Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
MonoQwen2-VL-v0.1 represents the inaugural visual document reranker aimed at improving the quality of visual documents retrieved within Retrieval-Augmented Generation (RAG) systems. Conventional RAG methodologies typically involve transforming documents into text through Optical Character Recognition (OCR), a process that can be labor-intensive and often leads to the omission of critical information, particularly for non-text elements such as graphs and tables. To combat these challenges, MonoQwen2-VL-v0.1 utilizes Visual Language Models (VLMs) that can directly interpret images, thus bypassing the need for OCR and maintaining the fidelity of visual information. The reranking process unfolds in two stages: it first employs distinct encoding to create a selection of potential documents, and subsequently applies a cross-encoding model to reorder these options based on their relevance to the given query. By implementing Low-Rank Adaptation (LoRA) atop the Qwen2-VL-2B-Instruct model, MonoQwen2-VL-v0.1 not only achieves impressive results but does so while keeping memory usage to a minimum. This innovative approach signifies a substantial advancement in the handling of visual data within RAG frameworks, paving the way for more effective information retrieval strategies.
Description
TILDE (Term Independent Likelihood moDEl) serves as a framework for passage re-ranking and expansion, utilizing BERT to boost retrieval effectiveness by merging sparse term matching with advanced contextual representations. The initial version of TILDE calculates term weights across the full BERT vocabulary, which can result in significantly large index sizes. To optimize this, TILDEv2 offers a more streamlined method by determining term weights solely for words found in expanded passages, leading to indexes that are 99% smaller compared to those generated by the original TILDE. This increased efficiency is made possible by employing TILDE as a model for passage expansion, where passages are augmented with top-k terms (such as the top 200) to enhance their overall content. Additionally, it includes scripts that facilitate the indexing of collections, the re-ranking of BM25 results, and the training of models on datasets like MS MARCO, thereby providing a comprehensive toolkit for improving information retrieval tasks. Ultimately, TILDEv2 represents a significant advancement in managing and optimizing passage retrieval systems.
API Access
Has API
API Access
Has API
Integrations
Hugging Face
Python
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
LightOn
Founded
2016
Country
France
Website
www.lighton.ai/lighton-blogs/monoqwen-vision
Vendor Details
Company Name
ielab
Country
United States
Website
github.com/ielab/TILDE/tree/main