Instant Eval & RRFFaithfulness · Relevance · PrecisionVector + FTS Hybrid Search

AI RAG Eval & Hybrid Search Tester

Test Faithfulness (hallucination detection), Context Precision and Vector + tsvector FTS hybrid RRF ranking in real time.

RAG Eval & Hybrid RRF Search Guide

Relying solely on dense vector similarity in RAG systems often misses exact product codes, acronyms and domain terms. Production-grade assistants need both hybrid RRF ranking and sentence-level Faithfulness evaluation.

Why Reciprocal Rank Fusion (RRF) is the standard

RRF merges dense vector cosine rankings and PostgreSQL tsvector FTS rankings using 1 / (k + rank) without brittle score normalization. Set up the underlying schema with Drizzle Schema & Zod Builder and AI SQL & Postgres Optimizer.

Faithfulness and hallucination detection

LLMs sometimes inject prices, SLA numbers or dates from pretraining that do not exist in the retrieved chunks. Sentence-level grounding highlights unsupported claims so you can catch hallucinations before shipping.

End-to-end RAG workflow

Pair this evaluator with AI RAG Chunking Visualizer for chunking, AI Prompt Injection Tester for security and AI Model Arena for side-by-side LLM benchmarking.

Frequently Asked Questions (FAQ)

RRF merges dense vector search and keyword (FTS) rankings using 1 / (k + rank). The k=60 constant dampens extreme top-rank swings so both semantic and exact-match chunks surface reliably.
Each sentence in the generated answer is checked against the retrieved chunks. Claims that lack grounding in the context are flagged as hallucination risks and reduce the faithfulness score.
If a chunk contains exact technical terms or codes from the user query, its strong FTS rank boosts its combined RRF score. The Rank Shift column shows this movement clearly.
No. This evaluator runs 100% client-side in your browser; your queries, answers and chunks are never transmitted externally.