Chunking Technique Research
June 9, 2026
After building RAG systems for technical books, I kept asking which chunking strategy actually retrieves better. I built a research platform to answer that with real vector search, LLM-as-judge ground truth, and metrics such as NDCG, MAP, and MRR. I compare fixed-length and overlap splitters with heading-aware and linguistically scored approaches. Some of this is still a heuristic, not a settled result.