ChatQA-1.5-llama3-70b (Zero-Shot, KILT)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Question AnsweringonNatural Questions
EM· uses extra data· 2024-01-18
47
best: 64 (Atlas (full, Wiki-dec-2018 index))
ChatQA: Surpassing GPT-4 on Conversational QA and RAG arXiv:2401.10225
Question AnsweringonTriviaQA
EM· uses extra data· 2024-01-18
85.6
best: 87.5 (Claude 2 (few-shot, k=5))
ChatQA: Surpassing GPT-4 on Conversational QA and RAG arXiv:2401.10225