Reliability of LLMs

Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs
In this work, we introduce the Learnable Response Scoring Function (LARS) for Uncertainty Estimation (UE) in generative Large Language …
Duygu Nur Yaldiz, Yavuz Faruk Bakman, Baturalp Buyukates, Anil Ramakrishna, Chenyang Tao, Dimitrios Dimitriadis, Salman Avestimehr
PDF Cite
Do Not Design, Learn: A Trainable Scoring Function for Uncertainty Estimation in Generative LLMs
MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs
Generative Large Language Models (LLMs) are widely utilized for their excellence in vari- ous tasks. However, their tendency to produce …
Yavuz Faruk Bakman, Duygu Nur Yaldiz, Baturalp Buyukates, Chenyang Tao, Dimitrios Dimitriadis, Salman Avestimehr
PDF Cite Code
MARS: Meaning-Aware Response Scoring for Uncertainty Estimation in Generative LLMs