Conformal Prediction
Tal Schuster
ML Researcher
Publications
Conformal Language Modeling
We propose a novel approach to conformal prediction for generative language models (LMs). Standard conformal prediction produces …
Conformal Risk Control
We extend conformal prediction to control the expected value of any monotone loss function. The algorithm generalizes split conformal …
Confident Adaptive Language Modeling
Recent advances in Transformer-based large language models (LLMs) have led to significant performance improvements across many tasks. …
Conformal Prediction Sets with Limited False Positives
We develop a new approach to multi-label conformal prediction in which we aim to output a precise set of promising prediction …
Uncertainty Estimation for Natural Language Processing (Tutorial)
Accurate estimates of uncertainty are important for many difficult or sensitive prediction tasks in natural language processing (NLP). …
Consistent Accelerated Inference via Confident Adaptive Transformers
We develop a novel approach for confidently accelerating inference in the large and expensive multilayer Transformers that are now …
Few-shot Conformal Prediction with Auxiliary Tasks
We develop a novel approach to conformal prediction when the target task has limited data available for training. Conformal prediction …