Avatar

Tal Schuster

ML Researcher

Google Research

Biography

I am a Research Scientist at Google Research where I work on developing methods for improving the robustness, reliability, and efficiency of Machine Learning models. Specifically, I develop reliable uncertainty estimates for practical applications. For example, to control and improve adaptive computation capabilities, or to derive small and accurate prediction sets. Currently, I am mainly working on Natural Language Processing applications, focusing on improving the precision of information-related tasks. For example, improving the robustness of Fact Verification and Language Inference systems, and leveraging them for solving related classification and generation tasks.

I have also worked on Deep Learning for Computer Vision, Medical applications, Computational Chemistry, as well as other topics in NLP including static and contextual Word Embeddings, Large Language Models, Transfer Learning, Cross-Lingual, Question Answering, program synthesis, and more. Many of my projects have been featured in global media.

I've completed my Ph.D. at MIT CSAIL, advised by Prof. Regina Barzilay, and was a member of the NLP and Learn To Cure groups. Before coming to MIT, I completed my MSc at Tel-Aviv University, advised by Prof. Lior Wolf.

Interests

  • Machine Learning
  • Natural Language Processing
  • Computer Vision

Education

  • PhD in Computer Science

    Massachusetts Institute of Technology

  • MSc in Computer Science

    Tel Aviv University

  • BSc in Mathematics and Computer Science

    Ben-Gurion University

Projects

*

Conformal Prediction

Confidence-aware predictions

Word Embeddings

Dense representations of words

Fact Verification

Identifying false or inaccurate facts

Medical

Deep learning for cancer risk prediction

Metric Learning

Deep metric learning

More Publications

Conformal Language Modeling

2023.

PDF Project

LAIT: Efficient Multi-Segment Encoding in Transformers with Layer-Adjustable Interaction

Annual Meeting of the Association for Computational Linguistics (ACL), 2023.

PDF Project

PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition

Findings of ACL, 2023.

PDF Dataset Project

Conformal Risk Control

2023.

PDF Project

UL2: Unifying Language Learning Paradigms

In International Conference on Learning Representations (ICLR), 2023.

PDF Code

Transformer Memory as a Differentiable Search Index

In Neural Information Processing Systems (NeurIPS), 2022.

PDF Video

Teaching

TA: 6.883 - Modelling with Machine Learning

Syllabus

Community Service

Area Chair

NeurIPS 2023, EMNLP 2023

Program Committee and reviewing

NeurIPS, ICLR, ICML, AAAI, NAACL, ACL, EMNLP, ARR

Tutorials

COLING, 2022: Uncertainty Estimation for Natural Language Processing

Workshops

ACL, 2023: Fourth Workshop on Simple and Efficient Natural Language Processing (SustaiNLP)

Contact

  • {first+last}@google.com
  • DM Me