UL2: Unifying Language Learning Paradigms Yi Tay, Mostafa Dehghani, Vinh Q Tran, Xavier Garcia, Jason Wei, Xuezhi Wang, Hyung Won Chung, Siamak Shakeri, Dara Bahri, Tal Schuster, Huaixiu Steven Zheng, Denny Zhou, Neil Houlsby, Donald Metzler.
In International Conference on Learning Representations (ICLR),
2023.
Confident Adaptive Language Modeling Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Q. Tran, Yi Tay, Donald Metzler.
In Neural Information Processing Systems (NeurIPS),
2022.
Transformer Memory as a Differentiable Search Index Yi Tay, Vinh Q Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Gupta, Tal Schuster, William W Cohen, Donald Metzler.
In Neural Information Processing Systems (NeurIPS),
2022.
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q Tran, Dara Bahri, Jianmo Ni, Jai Gupta, Kai Hui, Sebastian Ruder, Donald Metzler.
In International Conference on Learning Representations (ICLR),
2022.
Programming Puzzles Tal Schuster, Ashwin Kalyan, Oleksandr Polozov, Adam Tauman Kalai.
In Neural Information Processing Systems, track on Datasets and Benchmarks (NeurIPS),
2021.
Towards Debiasing Fact Verification Models Tal Schuster*, Darsh J Shah*, Yun Jie Serene Yeo, Daniel Filizzola, Enrico Santus, Regina Barzilay.
In Empirical Methods in Natural Language Processing (EMNLP),
2019.