Word Embeddings

Jan 1, 2018

Analyzing the space of word representations for multilingual applications and for better performance with less data.

Embeddings NLP Deep Learning
Avatar
Tal Schuster
ML Researcher

Publications

Humpty Dumpty: Controlling Word Meanings via Corpus Poisoning

Word embeddings, i.e., low-dimensional vector representations such as GloVe and SGNS, encode word “meaning” in the sense …
Roei Schuster, Tal Schuster, Yoav Meri, Vitaly Shmatikov
January 2020 In IEEE Symposium on Security and Privacy (IEEE S&P)
PDF Project Video

Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing

We introduce a novel method for multilingual transfer that utilizes deep contextual embeddings, pretrained in an unsupervised fashion. …
Tal Schuster*, Ori Ram*, Regina Barzilay, Amir Globerson
June 2019 In North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL)
PDF Code Project Slides Video