PeopleofSuperintelligence

Researcher

Omer Levy

Omer Levy is a researcher whose papers cover word embeddings, pre-training methods and language model benchmarks, all of which concern how AI systems handle written language. In 2014 he and Yoav Goldberg published a NIPS paper on implicit matrix factorization in word embeddings, and in 2016 he completed a PhD at Bar-Ilan University. In 2020 he joined Tel Aviv University and co-authored SpanBERT and BART, and in 2021 he co-authored a study of transformer feed-forward layers as key-value memories. SCROLLS, a standardized comparison over long language sequences, came out in 2022 with him among its authors. As of October 2026, he is a Scholar in the ELLIS Tel Aviv unit at Tel Aviv University.

Works
142
Citations
49,574
h-index
48

Publication numbers from OpenAlex, as of 15 October 2026.

Timeline

  1. 2014

    Word embeddings as matrix factorization

    In 2014 he and Yoav Goldberg publish a paper titled Neural Word Embedding as Implicit Matrix Factorization at NIPS.

  2. 2016

    A PhD on word embeddings

    He studies at the Technion and completes a PhD at Bar-Ilan University in 2016 with Yoav Goldberg as an advisor.

  3. 2020

    Joining Tel Aviv University

    Tel Aviv University becomes his employer in 2020.

  4. 2020

    SpanBERT and BART

    SpanBERT and BART, two pre-training methods, list him as a co-author in 2020.

  5. 2021

    Feed-forward layers as memories

    The 2021 conference paper Transformer Feed-Forward Layers Are Key-Value Memories lists him as a co-author.

  6. 2022

    SCROLLS for long sequences

    SCROLLS, a standardized comparison over long language sequences, comes out in 2022 with him among its authors.

  7. 2023

    LMentry, a language model benchmark

    The 2023 LMentry paper, written with Avia Efrat and Or Honovich, presents a language model benchmark of elementary tasks.

  8. As of October 2026

    An ELLIS Scholar in Tel Aviv

    He is a Scholar in the ELLIS Tel Aviv unit at Tel Aviv University.

Sources and credits

Photo: We have no published photo of Omer Levy yet. Send us a free-licensed photo.

  1. Neural Word Embedding as Implicit Matrix Factorization papers.nips.cc. Checked 15 October 2026.
  2. Omer Levy - The Mathematics Genealogy Project mathgenealogy.org. Checked 15 October 2026.
  3. Omer Levy - Wikidata wikidata.org. Checked 15 October 2026.
  4. SpanBERT: Improving Pre-training by Representing and Predicting Spans - ACL Anthology aclanthology.org. Checked 15 October 2026.
  5. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension - ACL Anthology aclanthology.org. Checked 15 October 2026.
  6. Transformer Feed-Forward Layers Are Key-Value Memories - ACL Anthology aclanthology.org. Checked 15 October 2026.
  7. SCROLLS: Standardized CompaRison Over Long Language Sequences - ACL Anthology aclanthology.org. Checked 15 October 2026.
  8. LMentry: A Language Model Benchmark of Elementary Language Tasks - ACL Anthology aclanthology.org. Checked 15 October 2026.
  9. Omer Levy | European Laboratory for Learning and Intelligent Systems ellis.eu. Checked 15 October 2026.