Ron J. Weiss
Also known as R.J. Weiss, Ron Weiss
Ron Weiss is an AI researcher whose work spans speech recognition, speech translation, speech synthesis, and audio editing. He earned a PhD in electrical engineering at Columbia in 2009, completed a postdoc at NYU, and worked at Google on speech and music systems including Translatotron, Parrotron, and Wave-Tacotron. He researched neural interfaces at Facebook Reality Labs, contributed to Google DeepMind's video-to-audio research in 2024, and coauthored Recomposer in 2025. He is a researcher at Google, a role he resumed in 2022.
- Now at
- Works
- 76
- Citations
- 85,120
- h-index
- 43
- Rankings
- #85 by citations since 2021
Publication numbers from OpenAlex, as of 22 October 2026.
Timeline
-
2009
A Columbia PhD
In 2009, he completes a PhD in electrical engineering at Columbia University and works in the Laboratory for the Recognition of Speech and Audio.
-
By 2010
Postdoc at NYU
By 2010, he is a postdoctoral researcher in the Music and Audio Research Laboratory at New York University.
-
2015
Google speech and music research
At the 2015 SANE workshop, he is a software engineer at Google working on content-based audio analysis, music recommendation, and noise-robust speech recognition.
-
May 2019
Translatotron speech translation
In 2019, he coauthors Translatotron, a sequence-to-sequence model that translates speech directly between languages without intermediate text.
-
July 2019
Parrotron for atypical speech
In 2019, he coauthors Parrotron, a neural network that converts atypical speech directly into fluent synthesized speech.
-
2021–2022
Wave-Tacotron and neural interface
In 2021, he coauthors Wave-Tacotron, a neural network that generates speech waveforms directly from text. From 2021 to 2022, he works as a research scientist at Facebook Reality Labs on a neural interface.
-
2024–2025
Video-to-audio and Recomposer
In 2024, he contributes to Google DeepMind's video-to-audio research, which uses video and text prompts to generate synchronized soundtracks. In 2025, he coauthors Recomposer, a text-guided system for editing sound events in complex scenes.
-
Since 2022
Researcher at Google
He returns to Google as a researcher in 2022 and remains in the role as of October 2026.
Career
- Since 2022GoogleSoftware Engineer
- 2021–2022MetaResearch Scientist
- 2010–2011New York UniversityPostdoctoral Researcher
- 2006–2011Columbia University
Education
- 2009Columbia UniversityPhD
Most-cited works
- Scikit-learn: Machine Learning in PythonWith Alexandre Passos, Bertrand Thirion, David Cournapeau, Fabian Pedregosa, Matthieu Brucher and Matthieu Perrot
- Natural TTS Synthesis by Conditioning Wavenet on MEL Spectrogram PredictionsWith Yonghui Wu
- CNN architectures for large-scale audio classificationWith Malcolm Slaney
- Tacotron: Towards End-to-End Speech SynthesisWith Quoc Le, Samy Bengio and Yonghui Wu
- State-of-the-Art Speech Recognition with Sequence-to-Sequence ModelsWith Tara Sainath and Yonghui Wu
Sources and credits
Photo: We have no published photo of Ron J. Weiss yet. Send us a free-licensed photo.
- SANE 2015 - Speech and Audio in the Northeast
- Introducing Translatotron: An End-to-End Speech-to-Speech Translation Model
- Parrotron: New Research into Improving Verbal Communication for People with Speech Impairments
- Ron J. Weiss
- Ron J Weiss
- Generating audio for video — Google DeepMind
- Recomposer: Event-roll-guided generative audio editing
- Ron J Weiss — Lacuna



