Nishant Relan
Nishant Relan is an AI researcher whose published work spans multimodal models and their evaluation. Reka listed him among the team behind Flash and Edge in February 2024, and he coauthored the Core, Flash, and Edge report in April 2024. In May 2024, he coauthored Vibe-Eval, an open benchmark with 269 visual prompts for multimodal chat. The paper reported that automatic scoring with Reka Core roughly correlated with human judgment.
Timeline
-
February 2024
Reka Flash and Edge
In February 2024, Reka releases Flash, a 21B multimodal language model, and the compact 7B Edge. The launch lists Relan among the Reka Team.
-
April 2024
The Core, Flash, and Edge report
In April 2024, he coauthors a technical report on Reka Core, Flash, and Edge. The report says the models process and reason with text, images, video, and audio.
-
May 2024
An open benchmark for multimodal chat
In May 2024, he coauthors Vibe-Eval, an open benchmark with 269 visual-understanding prompts, 100 of them hard. The authors release its evaluation code and data through a public repository.
-
May 2024
Scoring with Reka Core
In May 2024, the paper proposes Reka Core as an automatic evaluator for multimodal chat models. Its scores roughly correlate with human judgment.
-
May 2024
Research at Reka
Reka lists him on the Reka Team in February 2024. His 2024 publications cover the Core, Flash, and Edge model series and the Vibe-Eval benchmark.
Most-cited works
- Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language ModelsWith Aitor Ormazabal, Che Zheng, Cyprien de Masson d’Autume, Dani Yogatama, Donovan Ong and Max Bain
- Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language modelsWith Aitor Ormazabal, Che Zheng, Cyprien de Masson d’Autume, Dani Yogatama, Donovan Ong and Max Bain
Sources and credits
Photo: We have no published photo of Nishant Relan yet. Send us a free-licensed photo.
- Reka Flash: Efficient and Capable Multimodal Language Models
- Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models
- Vibe-Eval: A hard evaluation suite for measuring progress of multimodal language models
- Nishant Relan
- GitHub - reka-ai/reka-vibe-eval: Multimodal language model benchmark, featuring challenging examples