Vasu Sharma
Applied Research Scientist Lead at Facebook AI Research | 7k+ citations | ex-Citadel | CMU | IIT Kanpur | Startup advisor & mentor | Angel Investor | EB1A green card recipient
Updated 8 months ago
13+
Years Experience
17
Roles
26
Skills
3
Education
About
Researcher | Dreamer | Computer Enthusiast | Believer in the power of Artificial Intelligence I am presently working as an Applied Research Scientist at Facebook AI research, working on building Multimodal foundational generative AI models. I am also interested in the domain of self supervised learning. I have published 45+ papers across top AI conferences like NeurIPS, CVPR, ACL, EMNLP, TMLR, ICLR, NAACL, COLM, WACV, Interspeech among others garnering over 7000+ citations. I routinely work with billion scale datasets to train these massive multimodal models. Previously I worked as Quantitative Researcher at Citadel where my work involved leveraging the power of Machine Learning and Statistical methods in an attempt to fathom the enigmatic world that is the financial markets. I have also worked at Amazon Alexa AI on large scale multimodal models and Embodied AI applications to bring smart robot intelligence to Alexa devices. I actively advise several early stage startups and often guest lecture at Stanford and CMU. I graduated from Indian Institute of Technology, Kanpur completing my Bachelors in Computer Science and Engineering and then completed my Masters in Machine Learning and Artificial Intelligence at the Language Technologies institute at Carnegie Mellon University. I am deeply passionate about research in my field. My research interests include: Deep Learning and it's uses in the field of Computer Vision, Speech and Music Processing and Natural Language Processing. My goal in life is to use technology to make this world a better place for everyone to live in. It is with this goal in mind that I work on several interesting projects which help me realize this dream, one step at a time. I have had the good fortune of working with some amazing people at some fantastic places and have learnt a lot from them. I hope to continue learning, travelling to new places and meeting new people. My mantra in life is- "Live life with passion - Love what you do, do what you love". Besides being a Technology enthusiast, I am also very passionate about sports. I was a part of the IIT Kanpur Aquatics team and love to swim, play Water Polo, Soccer and Cricket. I am also an ardent traveler and love exploring new places and cultures and love travelling the world making new friends on the way.
See Related Jobs
Based on skills & location
Get AI Resume
Generate a polished resume
Salary Benchmark
What does a Applied Research Scientist Lea earn?
Experience (17 roles)
Applied Research Scientist Lead
CurrentWorking with Facebook AI Research (FAIR) on research on Large scale multimodal foundational models on trillion scale datasets. Particularly interested in Generative AI research and production use cases and exploring the realm of Self supervised learning. Published list of papers: - DINOv2: Learning...
Startup Advisor
Current• Advised multiple startups and VCs on technical and AI strategies for scaling from ideation to series A/B/C stages. • Designed AI infrastructure and built AI native products to drive customer acquisition and growth. • Facilitated connections with VCs and assisted in hiring top talent to support com...
AI Research Director
• Led the development of a cutting-edge AI program to empower students with industry-relevant skills, leveraging top AI research experience from leading labs. • Implemented strategies to enhance students' prospects for admission to top universities and successful careers in the tech industry. • Coll...
Is this your profile, Vasu?
Claim it to keep it updated or request removal.
Education (3)
Indian Institute of Technology, Kanpur
Grade: CGPA : 9.99/10.0 and IIT JEE AIR: 165 Activities and societies: Programming Club, Aquatics Team, Counselling Service (Student Guide and Academic Mentor), Association for Computing Activities (ACA)
Carnegie Mellon University
Grade: 4.19/4.33 (Dept. Rank 1) Activities and societies: Masters in Language Technologies, specializing in application of Machine Learning techniques for Computer Vision and Natural Language Processing PhD dropout Masters in Language Technologies (MLT program) Language Technologies Institute, School of Computer Science
St.Columba's School, New Delhi
Grade: Percentage : 97%
Skills (26)
Certifications (20)▼
Neural Networks and Deep Learning
Coursera
Regression Models
Coursera Course Certificates
Cybersecurity and Its Ten Domains
Coursera Course Certificates
Text Mining and Analytics
Coursera Course Certificates
Statistical Inference
Coursera Course Certificates
Introduction to Programming with MATLAB
Coursera Course Certificates
Digital Signal Processing
Coursera
The Data Scientist’s Toolbox
Coursera Course Certificates
Practical Machine Learning
Coursera Course Certificates
Regression Models
Coursera Course Certificates
Exploratory Data Analysis
Coursera Course Certificates
Developing Data Products
Coursera Course Certificates
R Programming
Coursera Course Certificates
Cybersecurity and Its Ten Domains
Coursera Course Certificates
Getting and Cleaning Data
Coursera Course Certificates
Introduction to TensorFlow for Artificial Intelligence, Machine Learning, and Deep Learning
Coursera
Advanced Open Water Diver
PADI
Cluster Analysis in Data Mining
Coursera Course Certificates
Fundamentals of Digital Image and Video Processing
Coursera Course Certificates
Reproducible Research
Coursera Course Certificates
Publications (20)▼
Cyclegen: Cyclic consistency based product review generator from attributes
International Conference on Natural Language Generation (INLG 2018), Tilburg, Netherlands, 2018 · Nov 5, 2018
Intracranial electroencephalography reveals real world vision in humans is a contextually modulated, distributed, and active sensing process
Journal of Vision · Oct 20, 2020
Attend and Attack: Attention Guided Adversarial Attacks on Visual Question Answering Models
NIPS 2018 (Security in Machine Learning Track), Montreal, Canada · Dec 2, 2018
BioAMA: Towards an End to End BioMedical Question Answering System
Published at Annual Meeting of the Association for Computational Linguistics(ACL), BioNLP track, Melbourne, Australia 2018 · Jun 1, 2018
Analyzing Newspaper Crime Reports for Identification of Safe Transit Paths
Proceedings of NAACL-HLT 2015 Student Research Workshop (SRW) · Jun 1, 2015
PISA: PoIncaré Saliency-Aware Interpolative Augmentation
Proc. Interspeech 2022, 2663-2667 · Sep 18, 2022
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
COLM 2024 · Mar 12, 2024
Tweet Based Reach Aware Temporal Attention Network for NFT Valuation
EMNLP 2022 · Dec 7, 2022
Mind Your Language: Learning Visually Grounded Dialog in a Multi-Agent Setting
Published at CVPR, VQA Challenge and Visual Dialog Workshop, Salt Lake City, USA, 2018 · Jun 1, 2018
Segmentation Guided Attention Networks for Visual Question Answering
Annual Meeting of the Association for Computational Linguistics, ACL 2017, Vancouver, Canada · Jul 1, 2017
Alexa Arena: A User-Centric Interactive Platform for Embodied AI
Neurips 2023 · Mar 2, 2023
MAViL: Masked Audio-Video Learners
Published at Neurips 2023 · Dec 15, 2023
Automatic tagging and retrieval of E-Commerce products based on visual features
Proceedings of NAACL-HLT 2016 Student Research Workshop (SRW) · Jun 15, 2016
Community Regularization of Visually-Grounded Dialog
International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Montreal, Canada, 2019 · Jan 1, 2019
A Deep Neural Network Based Approach For Vocal Extraction From Songs
IEEE's International Conference on Signal and Image Processing Applications 2015.
DINOv2: Learning Robust Visual Features without Supervision
Transactions of Machine Learning research (TMLR) journal · Apr 14, 2023
Multi Agent Dialog Framework for Visual Dialog
Adaptive Learning Agents (ALA) 2018, Stockholm, Sweden · Jul 1, 2018
CH-MARL: A Multimodal Benchmark for Cooperative, Heterogeneous Multi-Agent Reinforcement Learning
Robotics: Science and Systems 2022 · Jul 10, 2022
Multimodal Behavioral Markers Exploring Suicidal Intent in Social Media Videos
21st ACM International Conference on Multimodal Interaction · Oct 14, 2019
Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning
Jul 14, 2023
Languages (4)▼
Honors & Awards (20)▼
Selected for Deep Learning Summer School 2016
Issued by Canadian Institute for Advanced Research (CIFAR) · Jan 2016
Associated with Indian Institute of Technology, Kanpur Among the few internationally selected students and among the very few undergrads overall to be selected for Deep Learning Summer School 2016.
KC Mahindra Scholarship
Issued by KC Mahindra Organization · Jul 2017
Selected for DeepLearn Workshop, Bilbao
Issued by DeepLearn 2017 · Jul 2017
JN Tata Endowment Fund Scholarship
Issued by JN Tata Endowment Fund · Jul 2017
I was among the few students from across the country chosen for the JN Tata Endowment Fund Scholarship for pursuing my graduate education at Carnegie Mellon University.
Area Chair at EMNLP 2024
Jun 2024
Associated with Meta Served as Area Chair at EMNLP 2024
Area chair at ACL ARR 2022
Issued by ACL ARR · Dec 2022
Associated with Meta Serving as an area chair for ACL ARR from Dec 2022 to present
Overall Champions, Water Polo, Inter IIT 2014
Issued by Indian Institute of Technology · Jan 2014
Associated with Indian Institute of Technology, Kanpur
S.N. Bose Scholars program
Issued by SN Bose foundation · Jan 2014
Associated with Indian Institute of Technology, Kanpur
Reviewer at Neurips 2023
Apr 2023
Associated with Meta
Selected for Google Mountain View Internship program, Qualcomm San Diego Internship program and University of California, Irvine's Internship program
Jan 2015
Associated with Indian Institute of Technology, Kanpur
Sports Scholarship for leadership & excellence in sports
Issued by Games and Sports Council, IIT Kanpur · Jan 2013
Sports Scholarship from IIT Kanpur for leadership & excellence in sports
World Quantitative and Science Scholarship
Issued by WorldQuant · Jan 2014
Associated with Indian Institute of Technology, Kanpur Awarded the prestigious World Quantitative and Science Scholarship from Worldquant (Among the 30 students from all over the world and 2 from India, chosen across all years and departments).
Academic Excellence Award
Issued by IIT Kanpur
Associated with Indian Institute of Technology, Kanpur Awarded the Academic Excellence award by IIT Kanpur for Outstanding academic performance.
Outstanding Freshman of the year
Issued by Student's Gymkhana, IIT Kanpur · Jan 2013
Associated with Indian Institute of Technology, Kanpur Awarded the Outstanding Freshman of the year by Student's Gymkhana for all round performance in Academics and Sports.
Best Incoming Sportsperson
Issued by Games and Sports Council, IIT Kanpur · Jan 2013
Associated with Indian Institute of Technology, Kanpur Awarded Best Incoming Sportsperson 2012 by the Games and Sports Council, IIT Kanpur
Selected for Advances in Computer Science Technology Workshop at NUS
Issued by National University of Singapore · Jan 2016
Among the 20 students selected from South East Asian region to attend Advances in Computer Science Technology Workshop at National University of Singapore.
Institute Of Engineering Technology National Scholarship
Issued by IET · Jan 2014
Associated with Indian Institute of Technology, Kanpur Shortlisted for the Institute Of Engineering Technology National Scholarship.(Among the 168 selected from over 3,700 applicants from the top engineering colleges of India)
Reviewer at ACL and NAACL conferences
Issued by Association of Computational Linguistics (ACL) · Jan 2018
Associated with Carnegie Mellon University
2nd Best oral presentation at LTI Student Research Symposium, CMU
Issued by School of Computer Science, Carnegie Mellon University · Aug 2017
Associated with Carnegie Mellon University Awarded the 2nd best oral presentation at the annual Student Research Symposium organized by Language Technologies Institute at CMU for my presentation on "Segmentation Guided Attention Networks for Visual Question Answering"
Invited talk at National University of Singapore
Issued by National University of Singapore · Jan 2016
Associated with Indian Institute of Technology, Kanpur Gave an invited talk on "A Deep Autoencoder based approach for Music Retrieval‟ at Sound and Music Technology Group at National University of Singapore.
Frequently Asked Questions
What is Vasu Sharma's current role?▼
Where did Vasu Sharma study?▼
What skills does Vasu Sharma have?▼
Where is Vasu Sharma based?▼
Related Jobs
View all jobs →
Growth Lead
fonio.ai
Senior Data Scientist
Preplaced
Founding Customer Success Lead
Minoa
Growth Lead
Pool
Engineering Lead, ML Infrastructure + Data Engineering
Grid
Medical AI Researcher
Tessel AI: Rigorous Medical Imaging AI Evaluation for Hospitals
Other Profiles
Browse all →
Stanley T.
Senior Design & Research Operations Principal at Full-time · 3 yrs 5 mos
United States
Vasant Honavar
Faculty Member, Huck Institutes of the Life Sciences at 11 yrs 11 mos
United States
Aakash Anil Kolekar
AI Research Scientist - Foundational Model @ Amazon Ads Research at Full-time · 2 yrs 1 mo
United States
Ariel Wald
Independent Consultant GTM Director at Ariel Wald Consulting Enterprises
United States
Ariel Wald
Technical Sales Director at Stealth AI Startup
United States
Looking for your next role?
Chat with Clera to discover job matches, salary insights, and get a polished AI-generated resume.
Chat with CleraThis profile is based on publicly available information. Vasu is not affiliated with or endorsed by Clera. Privacy Policy