I am currently the Head of Perception at Lyft Self-Driving Program. My team is responsible for all on-vehicle perception capabilities of Lyft's Autonomous Vehicle. This incldues Computer Vision, 3D Perception, Tracking, Sensor Calibration, and the machine learning infrasturure to deploy real-time deep learned models on the vehicle platform. Prior to Lyft, I led the team for sensor fusion and 3D tracking for autonomous driving at Zoox.
In my academic life, I obtained PhD in Computer Science from Cornell University. I was a visiting research scholar at the Stanford AI Lab where I started the Brain4Cars and RoboBrain projects. I also have a Bachelors degree in Electrical Engineering from IIT Delhi.
Blog post on sensor calibration for Autonomous Vehicle, August 2019
Lyft open sourced one of the largest 3D Perception and Prediction data set for Autonomous Vehicle, July 2019
Spotlight from Lyft on my journey, Feb 2019
One paper accepted to CVPR 2018.
Joined Lyft Self Driving Program, January 2018
Best student paper award at CVPR 2016 (Deep learning on spatio-temporal graphs)
PhD thesis, May 2016.
Structural-RNN accepted as an ORAL to CVPR 2016.
Our paper on sensory-fusion RNN-LSTM for driver activity anticipation is accepted to ICRA 2016
I recently gave talks at Oculus, University of Washington Seattle, Keynote at the ICCV workshop on Autonomous driving, BayLearn Symposium, Qualcomm, and Zoox Labs on: Deep Learning for Spatio-Temporal Problems: On Cars, Humans, and Robots (ppt with videos, 300MB) (pdf, 30MB)
Neuralmodels: A deep learning package for quick prototyping of structures of Recurrent Neural Networks and for deep learning over spatio-temporal graphs.
My recent talk at BayLearn 2015 on Brain4Cars
My research interest lies at the intersection of machine learning, robotics, and computer vision. Broadly, I build machine learning systems & algorithms for agents – such as robots, cars etc. – to learn from informative human signals at a large-scale. Most of my work has been in multi-modal sensor-rich robotic settings, for which I have developed sensory fusion deep learning architectures. I have developed and deployed algorithms on multiple robotic platforms (PR2, Baxter etc.), on cars, and crowd-sourcing systems.
Learning Preferences for Manipulation Tasks from Online Coactive Feedback.
Ashesh Jain, Shikhar Sharma, Thorsten Joachims, Ashutosh Saxena
IJRR 2015 [PDF]
Brain4Cars: Sensory-Fusion Recurrent Neural Models for Driver Activity Anticipation
Ashesh Jain, Shane Soh, Bharad Raghavan, Avi Singh, Hema S Koppula, Ashutosh Saxena
BayLearn Symposium 2015 [Extended abstract] (Full ORAL)
PlanIt: A Crowdsourcing Approach for Learning to Plan Paths from Large Scale Preference Feedback.
Ashesh Jain, Debarghya Das, Jayesh Gupta, Ashutosh Saxena
ICRA 2015 [PDF]
RoboBrain: Large-Scale Knowledge Engine for Robots
Ashutosh Saxena, Ashesh Jain, Ozan Sener, Aditya Jami, Dipendra K Misra, Hema S Koppula
ISRR 2015 [arXiv]
Anticipatory Planning for Human-Robot Teams.
Hema S Koppula, Ashesh Jain, Ashutosh Saxena
ISER 2014 [PDF]
Beyond Geometric Path Planning: Learning Context-Driven Trajectory Preferences via Sub-optimal Feedback.
Ashesh Jain, Shikhar Sharma, Ashutosh Saxena
ISRR 2013 [PDF]
Learning Trajectory Preferences for Manipulators via Iterative Improvement.
Ashesh Jain, Brain Wojcik, Thorsten Joachims, Ashutosh Saxena
NIPS 2013 [PDF]
Brain4Cars: Sensory-fusion deep learning for smart-cars
Interactive human-robot learning from coactive feedback
Anticipating driver maneuvers few seconds in advance
Structural-RNN: Deep Learning on Spatio-Temporal Graphs
Invited talk at Oculus (Facebook), April 2016
Keynote at the ICCV workshop on Autonomous driving. Title: Deep Learning for Spatio-Temporal Problems: On Cars, Humans, and Robots. Dec 2015
Invited talk at Zoox Labs (autonomous driving startup), Dec 2015
Talk at University of Washington Seattle Department of Computer Science, Nov 2015
Invited talk at Qualcomm Deep Learning Research Center, Nov 2015
Oral at BayLearn 2015 on Brain4Cars: Sensory-fusion Recurrent Neural Networks (Video)
Invited Talk at RSS Workshop on Model Learning for Human-Robot Communication, July 2015
Invited Talk at ICML Workshop on Machine Learning for Interactive Systems, July 2015
Invited Talk at ICRA Tutorial on Planning, Control, and Sensing for Safe Human-Robot Interaction, May 2015
Invited Talk at IIT Kanpur Department of Computer Science. RoboBrain and Learning from Weak Signals, Feb 2015
Stanford Semantics and Geometry Seminar. RoboBrain and Learning from Weak Signals, Feb 2015
Stanford Robotics Seminar. Learning from Weak Signals, Nov 2014
Introductory talk at LPCHS workshop RSS 2014. Learning from Humans. (Slides)
Cornell AI Seminar and ISRR 2013. Beyond Geometric Path Planning. (Slides)
ICML Robot Learning workshop 2013. (Slides)
Lecture at Indo-German Winter Acadmey 2010. (Slides)