Senior/ Staff Machine Learning Research Scientist - Reinforcement Learning
Aug 31, 2023
Mountain View, California (HQ)
Who We Are
Nuro exists to better everyday life through robotics. The company’s custom electric autonomous vehicles are designed to bring the things you need—from produce to prescriptions—right to your home. Nuro’s autonomous, goods-focused solution can give you valuable time back and more freedom to do what you love. This convenient, eco-friendly alternative to driving has the potential to make streets safer and cities more livable.
About the Role
The mandate of the research team is to use advanced machine learning techniques to accelerate software progress. In this role, you will work closely with the software vertical teams to understand their pain points and explore novel and advanced machine learning methods to solve practical real-world challenging problems. If you love solving challenging new problems with a mindset of deriving practical solutions to eventually be used on the vehicle, come join us!
You will be primarily responsible for training RL model for planning in a real-world setting. It includes but is not limited to designing/using appropriate RL algorithms, improving value/risk estimation, tuning reward to shape good driving behavior, gathering appropriate training data, iterating and thinking about solutions from bad behaviors of the model, etc. The goal is to push RL performance to show that it can achieve comparable or better performance than traditional approaches for planning and that we can scale planning with more data and compute.
You should have a deep understanding of how RL works, understand major RL algorithms and their tradeoffs, and have hands-on experience in training RL models and making them work. You should have a strong interest in the problem and deploy models to the product to handle real-world scenarios. It is a plus if you have the experience to apply RL to some real-world problems with safety constraints.
In addition, you will participate in task solving using self-supervised learning to learn robust representations, exploring techniques for out-of-distribution detection to solve long tail problems, working on trajectory prediction and motion planning, investigating the robustness of models to mitigate uncertainties, or trying to build an end-to-end driving system.
About the Work
Research new machine learning problems and models
Work on joint trajectory prediction and motion planning
Iterate on RL planner to make it better than traditional methods in real-world scenarios and prove it is a scalable solution to planning
Develop various types of reward models including those based on human feedback
Collaborate with autonomy teams to understand their pain points and priorities to define milestones of the corresponding roadmaps
Derive practical solutions and deploy them on the NuroBot
You have deep expertise and prior experience in some or many of the following areas:
You have an M.Sc. plus 4 years of relevant work experience or a Ph.D. + 2 years of relevant work experience focusing on one or more of the following areas: Computer Science, Artificial Intelligence, Mathematics, or a closely related field
You have subject matter expertise and research in one or more of the following areas: Machine Learning, Deep Learning, Robotics
Deep knowledge and understanding of reinforcement learning and experience in how to train it well
Strong intuition and creativity in how to apply their knowledge for RL planning
Passionate about solving real-world challenging ML/Robotics problems
You have strong problem solving and programming skills in C++ or Python
Strong culture fit and good team player
Demonstrated research publications in any of the major conferences (RSS, ICRA, CoRL, CVPR, ICLR, ICML, NeurIPS, ICCV, AAAI, etc.)
At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected pay range is between $202,350 and $303,050/year for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.
At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.
You must be fully vaccinated against COVID-19 by your hire date to be eligible to start the role. Proof of vaccination will be required by your start date. Nuro will consider and review accommodation requests based on medical, religious, or other grounds as required by applicable law for qualified candidates.