www.offworld.ai

Reinforcement Learning Robotics Research Scientist

Based in Pasadena, CA

OffWorld is a robotics startup working on developing a mobile robotic workforce for heavy industrial jobs on Earth, Moon, asteroids & Mars. OffWorld was founded by an experienced engineering team drawing on decades of tackling formidable engineering challenges at NASA, ESA, NOAA, Maxar Technologies, CERN, Reaction Engines, SAFRAN, Surrey Satellites and Cisco. OffWorld’s first challenge is developing and maturing a modular robotic system for extreme environments on Earth. Our robots will go deeper underground and further on Earth than humans can, eliminating the need for humans to work in life-threatening environments in mining, construction, tunneling and other dangerous industries. They will also dramatically reduce the environmental footprint and cost of operations in key economies on Earth and beyond.

At OffWorld, we see Machine Learning (in particular Deep Reinforcement Learning) as the key enabler for developing sufficiently autonomous robots capable of continuously improving their performance. Recent advances in Reinforcement Learning make us believe that now is the right time for RL to crawl out of simulators and learn in the real physical world.

For more details on our AI approach and philosophy please see https://offworld.ai/ai.

We are looking for a talented Machine Learning Research Scientist to work on identifying and developing RL methods that are suited for real-world robots operating in unstructured environments. The initiative that will be the main focus for this role revolves around human demonstrations as a way to overcome hard exploration, sparsity of rewards and other challenges of real-world applications. An ideal candidate has deep knowledge of the state of modern RL, keeps tabs on new research and developments in the field, and has strong development skills allowing him/her to prototype solutions based on the latest research and novel ideas.

Key responsibilities:

• Advance the state of RL in the realm of real-world robotics
• Implement, develop, adapt, and conceive RL algorithms that match OffWorld’s strategic goals
• Keep track of all recent algorithms, concepts and innovations in the field of RL for robotic control, human demonstrations, improvements of sample complexity, and other concepts on a deep technical level, allowing to further experiment with algorithmic ideas and propose novel techniques
• Contribute to research initiatives and scientific publications
• Maintain high development standards and rigorousness of methodology

To hit the ground running, you need:

• MSc in Computer Science with a focus on Reinforcement Learning and research background, which may include work at a research lab or thesis work. (PhD is a plus)
• Experience working with RL for robotic applications is a strong plus, but not a hard requirement
• Theoretical base and practical experience with modern Reinforcement Learning algorithms and strong understanding of fundamental machine learning concepts
• Good Python programming skills, experience with machine learning and deep learning frameworks
• Strong understanding of software development practices
• Demonstrated experience with Linux shell, Docker, Git and other coding tools
• Familiarity with ROS and robot simulation software
• Nothing-is-impossible attitude

In a nutshell, we offer the:

• Opportunity to sink your teeth into cutting edge industrial robotics problems
• Opportunity to contribute to the mission of transforming how we mine on Earth today and how we will one day mine on the Moon, asteroids & Mars
• Opportunity to work with a kind, brilliant and supportive team
• Opportunity to join the OffWorld team if
  • You are as crazy-excited about the mission as we are
  • You’ve demonstrated you are The Right Stuff

Expected Compensation:

• $142,000 - $198,000/annual salary + stock awards + benefits

Our benefits package includes the following:

• Robust medical plan offerings with 0 to limited paycheck deductions
• Dental and vision insurance
• Unlimited Paid Time Off
• 401K Match

Pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements dependent on the position offered. Details of participation in these benefit plans will be provided if an employee receives an offer of employment.

OffWorld is an Equal Opportunity / Affirmative Action employer committed to diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, age, national origin, disability, protected veteran status, gender identity or any other factor protected by applicable federal, state or local laws.

OffWorld is also committed to working with and providing reasonable accommodations to individuals with disabilities. Please let your recruiter know if you need an accommodation at any point during the interview process.

Xrah4moxOh