Perception Engineer

Perception Engineer

We’re changing how machines move through unstructured environments – whether on the factory floor or in simulation. Built on next-generation computer processing and state-of-the-art software algorithms, our collision-free motion planning solutions make it possible for robots and other machines to instantly react to their environments and compute how and where to move as their situation is changing. We’re revolutionizing manufacturing by enabling close collaboration between robots and their surroundings, regardless of the robot brand. The sensor agnostic perception system provides the spatial awareness needed so the robots can operate collision free in unstructured environments. You will work with a variety of depth sensing and RGB cameras. In addition, the close integration between robot planning/control and perception enables customers to easily integrate other vision algorithms such as object detection, alignment and inspection into their automation. Our system strives for ease of use by abstracting the complexity of computer vision algorithms away from the end user.

Primary Responsibilities:

This role will solve difficult challenges for autonomous perception systems, addressing problems in real-time perception, decision-making, and high-dimensional planning. Will work closely with other Robotics & Perception engineers in collaborative, interdisciplinary teams to discover, invent, and build things that have meaningful revolutionary real-world impact.

Job Requirements:

  • Expertise with Computer Vision/Machine Learning/Deep Learning algorithms

  • Experience with depth sensing cameras, 3D reconstruction, camera calibration, and multi-modal fusion

  • Experience training deep neural networks, and network architectures for object detection, semantic segmentation/classification, tracking, and people sensing

  • Experience deploying robust computer vision algorithms into real world environments

  • Experience with CUDA and other accelerators a plus

  • Solid software engineering skills

  • Superior communication skills, both verbally and in writing

  • Ability to excel in international and collaborative teams

  • Motivation to initiate and accomplish ambitious research agenda

The ideal candidate will have many of the following key skills and qualifications:

  • C++/Python fluency, additional functional programming languages a plus

  • Write modern C++ code (C++11 & 14)

  • Multi-threaded development and Threaded Building Blocks (TBB)

  • OpenCV/PCL/ROS/Boost

  • Write production level C++ code taking design and architecture into consideration. Algorithms often have high frame rate throughput requirements.

  • Capable of direct customer interaction

  • Desire to work in a fast-paced startup environment

  • Nice to have: experience working with industrial robots, robotic pick-and-place or industrial automation

Below is a generic list of perception research duties and tasks:

  • Integrate with Depth sensing, RGB/IR, and work with a sensor agnostic perception stack

  • Install, calibrate, operate, or maintain cameras.

  • Supervise, technologists, technicians, or other engineers.

  • Write algorithms for perception applications.

  • Process or interpret signals or sensor data.

  • Evaluate stability of camera calibration in real world environments.

  • Debug perception programs.

Degree Requirement / Prior Experience:

  • MS/Ph.D. in Computer Science, Electrical or related discipline and 5+ years of relevant applied experience, or equivalent

Key Personality Traits:

  • A goal-oriented, highly motivated person that has a strong work ethic and commitment to customer satisfaction. The candidate should have a friendly, helpful personality who can communicate effectively in an interdisciplinary team.


Realtime Robotics, Inc. offers competitive pay, a high growth environment, and a benefits package that includes participation in health, dental and vision care plans; HSA with company contribution; 401(k) retirement plan; life insurance; and disability coverage.


If you are absolutely passionate about what we do, then send your cover letter, resume and job title to

Realtime Robotics, Inc. located at 27 Wormwood St Ste 110, Boston, MA 02210 is an equal opportunity employer. All candidates must be legally available to work in the United States.