[Job Radar](https://jobradar.live/) / [Jobs](https://jobradar.live/ilanlar) / Senior Perception Engineer Active Hybrid San Mateo Hybrid, California, United States Posted · 18.06.2026 Ashby (US) # Senior Perception Engineer XDOF At XDOF, we’re at an inflection point. Frontier labs are racing to build general-purpose robots, and high-quality training data is the bottleneck. We’re building the foundation behind the foundation models – the data collection systems, operational capability, exabyte-scale data warehouse, and software toolchain – to help our partners drive the field forward. The Perception Algorithm team transforms raw multimodal sensor data into high-quality robot training annotations. You will be deeply involved in the complete loop from data collection to model delivery — sensor calibration, SLAM localization, human pose estimation, perception model training, and embedded deployment. Your work directly determines the quality ceiling of our training data. Core Responsibilities Human Pose Estimation • Design and optimize hand pose estimation pipelines supporting accurate joint angle extraction from teleoperation data collection • Build full-body pose estimation systems for motion capture and teleoperation action annotation ground truth generation • Research and apply vision-based pose estimation methods (markerless) to reduce data collection costs • Fuse pose estimation outputs with robot joint angle data to generate consistent training annotations Robot Perception & Calibration • Design and maintain intrinsic/extrinsic calibration pipelines for multi-camera arrays (factory calibration + online recalibration) • Build visual SLAM / V-SLAM systems supporting real-time localization and scene reconstruction on data collection platforms • Implement hand-eye calibration between cameras and robot end-effectors • Develop temporal alignment solutions across multimodal sensors (cameras, IMU, data gloves, force sensors) Perception Model Training & Deployment • Train and iterate on perception models including object detection, instance segmentation, and 6DoF pose estimation • Optimize model inference using TensorRT / CUDA for real-time performance on robot embedded platforms • Write custom CUDA kernels for low-level acceleration of perception tasks • Design evaluation metric frameworks for perception models; continuously track the relationship between model performance and data quality End-to-End Loop from Data Collection to Model Delivery • Contribute to the design of automated annotation pipelines that convert sensor data into structured training labels • Build Auto QA modules to filter low-quality data including anomalous frames, failed demonstrations, and sensor dropouts • Collaborate with ML engineers and data infrastructure teams to ensure perception output formats meet downstream VLA model training requirements • Establish feedback mechanisms linking perception accuracy to model training outcomes, continuously improving annotation quality Requirements Must-Have • 5+ years of industry experience in robot perception or computer vision • Strong 3D vision fundamentals: stereo and structured-light camera principles, 3D reconstruction • Proficiency with SLAM frameworks (ORB-SLAM, VINS-Mono, FastLIO, etc.) or V-SLAM system development experience • Hands-on engineering experience with human pose estimation: hand joints (MediaPipe, MANO) or full-body pose (OpenPose, SMPLify, etc.) • Proficient in deep learning training frameworks for perception model training, tuning, and evaluation • TensorRT deployment experience with real-time inference optimization on embedded platforms (Jetson, Horizon, etc.) • CUDA programming fundamentals; ability to write or debug custom kernels • Proficient in C++ and Python with ROS / ROS2 development experience • Proficient with AI coding agents Nice to Have • Engineering experience with 6DoF object pose estimation (FoundPose, FoundationPose, GDR-Net, etc.) • Familiarity with 3D Gaussian Splatting or NeRF for scene reconstruction or data augmentation • Experience with robot manipulation or teleoperation systems • End-to-end development experience with automated annotation pipelines or ground truth generation systems • Published research in perception, pose estimation, or robotics What We Offer • Direct involvement in the most critical technical challenge in embodied intelligence: producing high-quality robot training data • An environment working alongside top-tier robotics engineers and ML researchers • Proprietary hardware platforms (humanoid robots, camera arrays, data gloves) • A fast-paced, high-autonomy 0→1 work environment This job was verified from Ashby (US). Applications are completed on the original source. [Apply on the original listing ↗](https://jobradar.live/ilan/0c5ceea4-7717-496f-a83e-acfb7a628a0e/git) ## Stop searching one by one for roles like this. Upload your resume or enter your target roles to see your first 3 matches for free. [Find jobs for me →](https://jobradar.live/uye/kayit) Your resume is never shared with employers; it is processed only for matching. Something wrong with this job? ## Similar jobs [XDOF Jobs](https://jobradar.live/company/xdof) · [Jobs in California](https://jobradar.live/jobs/california) · [Jobs by location](https://jobradar.live/jobs) · [Jobs by company](https://jobradar.live/company) - [Senior Production Systems/Test Engineer](https://jobradar.live/ilan/c20ba3c6-9d24-4ce8-930a-71c256cf5bd6) Carbon, Inc. · Santa Clara, CA - [Manager, Business Operations](https://jobradar.live/ilan/fda8d056-8999-4291-bc95-5dfa08087292) Zynga · Bay Area, CA - [Software Engineer, Data Infrastructure](https://jobradar.live/ilan/5d51b148-68ab-40aa-9e9c-49b3859013bb) Intrinsic · Mountain View, California - [Commercial Data Scientist](https://jobradar.live/ilan/ed7c5097-37b5-44ae-82a5-59c57b308221) Doximity · San Francisco, CA or Remote (U.S.) - [Sr Robotics Software Engineer](https://jobradar.live/ilan/bfb6a94b-75f1-49d3-9a7d-628b20622cb0) Blue River Technology · Santa Clara, CA - [Nurse Practitioner](https://jobradar.live/ilan/5d790802-8eeb-4708-afb1-0e68b352a16c) Upward Health · Alameda, California - [Quality Assurance Manager](https://jobradar.live/ilan/0ac2c3e8-130d-4b72-8524-16bb5f6d14e9) SI-BONE, Inc · Santa Clara, CA - [Wholesale Sales Associate](https://jobradar.live/ilan/97c28e9e-ca59-483f-90d3-b1efa0e8fbe8) Revivn · Fresno, CA