VR Teleop Engineer, Large Behavior Models
About the position Responsibilities • Own the Teleop Stack: Architect the full teleoperation pipeline: ingest live camera + sensor streams, fuse 3D data, render in VR, and relay user commands back to the robot. • Develop Immersive Experiences: Build VR/XR systems that deliver high situational awareness and intuitive control with minimal fatigue. • Optimize Performance & Robustness: Optimize networking and processing to eliminate lag, preserve visual fidelity, and harden against bandwidth variability. • Collaborate Cross-Functionally: Partner with hardware, AI, and deployment teams, iterate on user-feedback, and ship production-grade teleoperation systems. Requirements • VR Teleop Expertise: 5+ years shipping VR or XR applications, particularly those ingesting and rendering live camera or sensor streams in a headset. • Real-Time Data Pipelines: Experience building real-time pipelines that fuse camera, depth, and pose. • UI/UX Design: Craft intuitive control schemes (controllers, hand-tracking, gestures) and in-VR UIs for teleoperation. • Strong Implementation: Proven track record building efficient, reusable low-level systems for performance-critical VR teleoperation components. • Collaborative Approach: Passion for robotics and ability to work closely with hardware and software teams to deliver high-quality user experiences. Nice-to-haves • Cloud-Streaming Architectures: Experience building interactive cloud applications with Apache Kafka or similar event-streaming platforms. • Haptics & Spatial Audio: Familiarity with integrating haptic feedback systems and spatial audio to improve immersion.