Job Description
Contract duration- 6 months (can be extendable)
We are looking for an Embedded Engineer with expertise in hardware integration, video streaming, depth perception, and real-time processing to develop a video processing system with a dedicated kiosk interface. This role involves:
Selecting and integrating cameras (mono/stereo), Jetson boards, AI models, and GStreamer-based video pipelines
Developing a self-contained, plug-and-play kiosk system for surgical video recording, display, and file management
Key Responsibilities
1. Hardware & System Integration
Select and integrate mono/stereo cameras for laparoscopic imaging
Interface the camera with NVIDIA Jetson (Orin/Nano/Xavier) via MIPI CSI-2 and/or USB3.0
Optimize video capture pipeline for low latency and high-quality rendering
Implement real-time AI-based depth perception
2. Kiosk System Development
Design a plug-and-play embedded system with a dedicated touchscreen/UI
Ensure fast boot-up & auto-start of the video application
Develop an intuitive user interface using Qt for:
Live video streaming
File management (recording, screenshots, export)
Playback & review of saved videos
Simple touch-based controls for ease of use in operating theaters
3. Software & Video Processing
Develop a GStreamer-based video pipeline for real-time streaming
Work with V4L2 & OpenGL for video capture and rendering
Optimize image quality while maintaining low latency
Implement a custom Linux-based operating system to ensure:
Fast boot-up
Automatic application launch (kiosk mode)
Security & stability
4. AI & Depth Perception
Implement AI-based depth perception using models like MiDaS, FastDepth, or Monodepth2
Optimize AI inference for real-time performance using TensorRT on Jetson
Fine-tune depth estimation for high accuracy in surgical environments
5. Testing & Optimization
Perform latency analysis & real-time performance tuning
Conduct image quality, depth accuracy, and system stability tests
Implement secure file handling & data protection measures
6. Deployment & Compliance
Ensure seamless plug-and-play setup for the operating room
Follow medical compliance & regulatory standards
Document system setup, user guides, and maintenance instructions
Required Skills & Qualifications
Embedded Systems & Hardware
Experience with NVIDIA Jetson (Orin, Xavier, Nano, TX2, etc.)
Hands-on experience with MIPI CSI-2, USB, or optical fiber camera interfaces
Knowledge of camera sensors (Sony IMX, Basler, Framos, etc.)
Software Development
Proficiency in C/C++ and Python for embedded development
Strong experience with GStreamer, V4L2, OpenGL, and Qt
Familiarity with real-time video streaming & low-latency processing
Experience with Linux kernel, drivers, and fast boot optimizations
Kiosk System Development
Experience in Qt-based UI development for embedded devices
Knowledge of embedded Linux & secure OS development
Ability to implement auto-launch, file management, and touch-based UI
AI & Depth Perception
Experience in AI-based depth estimation (MiDaS, FastDepth, Monodepth2, etc.)
Knowledge of TensorRT, OpenCV, and Deep Learning frameworks (PyTorch, TensorFlow)
Security & Compliance
Experience with secure file handling & regulatory compliance (IEC 60601, FDA, etc.)
Understanding of data encryption & medical device security best practices
Preferred Experience
6+ years of experience in embedded systems, video processing, or AI-based imaging
Previous experience with medical imaging or real-time video processing
Experience working with stereo vision & 3D depth mapping
Experience in kiosk-based systems or embedded UI development (Good to have)
Any Graduate