Senior Computer Vision Engineer Onsite NY

Senior Computer Vision Engineer| Onsite (New York, NY) Full-time

Who we are:

Pakket builds remote control systems for warehouses. Specifically, we track customer's forklifts, pallet jacks, people, and trucks across their facility IP cameras, project them onto a shared bird's-eye-view floor map, and stream live positions to a customer-facing backend.

Our stack is a real-time Python pipeline (YOLO/Ultralytics detection, multi-object tracking, homography-based BEV projection), deployed on an on-site GPU edge server.

The system runs live at customer sites today. We are looking for a hands-on builder who is interested in owning the perception and the core of the multi-camera tracking systems.

• Build and improve the real-time pipeline: multi-camera RTSP capture, GPU decode, detection, fusion, and tracking.

• Improve tracking quality across cameras: association, track lifecycle, , occlusions, and track revival.

• Fine-tune, evaluate, and deploy detection models end-to-end — dataset prep through TensorRT/ONNX deployment.

• Optimize the compute budget: batching, quantization, latency/throughput on the edge GPU.

• Build the evaluation tooling that proves improvements: offline replay, ground-truth scoring (MOTA/IDF1/HOTA-tier metrics), and controlled A/B ablations.

• Own adjacent systems work: backend/API, deployment, observability, and internal admin tooling.

• Diagnose hard production failures from logs, replays, and captured data.

• 4+ years of hands on experience building Computer Vision systems

• Real-time multi-camera video: RTSP capture, FFmpeg/PyAV decode, GPU (NVDEC) decode, frame pacing, back pressure.

• Object detection with YOLO/Ultralytics end-to-end: dataset prep, fine-tuning, and deployment; inference optimization (batching, ONNX/TensorRT, CUDA).

• Camera geometry and calibration: intrinsics + lens distortion, homography estimation/application, projection to a shared ground plane; strong Num Py/OpenCV/Sci Py.

• Linux + remote GPU operations: SSH to an edge machine and a cloud VM, run systemd/Docker services.

• Experience building a system that ran in production on real video, and can speak to common failure modes.

• Warehouse/logistics or industrial CV domain experience

• Tracking objects across multiple cameras

• Small-model classification (Mobile Net-style) and sequence smoothing (e.g. HMM).

• Video encoding/distribution: NVENC, RTMP/HLS, MediaMTX.

• Familiarity with a startup environment. We're a small team so everyone's job is broader than the title.

• You can run and score a full-day replay of forklift movement end-to-end, and you've shipped one measured improvement to calibration, tracking quality, or latency with before/after numbers.

• You’ve gained familiarity with our detection, location and icon placement logic pipeline

• Engineering peers and field staff trust your diagnoses and write-ups

• You'll be a founding engineer: you'll receive meaningful equity, and ownership/control of the core technical system from day one

• Our team is small. While your core responsibility is computer vision, you will have the opportunity to work on any part of the stack that is meaningfully interesting to you (backend/API/calibration etc.)

• The problem is real and the demand is large: warehouses are a $1T+ industry still running on spreadsheets and radios. Our customers run some of the largest facilities in the country and are demanding a solution to solve their lack of visibility

• You'll see the direct impact of your work — your model will start being tested/run on a warehouse as soon as it's shipped, and you'll watch it get better every week.

• Competitive salary in a funded and rapidly growing company, and the opportunity to help build the company from the ground up.