Perception Algorithm Engineer

Cupertino, California, United States

As a member of the team, you’ll have the opportunity to work with a team of highly skilled engineers and scientists to bring new experiences to Apple products. We are looking for a self‑motivated algorithm engineer who is passionate about blending modern deep learning with robust classical techniques.

• This position requires strong technical and interpersonal skills to handle responsibilities including:
• Designing and implementing a robust, real‑time multi‑object tracking system to solve real‑world computer vision problems.
• Leveraging multimodal estimates (vision, audio, etc.) to ensure robust, high‑fidelity estimation across complex and challenging environments.
• Developing rigorous evaluation frameworks, curating datasets, and defining metrics to benchmark model performance, analyze edge cases, and continuously improve perception pipelines.
• Integrating perception systems into a larger software stack with real‑world performance constraints.

• PhD in Computer Science, Robotics or MS with 3+ years industry experience.
• Proficiency in systems programming (C++/Swift) and writing performant, production‑quality code.
• Fluency in Python and modern ML frameworks (e.g., PyTorch, JAX) with a solid foundation in machine learning and traditional perception and state‑estimation pipelines.
• Ability to break down complex problems into testable solutions, prioritizing challenging edge cases and accessible experiences for all users.
• Curiosity about new technologies, flexibility, and an openness to ambiguity.

• Experience designing scalable evaluation pipelines for learning‑based and classical perception pipelines.
• Experience in building and/or deploying on‑device computer vision models or multi‑object tracking systems.
• Domain expertise such as machine learning approaches and architectures (e.g., VLMs, VLAs, foundation models, self‑supervision, distillation, or data augmentation techniques).
• Experience with classical and modern computer vision approaches, reconstruction pipelines, image processing/camera systems and computational photography pipelines.
• Experience with multimodal data fusion across sensors, including audio processing (e.g., DSP, echo cancellation, audio‑visual diarization, speech recognition).
• Knowledge of robotics software stack (e.g., kinematics, planning, controls) alongside state estimation methods (e.g., SLAM, factor graphs, filtering, sensor fusion) and reinforcement learning methods.
• Strong applied math background (e.g., numerical optimization, geometry, graphics).
• Familiarity with Swift and Apple developer tools.

Base pay range: $147,400–$272,100, determined by skills, qualifications, experience, and location.

Employees may become shareholders through Apple’s discretionary employee stock programs, purchase Apple stock at a discount via the Employee Stock Purchase Plan, and may receive discretionary bonuses or commissions, relocation assistance, and tuition reimbursement for career‑related education. Benefit details include comprehensive medical and dental coverage, retirement benefits, discounted products and free services, and more.

Apple is an equal‑opportunity employer committed to inclusion and diversity. All applicants are evaluated without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or other legally protected characteristics.

Apple values accessibility as a fundamental human right and encourages diverse perspectives.