RealityKit Spatial UI Rendering Engineer
-
Software Development
Job Description & How to Apply Below
Sunnyvale, California, United States Software and Services
Shape the future of spatial computing by building the rendering technologies that bring Apple's user interfaces into three dimensions. As part of the Reality Kit team, you'll architect and optimize the systems that turn conventional app interfaces into spatial experiences, delivering exceptional visual fidelity, responsiveness, and power efficiency on Apple's next-generation vision products. Operating at the intersection of Core Animation, SwiftUI, and Reality Kit, you'll advance the architecture that renders windows, text, and controls as spatial content in real time.
You'll also shape Reality View, the API through which developers combine app UI with 3D content. Your work will define the visual quality and performance characteristics of spatial UI, establishing the foundation on which developers and users interact with apps across Apple's vision ecosystem.
Description As a Spatial UI Rendering Engineer on the Reality Kit team, you'll own the rendering quality, power, and performance of spatial UI and Reality View. You'll drive the evolution of the rendering pipeline that brings Core Animation content into Reality Kit, and develop the GPU techniques necessary to ensure UI elements maintain exceptional clarity and performance under spatial viewing conditions.
Your scope includes texture resolution and filtering strategies, foveated and multi-view rendering of UI content, and the shader and render-pass optimizations that preserve the clarity of text and controls while minimizing GPU, memory, and power cost. You'll also own how Reality View renders app UI and 3D content together, from the underlying rendering integration to the developer-facing behavior and APIs.
You'll address complex rendering challenges, including maintaining legibility as viewing distance and render resolution change, rendering UI and 3D content together seamlessly, managing large texture workloads efficiently, and sustaining stable frame rates, memory, and power across extended sessions. You'll collaborate closely with the Core Animation, UI frameworks (UIKit, App Kit, and SwiftUI), Metal, and GPU teams to deliver cohesive solutions that meet Apple's standards for performance and user experience.
- Own the rendering quality, power efficiency, and performance of spatial UI, including GPU utilization, memory footprint, and frame latency
- Architect and evolve the Reality Kit rendering pipeline for Core Animation content, driving technical decisions from design through ship
- Own the rendering of Reality View content, including how app UI and attachments are rendered and composed with 3D content
- Design and evolve Reality View APIs and behaviors in partnership with the UI frameworks teams, giving developers powerful, intuitive tools to integrate UI with 3D content
- Develop and optimize GPU techniques for spatial UI, including texture resolution scaling, filtering, foveated rendering, and multi-view rendering, to deliver high visual fidelity efficiently on Apple silicon
- Optimize shaders, render passes, and GPU resource usage to reduce rendering cost without compromising visual quality
- Investigate and resolve visual-quality defects and performance, power, and memory regressions across Core Animation, Reality Kit, and Metal using Instruments, system traces, and Metal GPU debugging tools
- Develop automated image-comparison, performance, and long-duration stress testing that detects rendering regressions before they reach customers
- Mentor engineers, conduct code and design reviews, and uphold high engineering standards across the team
- Bachelor's degree in Computer Science, Computer Engineering, or equivalent practical experience
- 5+ years of professional experience in real-time graphics or rendering engine development
- Demonstrated ability to independently own and ship significant rendering features end to end
- Proficiency in C++ and shader programming languages (Metal Shading Language, GLSL, or HLSL)
- Solid understanding of texture sampling, filtering, and resolution management, and of GPU memory management and frame pacing
- Familiarity with foveated rendering, multi-view rendering, or other advanced real-time rendering techniques
- Proven record of diagnosing and resolving GPU performance, power, or memory issues using profiling tools such as Instruments, Render Doc, PIX, or Perfetto
- Experience debugging complex rendering issues across…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction