Senior Data Engineer

Job d:

Location:

Cypress, California, United States Salary: $91,700 - $163,700/year

Job Area:
Technology Company:
United Health Group Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits and career development opportunities.

Come make an impact on the communities we serve as you help us advance health equity on a global scale. Join us to start Caring. Connecting. Growing together. This role supports the Identity Management rebuild initiative and ongoing support for the existing application. As part of the rebuild, the candidate will help build and support AI-enabled data pipelines that improve automation, monitoring, testing, data quality validation, and workflow efficiency.

The ideal candidate is a Data Engineer with 5+ years of experience in Python, Azure Databricks, PySpark, Azure Data Factory, and Git, along with hands-on exposure to enterprise-approved AI tools and custom AI agents to improve engineering productivity.

You'll enjoy the flexibility to telecommute
* from anywhere within the U.S. as you take on some tough challenges.

Primary Responsibilities:

Build, enhance, and support Azure data pipelines and data solutions for the Identity Management rebuild and existing application support

Develop and support data pipelines using Azure Databricks, Azure Data Factory, PySpark, Python, and Git-based development practices across development, staging, and production environments

Troubleshoot data issues, improve pipeline reliability, and contribute to performance tuning and cost optimization activities

Support ingestion, transformation, serving, monitoring, and data quality activities for distributed processing workloads while following data governance, privacy, and security expectations

Support the build and operationalization of custom AI agents to assist with development, testing, documentation, data validation, monitoring, production support, runbook execution, and data workflow automation

Use Databricks Genie, Git Hub Copilot, Microsoft 365 Copilot, and other enterprise-approved GenAI tools to accelerate pipeline development, automation, troubleshooting, documentation, analysis, and decision-making workflows

Maintain a minimum of 90% weekly usage of approved AI tools and leverage AI tools and agents to enhance coding, documentation, data analysis, testing, and delivery workflows

Collaborate with stakeholders, platform engineering, analytics, and application teams to support delivery priorities and communicate risks, dependencies, and progress clearly

Stay current with evolving AI capabilities and apply them to improve delivery quality, efficiency, innovation, and responsible engineering practices

You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear directions on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Required Qualifications:

Bachelor's Degree5+ years of hands-on data engineering experience building, supporting, and operating data pipelines and data platforms4+ years of proficiency in Python for programming, automation, data processing, and scripting4+ years of Azure Databricks experience, including pipeline development, job monitoring, workload support, performance tuning, and cost-aware development practices4+ years of PySpark experience for distributed data processing, transformations, data quality validation, and…