Senior Data Engineer

Overview

The Senior Data Engineer plays a pivotal role within our expanding Data and AI team. This person helps build and scale our next-generation data platform, starting with our modernization initiative; transitioning from legacy ingestion processes embedded in C# .NET code to a scalable, cloud-native architecture on AWS and expanding into our Databricks analytical data platform for advanced processing and analytics. This is a highly impactful, hands-on role responsible for designing and implementing AI-assisted data pipelines and distributed systems that power data product, analytics, data science, and operational use cases.

Starting base pay for this role is between $117,000 and $146,000. The actual base pay is dependent upon many factors, such as transferable skills, work experience, business needs, training, location, and market demands. The base pay range is subject to change and may be modified in the future. This role will be eligible for a bonus as well as competitive medical, dental, and vision benefits, wellness reimbursement, life insurance, and a 401(k) with company match.

We offer vacation and sick leave benefits (under a flexible time off policy in most states).

• Designs and implements scalable data-ingestion pipelines using AWS services (e.g., S3, Lambda, API Gateway, Glue, Step Functions, Amazon Bedrock, Amazon Agent Core) and Azure Dev Ops
• Builds APIs and file upload mechanisms for client data ingestion
• Develops data mapping and transformation workflows for loading into SQL Server client databases
• Contributes to the design and implementation of a data Lakehouse architecture leveraging Databricks
• Enables seamless data flow from the SaaS platform to the analytical platform
• Optimizes ETL/ELT processes for performance and reliability
• Collaborates with analytics teams to ensure data availability and quality for reporting and machine learning use cases
• Provides operational support for existing ingestion processes integrated into C# .NET code and UI
• Troubleshoots and resolves data pipeline issues across environments
• Works closely with Software Engineers, Architects, and Product teams to align data solutions with business needs
• Implements best practices for data governance, security, and compliance in a multi-tenant environment
• Documents architecture, workflows, and operational procedures

• Bachelor’s degree in Computer Science, Information Technology, or a related field required
• 7+ years in Data Engineering or related role
• Strong experience with AWS services for data engineering (S3, Lambda, Glue, Step Functions, API Gateway)
• Proficiency in Python and/or C# .NET for data processing and integration
• Hands-on experience with SQL Server and relational database concepts
• Familiarity with Databricks, Spark, and Lakehouse architectures
• Knowledge of ETL/ELT design patterns and data modeling
• Experience building APIs and file-based ingestion solutions
• Exposure to multi-tenant SaaS environments is a plus
• Strong problem-solving and analytical skills
• Ability to work collaboratively in a cross-functional team
• Excellent communication and documentation skills

• Experience with CI/CD pipelines for data workflows
• Knowledge of data governance and security best practices in cloud environments
• Familiarity with modern data integration tools and frameworks
• Exposure to machine learning pipelines and real-time data processing

• Medical and Dental coverage available for employees, dependents, domestic partners, and spouses
• Paid Time Off – Flexible options plus 10 paid company holidays where available
• All full-time positions are hybrid, with many eligible to be completely remote
• Vision insurance, Short & Long-Term Disability Insurance, and Basic Life Insurance provided
• Generous family leave options—including adoption and foster care placements
• Pre-Tax Savings Accounts – Flexible Spending Account, Health Savings Account, Commuter Benefits, Dependent Care Savings Account
• Retirement Savings – 401(k) with company match up to 4%
• Employee Assistance Program (EAP) – Confidential & Free support offered to colleagues facing personal or work-related complications
• Education Assistance Program – to…