Senior Data Engineer - Databricks & Lakehouse Lead
Listed on 2026-11-01
-
Software Development
Data Engineering
Our Company
Explore how you can contribute at Ameri Life.
Our Company
Explore how you can contribute at Ameri Life.
For over 50 years, Ameri Life has been a leader in the development, marketing and distribution of annuity, life and health insurance solutions for those planning for and living in retirement.
Associates get satisfaction from knowing they provide agents, marketers and carrier partners the support needed to succeed in a rapidly evolving industry.
Job Summary
We are seeking an experienced Senior Data Engineer to design, build, and optimize enterprise data products and modern data pipelines on Databricks. This role is responsible for developing scalable, metadata-driven data solutions that power enterprise reporting, analytics, AI, operational applications, and business intelligence.
The ideal candidate has deep expertise in Databricks, Apache Spark, Delta Lake, and modern Lakehouse architecture, with strong experience designing enterprise-grade data engineering solutions.
Job Description
What You'll Do
Enterprise Data Engineering
- Design and develop scalable Spark-based ETL and ELT pipelines.
- Build enterprise data products using Medallion Architecture.
- Develop Bronze, Silver, Gold, and Semantic data layers.
- Engineer reusable enterprise data assets for business consumption.
- Optimize large-scale distributed data processing workloads.
- Build native Databricks solutions using Spark, Delta Lake, Unity Catalog, Workflows, SQL Warehouses, and Delta Live Tables.
- Optimize cluster performance and workload efficiency.
- Implement automated deployment pipelines and CI/CD practices.
- Develop scalable Lakehouse solutions.
- Design dimensional models for business consumption.
- Build Data Vault 2.0 models for enterprise integration.
- Develop semantic models and curated data products.
- Support Master Data Management initiatives.
- Implement enterprise data quality validations.
- Develop metadata-driven engineering solutions.
- Enable lineage, governance, and traceability.
- Ensure production-ready engineering standards.
- Partner with Architects, Product Owners, Business Analysts, and Data Scientists.
- Participate in architecture reviews and code reviews.
- Mentor junior engineers.
- Drive engineering best practices across the organization.
Required Qualifications
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
- 7+ years of Data Engineering experience.
- 3+ years of hands-on Databricks experience.
- Strong expertise in Apache Spark (PySpark and SQL).
- Deep knowledge of Delta Lake, Unity Catalog, Workflows, and Lakehouse architecture.
- Advanced SQL development skills.
- Experience building enterprise-scale ETL/ELT pipelines.
- Experience with Azure cloud services.
- Strong Git, CI/CD, and Dev Ops practices.
- Experience with performance tuning and optimization.
Preferred Qualifications
- Insurance or Financial Services experience.
- Data Vault 2.0 certification or implementation experience.
- Experience with dbt, Terraform, and Azure Dev Ops.
- Experience building metadata-driven frameworks.
- Experience with Master Data Management (MDM).
- Experience developing enterprise semantic models.
- Familiarity with data quality frameworks and data governance.
- Experience enabling AI and analytics through trusted enterprise data products.
- Salary Range: $142,500 to $160,000
- This role may be eligible for a discretionary annual bonus.
- Salary offers will vary commensurate with experience, education, skills, and training
A comprehensive benefits package that includes PTO, medical, dental, vision, retirement savings, disability insurance, and life insurance.
Equal Employment Opportunity Statement
We are an Equal Opportunity Employer and value diversity at all levels of the organization. All employment decisions are made without regard to race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), sexual orientation, gender identity or expression, age, national origin, ancestry, disability, genetic information, marital status, veteran or military status, or any other protected characteristic under applicable federal, state, or local law.
We are committed to providing an inclusive, equitable, and respectful workplace where all employees can thrive.
Americans With Disabilities Act (ADA) Statement
We are committed to full compliance with the Americans with Disabilities Act (ADA) and all applicable state and local disability laws.…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).