More jobs:
Senior Data Engineer – Databricks | Spark; Entertainment
Job in
Glendale, Los Angeles County, California, 91222, USA
Listed on 2026-10-15
Listing for:
TechLink Resources, Inc
Full Time
position Listed on 2026-10-15
Job specializations:
-
Software Development
Data Engineering
Job Description & How to Apply Below
We are seeking an experienced Senior Data Engineer with deep expertise in Databricks, Apache Spark, Python, SQL, and Apache Airflow to design, develop, and maintain scalable data platforms and pipelines.
In this role, you will play a key part in building and optimizing enterprise data solutions, supporting both batch and streaming pipelines, and managing Databricks platform operations within an AWS cloud environment.
Key Responsibilities- Design, develop, and optimize scalable data pipelines using PySpark, Scala, Python, and SQL.
- Build and maintain batch and streaming pipelines using Databricks and Apache Spark.
- Manage Databricks platform administration, governance, access controls, and Unity Catalog.
- Develop and maintain workflow orchestration using Apache Airflow (MWAA).
- Optimize Spark performance, troubleshoot pipeline failures, and improve platform reliability.
- Design and support cloud-based data architectures across AWS, Kubernetes, and Databricks.
- Implement automation, CI/CD processes, monitoring, and data quality solutions.
- Collaborate with engineering teams and stakeholders to translate business requirements into scalable technical solutions.
- 5+ years of professional data engineering experience.
- Strong hands-on experience with Databricks (primary requirement).
- Advanced knowledge of Apache Spark / PySpark and Spark architecture.
- Strong programming experience with Python and Scala.
- Advanced SQL skills, including query optimization and performance tuning.
- Production experience with Apache Airflow for workflow orchestration.
- Experience designing, developing, and maintaining ETL/ELT pipelines.
- Experience with AWS cloud services and data infrastructure.
- Familiarity with Docker, Kubernetes, and cloud-based data architectures.
- Experience with Databricks governance, Unity Catalog, and access management.
- Experience with Snowflake or similar cloud data platforms.
- Familiarity with Databricks APIs, SDKs, and CLI tools.
- Experience with CI/CD, Dev Ops, and Git-based workflows.
- Knowledge of data governance, lineage, monitoring, and platform security.
If you have strong hands-on Databricks experience and enjoy building scalable, high-performance data solutions, this job is for you!
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×