Data Engineer
Listed on 2026-08-15
-
Software Development
Python, Data Engineering, SQL Developer, AWS
We are seeking a Python Software Engineer with Data Engineering experience to join a global team building a large‑scale Metering Data Platform. This role focuses on building scalable, production-grade applications rather than traditional Databricks notebook‑centric ETL development. The ideal candidate has a strong software engineering foundation and enjoys creating robust, scalable solutions.
Key Responsibilities:Build and maintain Python‑based applications, APIs, and data services.
Develop scalable data ingestion and processing solutions using PySpark and Databricks.
Create reusable frameworks, CI/CD processes, monitoring, and testing capabilities.
Collaborate with global teams to build a shared platform that aggregates customer usage data into a centralized data lake.
Contribute to architecture decisions, engineering standards, and platform growth.
Strong Python software engineering background;
Python developer first, data engineer second.Proficient in Python, Django and/or Flask, PySpark, Databricks, REST APIs, object‑oriented design, and Git.
Experienced in building data pipelines and data lakes.
Skilled at Spark optimization and performance tuning.
Knowledgeable in data modeling and distributed systems.
Skills:
AWS (S3, Glue, Lambda)
CI/CD and Dev Ops practices
Strong Python developer with production‑grade application experience. Proficient in PySpark, Databricks, and scalable data pipelines. Experience building REST APIs, CI/CD, and cloud services
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).