Skip to content
×

Data Engineer

Job in Johannesburg, 2000, South Africa
Listing for: PBT Group
Full Time position Listed on 2026-10-30
Job specializations:

Job Description & How to Apply Below

Data Engineer position available in Johannesburg.

PBT Group is seeking an experienced Data Engineer to join a project focused on implementing a modern Lakehouse architecture using the Medallion framework.

The successful candidate will be responsible for developing and maintaining data ingestion pipelines, landing data in the Bronze layer, and supporting data transformation and semantic modelling through the Silver and Gold layers.

The objective is to deliver governed, reusable, production-ready and AI-ready data products that support advanced analytics, Power BI reporting and data science use cases.

Working closely with an in-house Data Scientist and other technical stakeholders, the Data Engineer will contribute to the development of reliable data products and business views, with a strong emphasis on production deployment, data governance, performance optimisation and operational excellence.

Key Responsibilities:

  • Data Engineering and Lakehouse Architecture
    • Design, develop and maintain scalable data pipelines using Azure Databricks and Azure Data Factory (ADF).
    • Implement and support Medallion architecture, including Bronze, Silver and Gold data layers.
    • Ingest data from multiple sources and ensure reliable landing, transformation and processing.
    • Develop and maintain data integration and ingestion patterns that support batch and real-time data processing.
    • Contribute to the design and implementation of robust, scalable and maintainable Lakehouse solutions.
  • Data Transformation and Modelling
    • Develop data pipelines and transformation logic using Python, PySpark and SQL.
    • Support semantic data modelling across Silver and Gold layers to deliver high-quality, reusable and governed data products.
    • Develop data models and business views that support Power BI reporting, analytics and data science requirements.
    • Ensure datasets are accurate, consistent, documented and suitable for downstream analytical and AI use cases.
    • Apply data warehousing principles and appropriate modelling techniques to support business requirements.
  • Azure Data Services and Integration
    • Work with Azure data services and technologies to develop, integrate and maintain data solutions.
    • Implement data ingestion and integration pipelines using Azure Data Factory, Azure Databricks and other relevant Azure services.
    • Apply API integration and data ingestion patterns to connect systems and source platforms.
    • Where required by the solution, work with Azure Functions, Apache Kafka and Apache Spark to support integration, processing and streaming requirements.
  • Data Governance and Quality
    • Apply data governance, access control and catalogue management practices using Databricks Unity Catalog and relevant gateway capabilities.
    • Ensure that data products comply with established governance, security, quality and access requirements.
    • Support data lineage, documentation, discoverability and reusability across the data environment.
    • Ensure that data products are well governed and structured to support analytics and AI-driven use cases.
  • Production Deployment and Dev Ops
    • Develop, deploy and maintain production-ready data pipelines and data products.
    • Apply Git version control, release management and established Dev Ops practices.
    • Contribute to CI/CD pipeline development, automation and controlled deployment processes.
    • Monitor and troubleshoot pipeline performance, data quality issues and production incidents.
    • Perform performance tuning and optimisation to improve pipeline efficiency, reliability and scalability.
    • Maintain clear technical documentation covering architecture, design decisions, pipelines, transformations and data models.
  • Collaboration and Continuous Improvement
    • Collaborate with Data Scientists and other stakeholders to translate analytical and business requirements into production-ready data products.
    • Develop datasets and business views that support Power BI reporting and AI use cases.
    • Work within an Agile delivery framework and contribute to planning, reviews and continuous improvement.
    • Support the use of Databricks Genie where relevant to the solution.
    • Promote engineering best practices, reusable components and operational excellence throughout the data delivery lifecycle.

Minimum Requirements:

Candidates should demonstrate hands-on experience in the following areas:

  • Lakehouse and Data Engineering
    • Advanced experience with Azure Databricks.
    • Practical experience implementing Medallion or Lakehouse architecture, including Bronze, Silver and Gold layers.
    • Strong proficiency in Python, PySpark and SQL for data…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary