×
Register Here to Apply for Jobs or Post Jobs. X

ETL Data Senior Developer

Job in Cape Town, 7100, South Africa
Listing for: Circana
Full Time position
Listed on 2025-12-05
Job specializations:
  • IT/Tech
    Data Engineer, Cloud Computing, Big Data
Job Description & How to Apply Below


At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives.

We’re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. With us, you can always bring your full self to work.
Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified
by Great Place To Work. This prestigious award is based entirely on what current employees say about their experience working at Circana.
Learn more at

Job Summary:

What is the role & team:

Join our Global Professional Services team as a Data Engineer, where you will be instrumental in bridging the gap between client needs, business objectives, and cutting-edge technology solutions, particularly supporting our new Private Cloud clients.

This role is for more than just a service provider; we are seeking a consultant-minded go-getter who is client-obsessed
, a liquid thinker who thrives at pace, and is bold and brave in challenging the status quo. We are a team that values being part of a successful business and building partnerships based on trust, deep knowledge, respect, and unwavering support
.

We are passionate about technology, data and AI and how it can be leveraged to solve our clients' most pressing business challenges. You will be a key player in understanding our clients' world, becoming their trusted partner, and proactively identifying opportunities for innovation and efficiency.
Curiosity, accountability, and a positive, questioning mindset are at the core of our team's DNA – we don't just aim to meet expectations, we strive to exceed them.

You will work collaboratively with global Circana teams, acting as the vital link to ensure seamless, unified support and strategic technological partnership for our clients.

In this role we are seeking a skilled and motivated Data Engineer to join a growing Global Team based in the UK. You will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the Azure cloud platform. You will leverage your expertise in PySpark, Apache Spark, and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability.

If you have a passion for Data Engineering and a desire to make a significant impact, we encourage you to apply!

Key Responsibilities:

  • ETL/ELT Pipeline Development:
  • Design, develop, and optimize efficient and scalable ETL/ELT pipelines using Python, PySpark, and Apache Airflow.
  • Implement batch and real-time data processing solutions using Apache Spark.
  • Ensure data quality, governance, and security throughout the data lifecycle.
  • Cloud Data Engineering:
  • Manage and optimize cloud infrastructure (Azure) for data processing workloads, with a focus on cost-effectiveness.
  • Implement and maintain CI/CD pipelines for data workflows to ensure smooth and reliable deployments.
  • Big Data & Analytics:
  • Develop and optimize large-scale data processing pipelines using Apache Spark and PySpark.
  • Implement data partitioning, caching, and performance tuning techniques to enhance Spark-based workloads.
  • Work with diverse data formats (structured and unstructured) to support advanced analytics and machine learning initiatives.
  • Workflow Orchestration (Airflow):
  • Design and maintain DAGs (Directed Acyclic Graphs) in Apache Airflow to automate complex data workflows.
  • Monitor, troubleshoot, and optimize job execution and dependencies within Airflow.
  • Team Leadership &

    Collaboration:

  • Provide technical guidance and mentorship to a team of data engineers in India.
  • Foster a collaborative environment and promote best practices for coding standards, version control, and documentation.
  • Required

    Skills & Experience:

  • 5+ years of proven experience in data…
  • Position Requirements
    10+ Years work experience
    Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
    To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
     
     
     
    Search for further Jobs Here:
    (Try combinations for better Results! Or enter less keywords for broader Results)
    Location
    Increase/decrease your Search Radius (miles)

    Job Posting Language
    Employment Category
    Education (minimum level)
    Filters
    Education Level
    Experience Level (years)
    Posted in last:
    Salary