Senior Data Engineer - Big Data Solutions
South Africa
Listed on 2026-11-01
-
IT/Tech
Data Engineering, Data Warehousing
Our client, a leader in data analytics and insights, is looking for a highly motivated and experienced Senior Data Engineer to join their fully remote team. This role is crucial for designing, building, and maintaining scalable data pipelines and infrastructure that enable advanced analytics and machine learning initiatives. You will work with large, complex datasets, transforming raw data into actionable insights that drive business decisions.
The ideal candidate possesses a strong background in big data technologies, cloud platforms, and ETL/ELT processes. This is a fully remote position, offering the flexibility to work from anywhere while collaborating with a talented, distributed team of data professionals. You will play a key role in shaping our client's data strategy and infrastructure, ensuring data quality, accessibility, and reliability.
- Design, build, and maintain robust and scalable data pipelines using tools like Apache Spark, Flink, or Kafka.
- Develop and optimize ETL/ELT processes for data ingestion, transformation, and loading into data warehouses or data lakes.
- Implement and manage data warehousing solutions (e.g., Snowflake, Redshift, Big Query) and data lake architectures.
- Work with cloud platforms (AWS, Azure, GCP) and their associated data services.
- Ensure data quality, integrity, and reliability across all data systems.
- Collaborate with data scientists and analysts to understand their data needs and provide data solutions.
- Develop and maintain data models and schemas.
- Automate data processes and monitor pipeline performance.
- Stay current with emerging technologies and best practices in data engineering.
- Contribute to the continuous improvement of data infrastructure and processes.
- Bachelor's degree in Computer Science, Engineering, Mathematics, or a related quantitative field.
- 5+ years of experience in data engineering or a related role.
- Proven experience with big data technologies such as Apache Spark, Hadoop ecosystem (HDFS, Map Reduce), or similar.
- Strong proficiency in at least one programming language like Python, Scala, or Java.
- Experience with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., S3, Blob Storage, GCS, EMR, Databricks, Data Factory).
- Solid understanding of SQL and database design principles.
- Experience with data warehousing concepts and tools.
- Familiarity with streaming data technologies (e.g., Kafka, Kinesis).
- Excellent problem-solving, analytical, and communication skills.
- Ability to work independently and collaborate effectively in a remote team environment.
- Experience with data governance and security best practices is a plus.
Our client offers a competitive salary, performance bonuses, and a comprehensive benefits package including health, dental, and vision insurance. This is a fully remote position, providing exceptional flexibility and work-life balance. We offer opportunities for professional development, including training, certifications, and conference attendance. Employees have access to leading-edge data technologies and tools. Our client fosters a collaborative and innovative remote work culture.
Enjoy generous paid time off and retirement savings plans. Join a team dedicated to harnessing the power of data to drive innovation.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).