Data Engineer | Kafka & Databricks | Big Data Technologies

Data Engineer

Bristol | Hybrid (3 Days Onsite)

Salary Benefits – £60,000 to £71,000 10% bonus, 33 days holiday, pension, health

Pyspark | ML | AI | Databricks | Kafka | AWS

Are you a Data Engineer with strong Python, SQL and PySpark skills who is looking for the opportunity to step up and accelerate your career?

We're partnering with a market-leading technology business that is investing heavily in its data platform and is at the forefront of innovation within the smart housing sector. Processing billions of sensor readings every month, they're looking for a talented Data Engineer to join their growing team and help build the next generation of scalable data solutions.

This opportunity is ideally suited to a mid-level Data Engineer who is ready to take on more responsibility, work on complex technical challenges, and gain exposure to cutting-edge technologies including Databricks, Kafka, Streaming, AI and Machine Learning.

You’ll be joining a collaborative team of engineers and data specialists working on large-scale, real-time data platforms. This is a business that embraces new technologies and encourages engineers to learn, innovate and have a genuine impact on technical direction.

• Build and optimise large-scale data pipelines
• Work with billions of data points generated from IoT devices
• Develop solutions using Python, SQL and Py Spark
• Gain exposure to Databricks, Kafka and streaming technologies
• Contribute to Machine Learning and AI initiatives
• Work alongside Data Scientists and Software Engineers
• Influence architecture and engineering best practices
• Play a key role in exciting greenfield projects

• Strong commercial experience as a Data Engineer
• Advanced Python and SQL skills
• Strong PySpark experience
• Experience building and maintaining scalable data pipelines
• Understanding of data modelling and database design principles
• Strong analytical and problem-solving capabilities
• Excellent communication and stakeholder engagement skills
• Degree in Computer Science, Mathematics, Statistics or a related discipline would be advantageous

Experience with any of the following would be beneficial but not essential:

• Databricks
• Apache Kafka
• Real-time streaming technologies
• AWS services
• Click House
• Infrastructure as Code
• CI/CD practices

This is more than just another Data Engineer role.

It's an opportunity to join a business that genuinely invests in technology, learning and innovation. If you're looking for a company where you can progress into a senior position, develop expertise in modern big data technologies, and work on exciting AI and Machine Learning projects, this could be the perfect next step.

If you're an ambitious Data Engineer with strong Python, SQL and PySpark skills and you're ready to take your career to the next level, we'd love to hear from you.