Data Engineer

We are seeking a versatile and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and machine learning, with the ability to design, build, and maintain data pipelines, as well as develop and deploy machine learning models. This role requires a deep understanding of data lake houses, such as Databricks and Azure Fabric, and the ability to work collaboratively with cross-functional teams to deliver data-driven solutions.

• Design, build, and maintain scalable data pipelines and ETL processes.
• Work with large datasets and data lake houses, including Databricks and Azure Fabric.
• Ensure data quality, integrity, and security across all data pipelines.
• Optimize data storage and retrieval processes for performance and efficiency.

• Develop, implement, and optimize machine learning models and algorithms.
• Perform data analysis and model tuning to improve accuracy and performance.
• Deploy machine learning models into production environments.
• Monitor and maintain the performance of deployed models.

• Collaborate with cross-functional teams to understand business requirements and deliver data-driven solutions.
• Work closely with data scientists, analysts, and other stakeholders to ensure seamless integration of data and models.

• Stay up-to-date with the latest advancements in data engineering and machine learning.
• Participate in training and development opportunities to enhance skills and knowledge.

• Bachelor's or Master's degree in Data Science, Computer Science, Engineering, or a related field.

• 5-10 years of experience in data engineering and machine learning.
• Proficiency in programming languages such as Python, R, or SQL.
• Experience with data lake houses, particularly Databricks and Azure Fabric.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.
• Ability to work independently and manage multiple projects simultaneously.