Senior Data Engineer: AI​/ML-Driven Data Pipelines

Job Overview:
We are seeking a skilled professional with strong expertise in SQL, Python, Spark, and leading AI/ML frameworks to design and build scalable, intelligent data solutions. The ideal candidate will have hands-on experience with big data platforms and distributed data processing.

Key Responsibilities:

• Extensive experience in SQL and databases

• Develop and optimize scalable data pipelines using Apache Spark

• Build and deploy AI/ML models leveraging modern frameworks

• Work with large datasets using platforms like Delta Lake and other big data technologies

• Manage and integrate multiple databases for efficient data processing

• Collaborate with cross-functional teams to deliver data-driven solutions

Required Skills:

• Strong proficiency in SQL and Spark

• Experience with AI/ML frameworks (e.g., Tensor Flow, PyTorch, or similar)

• Hands-on experience with big data platforms such as Delta Lake

• Solid understanding of distributed data processing and database management