Senior GenAI Data Engineer Scalable ML Pipelines

As a Senior GenAI Solutions Machine Learning Engineer, you will lead the development and implementation of advanced data engineering solutions to support the deployment and optimization of Generative AI models. Your role will involve leveraging your extensive experience to design robust, scalable, and innovative data architectures that align with the unique requirements of General Artificial Intelligence (GenAI) applications.

Key Responsibilities

• The Machine Learning Engineer will be responsible for architectural design and planning, advanced data pipelines, model integration and optimization, scalability, performance and research and innovation supporting production generative AI systems.
• Build and maintain data engineering solutions on cloud platforms using hyperscaler services.
• Design, develop, and maintain data pipelines to efficiently collect, process, and load data from various sources into data storage systems (e.g., data warehouses, data lakes).
• Understanding of indexing and vectorization to use with Generative AI prompt engineering.
• Strong understanding of fundamental data science concepts in NLP, including selection and understanding of embedding models.
• Use hyperscaler technologies to support data needs for expansion of Machine Learning/Data Science capabilities including generative AI.
• Design, develop, and implement scalable data pipelines and ETL/ELT processes using Python, PySpark and API integrations.

Required Skills

• Bachelor's degree in computer science, data engineering, or a related field with 5+ years experience (Master's preferred).
• Proven experience in data engineering, ETL, and database management, QL and data manipulation languages.
• Azure, Python, Java, or Scala.
• data warehousing platforms (e.g., Amazon Redshift, Snowflake) and big data technologies (e.g., Hadoop, Spark).
• highly scalable Data stores, Data Lake, Data Warehouse, Lakehouse, and unstructured datasets

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs.

It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.

Get The Future You Want |

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties,…