Sr. Data Engineer; Python, Spark​/Scala, PySpark

Overview

6-12 years of total experience. At least three years of experience designing and delivering data engineering solutions (data pipeline development, data process orchestration, etc.). Highly proficient at SQL development, Python development, and Spark/Scala, PySpark. In-depth knowledge of Cloud services. Experience handling large and complex data from various sources and databases. Solid grasp of database engineering and design principles. Familiarity with CI/CD methods.

Past or current experience with ETL tools such as Informatica, Talend, or Matillion (desirable).

Candidates should be flexible and willing to work across the delivery landscape, which includes but is not limited to Agile Applications Development, Support and Deployment.

• Programming and software development using various programming languages and related tools and frameworks; review code written by other programmers; requirement gathering; bug fixing; testing; documenting and implementing software systems.
• Interpreting architecture and design, conducting code reviews, mentoring, guiding and monitoring programmers; ensuring adherence to programming and documentation policies; software development, testing and release.
• Assigning, coordinating, and reviewing the work of programming personnel; collaborating with business stakeholders to develop methods; supervising and mentoring junior programmers; representing the team in project meetings.
• Working with business and functional analysts, and software/solution architects to ensure that programs and systems function as intended; supervising, mentoring and managing large teams of programmers on one or more projects.

• 6-8 years of experience (2 years minimum relevant experience in the role);
  Bachelor’s Degree.
• Must have experience in Software Engineering Techniques, Software Engineering Architecture, Software Engineering Lifecycle and Data Management.
• Should be proficient in Business Analysis, Business Knowledge, Software Engineering Leadership, Architecture Knowledge and Technical Solution Design.

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Capgemini will consider reasonable accommodations to provide equal employment opportunity where needed, provided no undue hardship.

Capgemini is a global leader in consulting, digital transformation, technology and engineering services. The Group enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is a multicultural company with a large global workforce.