Lead Cloud Data and AI​/ML Engineer, AVP

Education and experience Qualification

• Bachelor's degree in computer science, Information Systems, or equivalent education or work experience.
• Around 5+ years of experience as a Data Engineer with cloud technologies.
• Any AWS and/or Databricks certification will be a plus.

• Lead work streams end to end and deliver business outcomes.
• Researching, learning, and applying new tools and techniques rapidly and suggesting new concepts to improve performance.
• Explore various AWS services and perform proof of concepts to determine the usage within the applications.
• Document the best practices and strategies associated with application deployment and infrastructure support.
• Produce reusable, efficient, and scalable programs, and cost-effective migration strategies.
• Develop Data Engineering and Machine Learning pipelines in Databricks and use different AWS services, including S3, EC2, API, RDS, Kinesis/Kafka, Open Search and Lambda.
• Work jointly with the IT team and other departments to migrate data engineering and Machine Learning applications to Databricks/AWS and support model life cycle management.
• Design and develop GenAI and Agentic AI based applications.
• Evaluate and onboard new AI tools, frameworks, and cloud services to enhance platform capabilities.
• Performing data and system analysis.
• Comfortable working on tight timelines, when required.
• Learn and work on vendor products.
• Effectively communicate technical concepts and project updates to stakeholders, ensuring alignment between business goals and technical solutions.
• Supporting implementation of the Software Development Life Cycle, in agile and/or Kanban approaches.

• Strong work ethics and collaborative attitude.
• Self-driven, critical thinking, problem solving, and decision-making skills.
• Solid understanding of Databricks fundamentals/architecture and have hands on experience in Databricks modules (Data Engineering, Machine Learning and SQL warehouse).
• Solid Knowledge of medallion architecture, DLT and unity catalog within Databricks.
• Knowledge of Machine learning model development process.
• Understanding of core AWS services, uses, and AWS architecture best practices
• Hands-on experience in different domains, like database architecture, business intelligence, machine learning, advanced analytics, big data, etc.
• Knowledge of Agentic AI frameworks.
• Solid knowledge of Airflow.
• Solid knowledge of CI/CD pipelines in AWS technologies.
• Application migration of RDBMS, java/python applications, model code, elastic etc.
• Solid programming background on scala, python and/or Java.
• Experience with Docker and Kubernetes is a plus.
• Keen to learn new technology and enjoy hands‑on development.
• Effective communication skills to interact with various stakeholders and management.

$90,000 - $157,500 Annual

Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long‑term disability, and other optional additional coverages; paid‑time off including vacation, sick leave, short‑term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance‑based awards (excluding certain sales roles subject to sales incentive plans);

and, eligibility for certain tax‑advantaged savings plans.

For a full overview, visit

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you’ll benefit from inclusive development opportunities, flexible work‑life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.