Python Developer Data Engineering

Position: Python Developer for Data Engineering
This job is with MSCI, an inclusive employer and a member of my Gwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly.

Your Team Responsibilities:_*]:min-w-0" The Data Engineering group within MSCI is responsible for delivering data products to MSCI's product lines globally. We're building a next-generation metadata-driven data platform that uses AI to automate and scale data onboarding. As part of a talented software development team in Mumbai, you'll have the opportunity to design and build state-of-the-art automation solutions that transform how MSCI ingests, governs, and delivers data to the investment community.

This is a greenfield opportunity to architect systems that will reduce manual effort by 40-60% and accelerate vendor onboarding by 50-70%.
_*]:min-w-0"Your

Key Responsibilities:

Design and develop AI-powered automation capabilities for data onboarding, including vendor file classification, metadata auto-suggestion, data profiling engines, and automated quality control frameworks
Build LLM-integrated code generation systems for ingestion pipelines, PySpark transformations, and Airflow DAG orchestration
Implement metadata management platforms that serve as the control plane for data lifecycle automation
Develop RESTful APIs and integration layers connecting AI services, data platforms (Snowflake, Databricks), and orchestration frameworks
Create human-in-the-loop workflows for validation, exception handling, and continuous model improvement
Collaborate with cross-functional teams across data engineering, governance, and product to deliver end-to-end automation solutions
Build scalable, fault-tolerant systems designed for metadata processing at scale
Your skills and experience that will help you excel:

Required:

5-8 years of software development experience with strong Python programming expertise
Knowledge of data manipulation libraries (Pandas, Polars) and analysis workflows
Proficiency in SQL and data querying across modern data platforms
Understanding of columnar storage formats and time-series analytics (Click House, Parquet, Iceberg)

Experience with AI-assisted development tools (Git Hub Copilot, Cursor, or similar)
Strong understanding of RESTful API design and implementation

Experience with Git version control and collaborative development workflows
Demonstrated ability to take ownership of complex technical solutions end-to-end
Strong analytical and problem-solving skills with attention to data quality and reliability
Preferred:
Hands-on experience with LLMs (OpenAI, Anthropic, or open-source models) and prompt engineering
Familiarity with Agentic AI frameworks and orchestration patterns

Experience with cloud platforms (Azure or GCP) and modern data infrastructure
Exposure to financial concepts, reference data, or market data processing
Experience building metadata-driven or self-service data platforms
About MSCI:  What we offer you
Transparent compensation schemes and comprehensive employee benefits, tailored to your location, ensuring your financial security, health, and overall wellbeing.
Flexible working arrangements, advanced technology, and collaborative work spaces.
A culture of high performance and innovation where we experiment with new ideas and take responsibility for achieving results.
A global network of talented colleagues, who inspire, support, and share their expertise to innovate and deliver for our clients.
Global Orientation program to kickstart your journey, followed by access to our Learning@MSCI platform, AI Learning Center , Linked In Learning Pro and tailored learning opportunities for ongoing skills development.
Multi-directional career paths that offer professional growth and development through new challenges, internal mobility and expanded roles.
We actively nurture an environment that builds a sense of inclusion belonging and connection, including eight Employee Resource Groups. All Abilities, Asian Support Network, Black Leadership Network, Climate Action Network, Hola! MSCI, Pride & Allies, Women in Tech, and Women's Leadership Forum.
At MSCI we are passionate about what we do, and we are inspired by our vision - to…