Lead MLOps Engineer

Role Overview

NTT DATA Services currently seeks a professional to join our team in Jersey City, New Jersey. As a professional in this role, you will own the infrastructure and operationalization of machine learning and generative AI systems s includes building reliable pipelines for training, evaluation, deployment, and monitoring of models in production environments.

• ML/LLMOps Architecture:
  Design end-to-end pipelines for training and deploying models, including LLM fine‑tuning and RAG architectures.
• Deployment & Scaling:
  Build scalable services using Docker, Kubernetes, and cloud‑native tools (AWS/GCP/Azure).
• Pipeline Automation:
  Develop CI/CD pipelines for ML workflows (Git Hub Actions, Jenkins) including automated testing and validation of models.
• Monitoring & Observability:
  Implement monitoring for model performance, latency, drift, and cost (Prometheus, Grafana, custom metrics).
• Data & Feature Pipelines:
  Integrate with data platforms (Spark, Kafka, Airflow) and feature stores.
• Cost Optimization:
  Optimize GPU/compute usage for large‑scale model inference and training.

• 8 years in software/ML engineering with production systems.
• Strong Python skills and experience building scalable APIs/services.
• Experience with ML platforms (MLflow, Sage Maker, Vertex AI).
• Deep understanding of distributed systems and data pipelines.
• Hands‑on experience with LLMs, embeddings, and vector databases.

NTT DATA Services is an equal opportunity employer and considers all applicants without regard to race, color, religion, citizenship, national origin, ancestry, age, sex, sexual orientation, gender identity, genetic information, physical or mental disability, veteran or marital status, or any other characteristic protected by law. We are committed to creating a diverse and inclusive environment for all employees. If you need assistance or an accommodation due to a disability, please inform your recruiter so that we may connect you with the appropriate team.

This position is eligible for company benefits that will depend on the nature of the role offered. Company benefits may include medical, dental, and vision insurance, flexible spending or health savings account, life, and AD&D insurance, short-and long-term disability coverage, paid time off, employee assistance, participation in a 401k program with company match, and additional voluntary or legally required benefits.