Software Engineer, IDSM

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Staff Software Engineer, IDSM based in United States .We are looking for an experienced Staff Software Engineer to help advance an enterprise platform for developing, deploying, and managing machine learning and AI solutions  this senior individual contributor role, you will design scalable backend systems and build capabilities that simplify the machine learning lifecycle, from model development and registration to deployment and monitoring.

You will work closely with customers and cross-functional engineering teams to deliver reliable integrations with cloud-based machine learning platforms. Your work will also support improved resource discovery, model observability, and large language model (LLM) hosting. This opportunity is ideal for a technically strong engineer who enjoys solving complex distributed systems challenges and shaping architecture in a collaborative, innovation-driven environment. You will have meaningful ownership over platform capabilities that help organizations operationalize AI securely, efficiently, and reliably.

• Design, develop, and maintain high-performance backend services that support enterprise-scale data science and machine learning workflows.
• Collaborate with customers and internal teams to design and implement model deployment solutions integrating with platforms such as AWS Sage Maker and Azure Machine Learning.
• Enhance capabilities across model development, training, registration, deployment, and ongoing management to improve reliability and efficiency.
• Help design and launch a centralized data science catalog that enables users to discover, explore, and summarize resources across the platform.
• Integrate monitoring capabilities that provide a comprehensive view of deployed model health, performance, and operational status.
• Expand tagging and metadata functionality across platform entities to improve organization, tracking, reuse, and resource discovery.
• Extend large language model hosting capabilities to meet customer requirements for scalability, performance, and operational logging.
• Build secure, reliable, and scalable APIs, including RESTful APIs and gRPC services, and integrate backend systems with frontend interfaces and third-party services.
• Profile, troubleshoot, and optimize backend applications and distributed workloads across cloud environments and containerized infrastructure.
• Implement comprehensive unit, integration, and end-to-end testing practices, and contribute to robust continuous integration and continuous delivery (CI/CD) pipelines.
• Partner with engineering, product, and customer-facing teams to translate technical and business requirements into practical, maintainable solutions.
• Contribute to architectural decisions, share engineering best practices, support team learning, and continuously improve platform quality and performance.

• At least 8 years of experience in software engineering, primarily in an individual contributor capacity.
• Strong knowledge of artificial intelligence and machine learning systems, including model development, training, optimization, deployment, and lifecycle management.
• Demonstrated experience designing, building, and maintaining scalable backend systems in distributed computing environments.
• Proficiency in designing and implementing secure, high-performance APIs, including RESTful APIs and/or gRPC.
• Experience with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform.
• Strong understanding of backend performance profiling, troubleshooting, and optimization in cloud-based or distributed environments.
• Familiarity with containerization and orchestration technologies such as Docker and Kubernetes.
• Experience implementing automated testing strategies, including unit, integration, and end-to-end tests, as well as maintaining CI/CD pipelines.
• Ability to collaborate effectively across engineering teams and integrate backend services with frontend applications and external systems.
• Strong analytical and problem-solving skills, with the ability to address complex technical challenges and deliver maintainable, reliable solutions.
• Excellent communication skills and the ability to work collaboratively with technical stakeholders and customers.
• A growth mindset, curiosity, and a willingness to learn, share knowledge, and continuously improve engineering practices.
• Experience with distributed…