Platform Engineer IV

Job Summary

Client's Infrastructure Intelligence and Analytics (IIA) team builds and operates the data platform and AI agent infrastructure that supports proactive network monitoring and autonomous investigation for network operations. The Platform Engineer IV designs, builds, and maintains AWS infrastructure supporting the IIA Data Lake, AI agent runtime environments, CI/CD pipelines, and graph database systems. The role also develops application code, automation, and internal tooling to ensure production environments remain stable, scalable, and secure while enabling data science and agentic AI workloads to operate reliably at scale.

• Design and manage AWS infrastructure for the IIA Data Lake, including S3 storage, Glue Data Catalog, Athena query engine, and EMR compute clusters.
• Manage cross-account connectivity, VPC networking, security groups, and IAM roles and policies to enable secure data flow between IIA, upstream data providers, and downstream consumers.
• Build and maintain infrastructure for AI agent runtime environments, including compute resources for Lang Graph agents deployed through Lang Smith Deployments.
• Design and implement event-driven infrastructure, including triggers, message queues, and pub/sub frameworks that orchestrate agent execution and data pipeline workflows.
• Support the deployment and operation of AWS Neptune for the network topology graph, including capacity planning, schema design support, and performance tuning.
• Implement and manage Infrastructure as Code using Terraform and Cloud Formation for repeatable and auditable environment provisioning.
• Manage IAM access key rotations, secrets management using AWS Secrets Manager and Delinea, and security compliance for on-premises and cloud integrations.
• Build and maintain CI/CD pipelines for AI agent deployments using Git Lab CI/CD, Docker, and Artifactory.
• Manage container life cycles for agents deployed through Lang Smith Deployments, including image builds, versioning, and rollback procedures.
• Automate deployment workflows to enable reliable promotion of agents from development through production.
• Coordinate with platform teams on AI Gateway integration, cross-account deployment, and connectivity requirements.
• Support and maintain existing ETL pipelines written in Scala and Spark, including troubleshooting, enhancements, and onboarding of new data sources.
• Develop and maintain scripts, CLIs, small services, and automation utilities primarily using Python to support data ingestion, deployment, environment provisioning, and operational workflows.
• Develop integration code and services connecting IIA systems with upstream data providers, downstream consumers, and external platforms.
• Ensure production environment stability through monitoring, alerting, and incident response while maintaining SLAs for data pipeline availability and agent uptime.
• Implement production monitoring and alerting for deployed agents, including health checks, error rates, latency, and resource utilization.
• Coordinate with data, platform, cloud, and security teams on connectivity, firewall requests, and integration requirements.
• Support infrastructure needs for onboarding new data sources, including storage provisioning, access controls, pipeline compute, and scheduler maintenance.
• Support workflow orchestration using Airflow and event-driven triggers.
• Perform other duties as required.

• Strong communication skills with the ability to explain infrastructure decisions to non-infrastructure stakeholders.
• Expert-level experience with AWS services including EC2, S3, IAM, VPC, Glue, Athena, EMR, Secrets Manager, and Cloud Watch.
• Strong experience with Infrastructure as Code, with Terraform preferred and Cloud Formation acceptable.
• Experience managing cross-account AWS architectures, VPC peering, Private Link, and Transit Gateway configurations.
• Experience with IAM policy design, least-privilege access patterns, and service account management.
• Experience with Docker and container orchestration.
• Experience with CI/CD pipelines, preferably Git Lab CI.
• Experience with event-driven architectures and messaging systems such as Kafka, SNS/SQS, and Event Bridge.
• Proficiency with Linux-based operating systems and shell scripting.
• Experience with monitoring and alerting tools such as Cloud Watch, Prometheus, Grafana, or similar platforms.
• Understanding of networking fundamentals including DNS, CIDR, NAT, VPC endpoints, firewalls, and security groups.
• Demonstrated ability to…