Software Developer, Backend Developer, DevOps

Job Description

We are seeking an experienced Technical Lead contractor to deliver hands‑on software development for our Infrastructure Telemetry and Capacity Planning platform. This engagement covers the collection, streaming, processing, and persistence of telemetry data from various sources that contains utilization of servers and GPUs across our fleet, enabling efficient querying and dashboarding for capacity planning. The ideal contractor hits the ground running, engages actively in architecture design discussions, and drives execution with minimal ramp time.

The contractor will serve as an active technical contributor and platform specialist working closely with cross functional teams, focused on the design, development, and delivery of an end‑to‑end telemetry pipeline that turns raw server and GPU metrics into a reliable, queryable capacity planning backbone.

Participate in end‑to‑end solution design for streaming telemetry ingestion from servers (utilization, memory, thermal, power, and workload metrics), contributing to data flow models, schema design, and error‑handling strategies. Recommend appropriate patterns (streaming vs. batch, event‑driven ingestion, EMR‑based processing) based on data volume, cardinality, and latency requirements for capacity planning use cases.

Develop production‑grade ingestion and processing pipelines following team coding standards, peer review practices, and CI/CD workflows. Build streaming collectors/agents for server telemetry, implement processing jobs on EMR (Spark), and persist processed data in No

SQL stores like Trino‑queryable lakehouse formats (e.g., Parquet). Write adequate test coverage and instrument pipelines with logging and monitoring for operational observability.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to  To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

• 10+ years of software development experience, with demonstrated technical execution on complex, large‑scale data or infrastructure platforms
• Strong proficiency in Java and/or Python; hands‑on experience with Spark and distributed data processing
• Deep, hands‑on experience with AWS EMR (or spark) for large‑scale data processing pipelines
• Experience with streaming data ingestion technologies (e.g., Kafka, Flink) for high‑volume telemetry data
• Solid experience with No
  
  SQL data stores (e.g., DynamoDB, MongoDB) or lakehouse/query engines such as Trino, including schema and partitioning strategies for efficient querying at scale
• Experience collecting and processing infrastructure telemetry using tools such as Prometheus, Grafana
• Proven expertise in cloud‑native architecture ‑ high availability, extensibility; AWS preferred
• Familiarity with containerized deployment environments (Kubernetes, Docker) and CI/CD pipelines
• Strong experience using AI‑assisted development tools (e.g., Cursor, Windsurf, or equivalent) to accelerate delivery and maintain code quality
• Strong analytical and problem‑solving skills with the ability to operate independently in an ambiguous environment

• Working knowledge of capacity planning concepts ‑ utilization forecasting, resource trending, and translating telemetry into actionable capacity signals
• Experience building dashboards and visualization layers for operational and reporting
• Experience with Agile development methodologies and Dev Ops practices