Platform Software Engineer, Kubernetes

Job Summary

As a Platform Engineer, you will be responsible for building, managing, and optimizing the underlying infrastructure and tools that enable efficient, scalable, and reliable execution of large‑scale data processing workloads. This role is a specialized subset of data platform engineering, ensuring the environment where data engineers and data scientists run their Spark jobs is robust and cost‑efficient.

This position is ineligible for visa sponsorship. To be considered for this role, you must be legally authorized to work in the United States and not require sponsorship for employment now or in the future.

• Architecting and managing the platforms where Spark runs, such as Kubernetes clusters, or cloud services like AWS (EKS).
• Packaging Spark workloads (often via Docker/Kubernetes) and integrating them with orchestration systems like Apache Flyte.
• Deploying infrastructure via Terraform/Ansible.
• Troubleshooting and resolving job failures, memory/resource issues, and execution anomalies. This includes optimizing Spark configurations to reduce cloud compute and storage costs.
• Building automation and tools in languages like Python, Java, or Scala, Linux scripting (Bash) to increase the productivity of development teams.
• Write medium to complex SQL queries as needed.
• Implementing and maintaining systems for monitoring, logging, and alerting (e.g., Prometheus, Grafana) to ensure platform stability and reliability.
• Working closely with data engineers, data scientists, and other engineering teams to define requirements, advise on best practices, and ensure successful delivery of data objectives.
• Engaging with open‑source communities (like Apache Spark, Delta Lake, or Apache Iceberg) to discuss technical challenges and contribute improvements.
• Create and maintain comprehensive documentation for Kubernetes infrastructure, processes, and procedures. Provide training and support to team members as needed.

• Bachelor's degree in computer science or a related field, or equivalent experience, typically 5 years in a Dev Ops or Systems Engineering role.
• Expertise in Apache Spark: deep understanding of Spark architecture, including RDDs, Data Frames, execution hierarchy, lazy evaluation, shuffling, and fault tolerance.
• Proficiency in languages used for Spark development and automation, such as Python, PySpark and Scala/Java.
• Proficient in Linux scripting (Bash).
• Proficient in writing SQL.
• Experience in CI/CD tools, Git Hub.
• Experience in setting up and using observability tools like Prometheus, Grafana, etc.
• Knowledge of networking concepts like TCP/IP, DNS, Load Balancer, etc.
• Automation via Terraform/Ansible.
• Hands‑on experience with on‑prem and major cloud providers (AWS, Azure, GCP) and container orchestration tools like Docker and Kubernetes.
• Hands‑on experience setting up IAM, VPC, EC2, etc.
• Familiarity with related technologies and formats like Delta Lake, Apache Iceberg, Apache Kafka, Hadoop, and various data storage systems (S3, HDFS, etc.).
• Nice to have experience with catalogs like Hive Metastore, Unity Catalog (Databricks and Open Source).
• Nice to have experience setting up, maintaining caching layers like Alluxio.
• Strong analytical skills for debugging complex distributed systems issues.
• Strong communication and collaboration abilities.

• This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.

Amazon Web Services (AWS); CI/CD;
Kubernetes;
Terraform;
Apache Spark;
Python software development;
Docker container.

Pay Range:
This job can be performed in Denver Campus with a Pay Range of $ - $. Comcast intends to offer the selected candidate base pay within this range, dependent on job‑related, non‑discriminatory factors such as experience. The application window is 30 days from the date job is posted, unless the number of applicants requires it to close sooner or later.

• Bachelor's Degree. While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.

5-7 years

Comcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.