Software Engineer, Platform & Infrastructure

What You ll DoPlatform Design & Development

• Collaborate with stakeholders to gather requirements and translate them into a comprehensive software system. This includes designing microservices, persistence layers, and implementing deployment workflows using tools like Terraform, Ansible, Puppet, or Salt.

• Design, develop, and implement highly available, scalable, and secure platform services for our data PaaS using programming languages (e.g., Python, Go, Java).

• Contribute to the architectural evolution of our data platform, ensuring it meets the growing demands of our users and adheres to best practices.

• Develop and maintain APIs, automation tools, and internal services to streamline platform operations and enhance developer experience.

• Implement and improve data pipelines, storage solutions, and processing frameworks within the PaaS.

• Manage and optimize cloud infrastructure in AWS and Azure cloud services to support our data platform, focusing on cost-efficiency, performance, and reliability.

• Implement Infrastructure as Code (IaC) principles using tools like Terraform for provisioning and managing resources.

• Develop and maintain CI/CD pipelines to automate deployments, testing, and release processes for platform services.

• Monitor platform health, performance, and security, and proactively identify and address potential issues.

• Work closely with data engineers and AI engineering to understand their needs and provide platform capabilities that facilitate efficient data ingestion, processing, storage, and analysis.

• Ensure the platform supports various data technologies and paradigms (e.g., streaming, batch processing, data warehousing, data lakes).

• Implement and manage data governance, security, and compliance features within the platform.

• Bachelor s degree in Computer Science, Software Engineering, or related field.
  OR demonstrable equivalent deep understanding, experience, and capability.

• Master or PhD degree in Computer Science (or related field) and 5+ years of experience in software engineering or 7+ years of experience in software engineering at a large scale. Experience in data system/platform development.

• Proven experience managing and optimizing cloud infrastructure (AWS, Azure).

• Demonstrable experience with Infrastructure as Code (IaC) tools (e.g., Terraform, Cloud Formation).

• Solid experience with containerization technologies (e.g., Docker, Kubernetes).

• Experience with CI/CD pipelines and Dev Ops best practices (Git Hub Actions preferred)

• Familiarity with data storage and processing technologies (e.g., Kafka, Spark, Flink, Hadoop, Snowflake, Mongo
  
  DB, S3/ADLS).

• Proficiency in one or more programming languages commonly used for platform development (e.g., Python, Go, Java).

• Strong understanding of networking, security, and performance principles in a cloud environment.

• Experience with monitoring and logging tools (e.g., Prometheus, Grafana, Datadog).

• Familiarity with database administration and optimization is a plus.

• Familiarity with application access control and automation

• Front-end engineering experience is advantageous.

Pay Range: $ - $. The base pay range represents the anticipated low and high end of the pay range for this position. Actual pay rates will vary and will be based on various factors, such as your qualifications, skills, competencies, and proficiency for the role. Base pay is one component of the total compensation package. Most sales positions are eligible for commission under the terms of an applicable plan.

Non-sales roles are typically eligible for a quarterly or annual bonus based on their role and applicable plan. Benefits include health, dental and vision insurances, retirement savings plan, paid time off, health savings account, flexible spending accounts, life insurance, disability insurance, tuition reimbursement, and more. For more information, check out the About Us section.