Lead Software Engineer - Data Platform

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Designs, builds, and maintains scalable data pipelines and ETL/ELT workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink
• Develops data platform components including data cataloging, data quality frameworks, and semantic/metrics layers with embedded governance, lineage, and compliance standards
• Implements data modeling strategies (fact and dimensional, wide tables) to support analytics, reporting, and downstream consumption
• Partners with analytics teams, product managers, and business stakeholders to translate data requirements into production‑grade solutions
• Develops secure high‑quality production code, and reviews and debugs code written by others
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
• Leads evaluation sessions with external vendors, startups, and internal teams to drive outcomes‑oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture
• Leads communities of practice across Software Engineering to drive awareness and use of new and leading‑edge technologies
• Adds to team culture of diversity, opportunity, inclusion, and respect

• Formal training or certification on software engineering concepts and 5+ years of applied experience
• Hands‑on practical experience delivering system design, application development, testing, and operational stability
• Demonstrated professional experience focused on software engineering or data platform development
• Advanced in one or more programming languages (Python, Java and SQL)
• Hands‑on experience with distributed data processing frameworks such as Apache Spark and Flink
• Solid understanding of data modeling techniques (star schema, snowflake) and query optimization
• Experience designing and operating data pipelines on Databricks using orchestration tools such as Apache Airflow
• Proficiency with cloud data services (AWS S3, Glue, Redshift, Athena, EMR, Lake Formation, or equivalent)
• Experience engineering production‑grade data platforms on Kubernetes with open catalog integration (e.g., Apache Iceberg, Unity Catalog, Open Metadata) for scalable data discovery, lineage, and governance
• Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
• Demonstrated proficiency in software applications and technical processes within a technical discipline (e.g., cloud, artificial intelligence, machine learning, mobile, etc.)

• Experience with Agentic AI, LLMs, RAG architectures, vector databases, and embedding‑based retrieval systems
• Hands‑on familiarity with Internal Developer Portals such as Backstage – including service catalog management, software templating, and plugin development
• Experience with data mesh or data product architectures
• Proficiency with Infrastructure as Code (Terraform) and containerized deployments (Docker, Kubernetes)
• Experience with data observability, quality, and metadata management tools
• Experience with semantic layers, metrics stores, or BI platforms (Tableau, dbt Metrics)

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission‑based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility.

These benefits include comprehensive health care coverage, on‑site health and wellness centers, a retirement savings plan, backup childcare, tuition…