AWS Data Tech Lead. San Mateo LilyLifestyle
Listed on 2026-05-30
-
IT/Tech
Data Engineering, Cloud Computing: Infrastructure & Operations
AWS Data Tech Lead
Experience in building data solutions with AWS technologies: storage, pipelines, ingestion, job scheduling, notifications/alerts, logging
Experience in data processing: full/incremental, batch/real-time/near-real-time, event driven
Experience building data solutions using AWS services such as Redshift, RDS, MWAA, Glue, S3, SQS, SNS
Proficiency in Python 3.6+, PySpark, SQL
Proficiency in Databricks and Medallion architecture on AWS platform
Implementing jobs monitoring with Amazon Cloud Watch
Experience deploying applications using Terraform or a similar IaC tool
Experience building CI/CD pipelines using Git Hub Actions or a similar tool
Proficiency in managing code as part of a team using Git Hub
Familiarity with agile development methodologies
Experience building data-driven unit test suites for data platforms
Experience with Domain Driven Design for data modelling
Experience in the biotechnology/biopharmaceutical industry
Knowledge of SRE/Observability practices
Architecting high performant and scalable data engineering solution with Databricks on AWS data platform
Architecting data solutions in Medallion data architecture definition and process for a Data Lake, Lakehouse, DW, analytical marts
Proficiency in data mesh architecture; data domain driven distributed/decentralized data solution, governance for data federation
Architect and design data pipeline patterns with aspects of process audit, data quality, cost optimized design
Perform data analysis and define data models
Setup connections and structure for the development components
Knowledge of data governance and security solutions with regulatory compliance requirements
Primary (Must have skills)- AWS, S3, Red Shift, Glue, PySpark, SQL
- Remaining
Soft skills/other skills (If any):
Should have strong technical experience to architect/design AND good communication and collaborative skills to work with the clients effectively
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).