Principal Data Engineer
Listed on 2026-06-24
-
IT/Tech
Data Engineering -
Engineering
Data Engineering
About Bay Rock Labs At Bay Rock Labs, we pioneer innovative tech solutions that drive business transformation. As a leading product engineering firm based in Silicon Valley, we provide full-cycle product development, leveraging cutting-edge technologies in AI, ML, and data analytics. Our collaborative, inclusive culture fosters professional growth and work-life balance. Join us to work on ground-breaking projects and be part of a team that values excellence, integrity, and innovation.
Together, let's redefine what's possible in technology.
We are looking for a highly skilled Senior Data Engineer / Data Architect with deep hands-on expertise in Azure, Databricks, PySpark, Python, SQL, and modern data warehousing
. This role is ideal for someone who has built large-scale data platforms, designed enterprise-grade architectures, and delivered high-quality data products in cloud environments.
- Cloud-native architecture design, scalability, and cost optimization
- Security & governance: RBAC, Managed Identity, Private Endpoints
- Lakehouse architecture implementation
- Delta Live Tables (DLT), Unity Catalog
- CI/CD for Databricks workloads
- Apache Spark with advanced PySpark transformations
- Delta Lake architecture & optimization
- Python for automation, data engineering, and orchestration
- SQL for complex query optimization and analytics engineering
- Enterprise Data Warehouse (EDW) architecture
- Dimensional modeling (Star/Snowflake)
- Data Vault 2.0 modeling
- Change Data Capture (CDC) implementation
- Medallion architecture (Bronze/Silver/Gold)
- Master Data Management (MDM)
- Design and delivery of scalable data products
- KPI frameworks & enterprise reporting enablement
- Integration of ERP, SaaS, and operational systems
- Hybrid Lakehouse + EDW architectures
- Infrastructure as Code (Terraform, ARM templates)
- Automated testing (unit, integration, data quality)
- Monitoring, logging, and observability
- Technical roadmap planning and execution
- Migration from legacy EDWs (Teradata, Oracle, SQL Server) to Lakehouse
- 5–10+ years of hands‑on experience in data engineering or data architecture
- Ability to lead design discussions, influence architecture decisions, and mentor teams
- Strong problem‑solving mindset and passion for modern data engineering
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).