Data Engineer

Data Engineer

Location: San Jose, CA
Duration: 6+ Months
Work Mode: Onsite / Hybrid
Max Bill Rate: $90/hr
MSP Owner: Deepa Narayanan
GBaMS Req :

We are seeking an experienced Data Engineer to design, develop, and implement a robust semantic data layer using Dremio
, enabling self‑service analytics and consistent business intelligence across the organization.

The ideal candidate will have hands‑on experience with Dremio, Apache Iceberg, Apache Arrow, AWS cloud services, SQL, and modern lakehouse architectures
. This role requires expertise in semantic modeling, data virtualization, query federation, and cloud‑native data platforms.

• Design and implement a scalable semantic data layer using Dremio.
• Develop and maintain semantic models, virtual datasets, and business views to support enterprise analytics.
• Build and manage lakehouse architectures utilizing Apache Iceberg for table management.
• Leverage Apache Arrow for high‑performance columnar query processing and analytics workloads.
• Integrate Dremio with AWS data platforms including:
  • Amazon S3 Data Lake
  • Amazon Redshift
  • Amazon RDS
• Develop and optimize SQL queries, data models, and reporting structures.
• Implement data governance, metadata management, and data quality best practices.
• Optimize query performance and support data virtualization and federation capabilities.
• Collaborate with business stakeholders, analytics teams, and data architects to deliver scalable data solutions.
• Support cloud‑native data engineering initiatives and modern analytics platforms.

• Strong experience with Dremio.
• Expertise in semantic data modeling and virtual datasets.
• Advanced SQL development and optimization skills.
• Experience building business views and semantic layers.

• Hands‑on experience with Apache Iceberg.
• Experience with Apache Arrow.
• Strong understanding of:
  • Data Virtualization
  • Query Federation
  • Lakehouse Architecture
  • Metadata Management
  • Data Governance

• Experience with AWS Cloud Services:
  • Amazon S3
  • Amazon Redshift
  • Amazon RDS
• Understanding of cloud‑native data platforms and architectures.

• Dremio
• AWS Cloud
• Oracle SQL / SQL
• Apache Iceberg
• Apache Arrow

• Data Modeling
• Semantic Layer Development
• Data Virtualization
• Query Federation
• Amazon Redshift
• Amazon S3
• Amazon RDS
• Data Governance
• Metadata Management
• Lakehouse Architecture

• Experience supporting enterprise BI and self‑service analytics platforms.
• Knowledge of modern data warehousing and data lake concepts.
• Experience with performance tuning and query optimization.
• Strong analytical and problem‑solving skills.
• Excellent communication and stakeholder management abilities.

6 – 8 Years