Data Engineer
Job in
San Jose, Santa Clara County, California, 95199, USA
Listed on 2026-08-08
Listing for:
Compunnel, Inc.
Full Time
position Listed on 2026-08-08
Job specializations:
-
IT/Tech
Data Engineering, Cloud Computing: Infrastructure & Operations, Azure, Data Warehousing
Job Description & How to Apply Below
We are seeking an experienced Data Engineer to design, implement, and optimize cloud-based data solutions on Azure. This role combines hands-on data engineering with cloud data architecture, focusing on scalable data pipelines, modern data platforms, and distributed computing technologies. The ideal candidate will have strong expertise in Azure, Databricks, Spark, SQL, Python, and cloud-native data services, with the ability to create clear technical documentation and architecture diagrams.
Key Responsibilities- Design and implement scalable, secure cloud-based data pipelines, data warehouses, and data lakes.
- Develop and optimize cloud-native data architectures aligned with business objectives.
- Design and integrate Azure data services, including Azure Databricks and Azure Data Lake.
- Build, maintain, and optimize Spark-based ETL pipelines using Databricks.
- Develop robust data models to support enterprise analytics and reporting.
- Create and maintain architecture documentation, including data flow diagrams, entity-relationship diagrams, and system architecture diagrams.
- Produce technical documentation to support implementation, knowledge sharing, and governance.
- Monitor and optimize data pipeline performance, scalability, and reliability.
- Troubleshoot issues related to data pipelines, data quality, and data accessibility.
- Implement best practices for data security, governance, and cloud architecture.
- Collaborate with cross-functional teams to deliver scalable cloud-based data solutions.
- Bachelor's degree in Computer Science or a related field.
- 5+ years of hands-on data engineering experience using distributed computing technologies such as Spark, Map Reduce, or Databricks.
- Proven experience designing and implementing cloud-based data solutions on Microsoft Azure.
- Strong hands-on experience developing Spark ETL pipelines in Azure Databricks.
- Deep understanding of data modeling concepts and techniques.
- Strong proficiency with relational and non-relational database systems.
- Advanced knowledge of Azure Databricks, Azure Data Lake, and cloud-native data services.
- Experience with big data technologies, including Hadoop and Spark.
- Strong scripting skills using Python and SQL.
- Experience creating technical diagrams using tools such as Microsoft Visio, Lucidchart, or similar diagramming tools.
- Strong understanding of data security, governance, and best practices.
- Experience with AI Agents or AI-enabled data solutions.
- Experience working with Gainsight.
- Strong analytical, problem-solving, and troubleshooting skills.
- Excellent communication and technical documentation skills.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×