Lead Data Engineer; AWS, Azure, GCP

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Cap Tech

Company Description

Cap Tech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At Cap Tech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time.

Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.

Company Description

Cap Tech is an award-winning consulting firm that collaborates with clients to achieve what’s possible through the power of technology. At Cap Tech, we’re passionate about the work we do and the results we achieve for our clients. From the outset, our founders shared a collective passion to create a consultancy centered on strong relationships that would stand the test of time.

Today we work alongside clients that include Fortune 100 companies, mid-sized enterprises, and government agencies, a list that spans across the country.



Job Description

Cap Tech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sourcesin order to enable decision-makers.

We build pipelines and prepare data for use by data scientists, data analysts, and other data systems.

We love solving problems and providing creative solutions for our clients.

Cloud Data Engineers leverage the client’s cloud infrastructure to deliver this value today and to scale for the future.

We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

The Value You Deliver (or What You’ll Do)

• Be trusted advisor to customers with best practices, methodologies, and technologies to implement data engineering solutions.
• Design, implement, and maintain modern data pipelines to deliver optimal solutions utilizing appropriate cloud technologies.
• Partner with product owners and business SMEs to analyze customer requirements and provide a supportable and sustainable engineered solution.
• Provide technical leadership and collaborate within and across teams to ensure that the overall technical solution is aligned with the customer needs.
• Stay current with the latest cloud technologies, patterns, and methodologies; share knowledge by clearly articulating results and ideas to key stakeholders.

• Experience building/operating highly available distributed systems of data extraction, ingestion, and processing large data sets
• 5+ years of experience delivering data engineering solutionson cloud platform
• 5+ years of experience implementing modern designs using at least one cloud-based solution/platform (AWS, Azure, GCP)
• Advanced level proficiency with at least one ETL / Data Orchestration technology (Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend, Matillion)
• Experience cloud-based data warehousing and data lake solutions like Snowflake, Redshift, Databricks
• 5+ years of experience with SQL or No
  
  SQL database (Postgre
  
  SQL, MySQL, SQL server, Oracle, Aurora, Presto, Big Query)
• Expertise with SQL, database design/structure and data structure (star, snowflake schemas, de/normalized designs)
• 5+ years of experience with at least one programming language (Python, Java, R, C / C# / C++, Shell)
• Familiarity with one or more Dev Ops tools (git, Jenkins, CI/CD, Jira)
• Fundamental understanding of big data, open source, and data streaming concepts
• Abilityto think strategically and provide recommendations utilizingtraditional and modern architectural componentsbased on business needs
• Experience providing technical leadership and mentoring other engineers in data engineering space
• Cloud certification on any platform a plus