Data Engineer Manager

1OX Recruiting Partners has a refreshing approach to recruiting. Our purpose and passion is to Connect Relationships and Elevate Careers and Lives. We are a group of experienced professionals from a wide variety of backgrounds specializing in different industries and geographies which gives us a unique ability to be successful in nearly any niche of recruiting.

• Must be a US Citizen or a Green Card Holder

Design and develop scalable solutions to store and retrieve high volume of data on cloud.

Deliver project and customer success by meeting deadlines, managing expectations and by delivering good quality solutions.

Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.

Design data integrations and data quality framework.

Work closely with all business units and engineering team to develop strategy for long term data platform architecture.

Develop high performance data pipelines to support complex data integration

Develop automation programs, shell scripts and other utilities.

Write well designed, testable, and efficient code.

Support process flow analysis and ETL process redesign

Document customer requirements as needed.

Here’s what you need:

Master’s degree in Computer Science, Computer Engineering, or related discipline

5+ years of expertise in Python

Experience in working with Data Structure

Advanced knowledge of RDBMS Systems, SQL and query optimization techniques

Experience with data orchestration tools like Airflow.

Experience with big data technology Apache Spark

Should have experience/exposure to technical design and architecture for any big data projects.

Experience working with one or more of the major cloud platforms - Azure/AWS/GCP

Hands on experience on Big Data tools and design and develop data pipeline on any Cloud Platform.

Experience of developing data pipelines using tools such as Spark, Python, AWS Glue, Azure Data Factory

Hands‑on experience in Dataflow, Apache Beam, Spark, Hadoop, Kafka, Big Query, Data Catalog, Airflow etc.

Familiarity with event‑driven programming

Strong unit test and debugging

Proficient understanding of Git Hub, JIRA

Dynamic and demonstrates a very positive attitude

Excellent Analytical and Communication Skills

Must be familiar with Agile development methodology

For now, all "Company" business travel, international and domestic, is currently restricted to client-essential sales/delivery activity only.