Data Engineer; Columbus, OH

Data Engineer (4168-1) Columbus, OH

Databricks, ETL pipelines, Docker for containerization, utilizing REST API in Python, Python

Experience level: Mid-senior
Experience required: 10 Years
Education level: Bachelor’s degree
Job function: Information Technology
Industry: Information Technology and Services
Pay rate: View hourly payrate
Total position: 1
Relocation assistance: No
Visa sponsorship eligibility: No

• Strong experience in Databricks
• Expertise in implementing batch and real-time data processing solutions using Azure Data Lake Storage, Azure Data Factory, and Databricks
• Experience in building ETL pipelines for ingesting, transforming, and loading data from multiple sources into cloud data warehouses
• Proficient in Docker for containerization, utilizing REST API in Python for system integration, and applying containerization to improve deployment efficiency and scalability
• Experience in data extraction, acquisition, transformation, manipulation, performance tuning, and data analysis
• Skilled in using Python libraries to build efficient data processing workflows and streamline ETL operations across large datasets and distributed systems
• Expertise in automating data quality checks, reducing data errors by 40%, and ensuring reliable reporting and analytics with data marts
• Proficient in data orchestration and automation tools such as Apache Airflow, Python, and PySpark for end-to-end ETL workflows
• Experience in deployment activities