DATA ENGINEER Job New York New York USA,Software Development

Position: DATA ENGINEER I
Location: New York

Job Purpose

The Data Engineer will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T‑SQL development, ETL processes, and Python scripting to ensure efficient data transfer, transformation, and integration. The primary focus will be on automating data workflows, supporting diverse file formats, and utilizing APIs for seamless data import and export.

The Data Engineer will collaborate closely with cross‑functional teams to enhance data‑driven decision‑making and contribute to the overall success of our data infrastructure.

Job Responsibilities

Utilize advanced T‑SQL skills to design, optimize, and maintain database structures.
Develop complex SQL queries for reporting and data transformation.
Design, implement, and optimize ETL processes for efficient data extraction, transformation, and loading.
Develop and maintain ETL scripts using Python for seamless integration with existing data workflows.
Automate SFTP file transfer processes, ensuring secure and reliable data exchange.
Import and export data and files in various formats, including flat file, XML, JSON, X12, Excel, and Parquet using Python.
Utilize Python to integrate with APIs for importing and exporting data.
Collaborate with team members and stakeholders to review and optimize code for efficiency and maintainability.
Collaborate with analysts and business stakeholders to understand data visualization requirements.
Work closely with cross‑functional teams to understand data requirements and ensure data integrity.
Document data engineering processes, standards, and best practices.
Use Git and Git Hub for version control of scripts and queries, ensuring a collaborative and organized development environment.
Integrate Tableau for effective data representation and reporting.

Schedule: Monday - Friday | 8:30AM – 5:30PM

Weekly

Hours:

40

Location: Flushing, Queens - Hybrid

Qualifications

Education: Bachelor's Degree in Computer Science, Information Technology, or a related field.

Experience

One to four (1-4) years of hands‑on experience in T‑SQL development and ETL processes.
Proven experience in Python scripting for data manipulation and automation.
Experience in data visualization using Tableau.
Strong problem‑solving skills and ability to troubleshoot data‑related issues effectively.
Identify and implement solutions to complex technical projects.
Ability to work independently and in a team environment.
Excellent communication and collaboration skills.
Knowledge of health care delivery and operations a plus.

Technical Skills

Strong expertise in database design, optimization, and maintenance using T‑SQL.
Proficient in developing and optimizing ETL processes.
Experience with automating SFTP file transfers and handling diverse file formats.
Knowledge of data formats such as XML, JSON, Excel.
Proficient in version controlling scripts and queries using Git and Git Hub.

Physical Requirements

Standing – Duration of up to 6 hours a day.
Sitting/Stationary positions – Sedentary position in duration of up to 6-8 hours a day for consecutive hours/periods.
Lifting/Push/Pull – Up to 50 pounds of equipment, baggage, supplies, and other items used in the scope of the job using OSHA guidelines, etc.
Bending/Squatting – Have to be able to safely bend or squat to perform the essential functions under the scope of the job.
Stairs/Steps/Walking/Climbing – Must be able to safely maneuver stairs, climb up/down, and walk to access work areas.
Agility/Fine Motor Skills – Must demonstrate agility and fine…