Data Engineer

Job Description

The Data Engineer II will help design, build, and maintain a centralized performance and analytics repository that integrates data from multiple technology platforms and operational systems. This role is responsible for developing scalable data pipelines, transforming and validating complex datasets, and creating reusable data structures that support reporting, analytics, and operational decision-making.

Working closely with architects, product owners, engineers, and analytics teams, this individual will help deliver high-quality data solutions that enable dashboards, reports, and visualizations. The ideal candidate combines strong data engineering fundamentals with experience building data models, optimizing databases, and supporting data-driven insights.

• Design, develop, and maintain data ingestion and transformation pipelines.
• Integrate data from multiple platforms, databases, APIs, and operational systems.
• Create and maintain data models, schemas, tables, views, and collections.
• Build and optimize solutions using PostgreSQL, MongoDB, or similar databases.
• Develop processes that ensure data quality, accuracy, consistency, and reliability.
• Transform raw and semi-structured data into curated, analytics-ready datasets.
• Partner with stakeholders to define data requirements and technical solutions.
• Support dashboard, reporting, and visualization initiatives by providing optimized datasets.
• Troubleshoot data issues, identify root causes, and implement corrective actions.
• Participate in testing, code reviews, deployment activities, and production support.
• Document data flows, transformations, and technical solutions.
• Contribute to Agile planning, estimation, and delivery activities.

• 3+ years of experience in data engineering, ETL, or data integration roles.
• Strong SQL skills and experience designing relational database solutions.
• Experience with PostgreSQL, SQL Server, or similar database technologies.
• Experience with MongoDB or other No
  
  SQL database platforms.
• Proficiency in Python, Java, Spark, or similar data processing technologies.
• Experience building and maintaining automated data pipelines.
• Knowledge of data modeling, schema design, and data warehouse concepts.
• Experience implementing data quality controls and validation processes.
• Familiarity with REST APIs, file-based ingestion, and system integrations.
• Experience working with large-scale operational or analytical datasets.
• Understanding of performance tuning, indexing, and query optimization.
• Experience supporting dashboards and reporting platforms such as Grafana, Tableau, or Power BI.
• Familiarity with Agile development methodologies and CI/CD practices.
• Strong analytical, problem-solving, and troubleshooting skills.
• Excellent communication and documentation skills.

• Experience working on Big Data Technologies
• Cloudera Admin / Dev Certification
• Certification in Cloud, Docker-Container, Openshift Technologies