Data Engineer – Big Data; Spark​/Scala, Hadoop, SQL, Python

Data Engineer – Big Data

CTG is seeking to fill a Data Engineer – Big Data position for our client.

Location:

Piscataway, NJ Duration: 12 months

Duties:

• Design, develop, test, and maintain scalable data-processing applications using Apache Spark and Scala.
• Develop and support Big Data applications and data pipelines utilizing Hadoop, Hive, and Impala.
• Write complex SQL queries for data extraction, transformation, reconciliation, analysis, and performance optimization.
• Develop Python scripts and utilities to support data processing, automation, and data engineering activities.
• Design, build, and maintain scalable ETL/data pipelines for large-volume datasets.
• Analyze, troubleshoot, and debug complex application and data-processing code.
• Support data quality, validation, reconciliation, and integrity across enterprise data platforms.
• Collaborate with application developers, data engineers, analysts, and business stakeholders in an Agile environment.
• Contribute to API development and application solutions supporting Big Data platforms and analytics.
• Apply knowledge of analytics libraries, open-source technologies, statistical computing, and Big Data processing frameworks as appropriate.

Skills:

• Strong hands-on experience with Apache Spark and Scala for distributed data processing.
• Strong experience with Hadoop, Hive, and Impala and enterprise Big Data platforms.
• Advanced SQL skills, including complex queries, joins, transformations, reconciliation, and performance tuning.
• Strong Python scripting and data-processing experience.
• Strong application development, coding, debugging, and problem-solving skills.
• Knowledge of ETL/data pipelines, data quality, and data reconciliation.
• Understanding of analytics libraries, statistical computing, and open-source data-processing technologies.
• Experience with Agile development methodologies and CI/CD practices is preferred.

Experience:

• Demonstrated experience developing and supporting applications in enterprise Big Data environments.
• Hands-on experience working with large datasets and distributed data-processing technologies.
• Experience designing, developing, testing, and debugging complex code.
• Experience with large-volume transactional or financial datasets is preferred.
• Banking or financial services experience is preferred.
• Experience supporting production data applications and resolving technical issues is a plus.

Education:

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent combination of education and experience.
• Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required.

CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role.

To Apply:

To be considered, please apply directly to this requisition using the link provided. Kindly forward this to any other interested parties. Thank you!

The expected base salary for this position ranges from $50.00 to $60.00/hour. Salary offers are based on a wide range of factors including relevant skills, training, experience, education, market factors, and where applicable, licensure or certifications obtained. In addition to salary, a competitive benefit package is also offered.

About CTG

CTG, a Cegeka company, delivers IT and business solutions that enhance clients' digital agility, empowering them to seize new opportunities and overcome any challenge. Backed by more than 60 years' experience and a commitment to being a reliable, results-driven partner, we work shoulder to shoulder with clients to shape digital together. Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts.

With more than 9,000 team members in over 15 countries, we combine global expertise with local insight to deliver innovative solutions. We operate across the Americas, Europe, and India, working with over 3,000 clients in many of today's highest-growth industries. Together, we shape what's next—working shoulder to shoulder to deliver impactful solutions for our clients and society.

Our culture is built by…