Technical Lead – Data Engineering

About the role

We are seeking a highly experienced Technical Lead – Data Engineering with 10+ years of expertise delivering enterprise‑scale data solutions on AWS. This role is suited for a seasoned, hands‑on developer who combines deep technical proficiency with strategic thinking to design, build, and modernize data platforms. You will develop and implement complex data engineering solutions and contribute to large‑scale cloud transformation initiatives, delivering high‑quality, scalable, and performant data systems that power advanced analytics and business insights.

In this role, you will:

• Design, build, and optimize scalable data engineering solutions using AWS cloud services.
• Develop and maintain robust ETL pipelines using AWS Glue (PySpark/Python) to process large‑scale data efficiently.
• Implement and enhance data integration frameworks leveraging Glue Data Catalog, Crawlers, and S3/JDBC sources.
• Develop high‑performance data processing logic using PySpark, Python, and SQL.
• Contribute to cloud data migration initiatives from on‑premises systems to AWS (RDS PostgreSQL/Aurora) using AWS SCT, DMS, or custom frameworks.
• Orchestrate and manage data workflows using AWS Step Functions, Glue Workflows, and event‑driven services.
• Collaborate with cross‑functional teams to understand data requirements and deliver scalable data solutions.
• Monitor, troubleshoot, and optimize data pipelines using Cloud Watch and other AWS monitoring tools.
• Ensure data quality, performance, and reliability across all data engineering processes.
• Follow best practices in coding, testing, and deployment to maintain high‑quality deliverables.

We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in Charlotte, NC. Regardless of your working arrangement, we are here to support a healthy work‑life balance through our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. These may change based on the project you are engaged in, as well as evolving business and client requirements. We will always be transparent about role expectations.

Please note:

Some roles may require in‑person interviews at Cognizant offices or client locations based on project needs.

• 10+ years of experience in IT with a strong focus on Data Engineering and Analytics.
• Proven hands‑on experience designing and developing scalable data pipelines using Apache Spark (PySpark).
• Strong expertise in AWS services, including Glue, S3, Lambda, Step Functions, Athena, RDS (PostgreSQL/Aurora), Event Bridge, SNS, SQS, SES, and Cloud Watch.
• Extensive experience building and optimizing ETL pipelines using AWS Glue (PySpark/Python).
• Experience in data migration from on‑premises systems to AWS using tools such as AWS SCT and DMS or custom frameworks.
• Strong programming skills in Python, SQL, and UNIX Shell scripting.
• Experience working with Glue Data Catalog, Glue Crawlers, and handling structured and unstructured data sources.
• Solid understanding of data modeling, performance tuning, and optimization techniques for large‑scale datasets.
• Hands‑on experience with UNIX/Linux environments.
• Ability to work independently in a fast‑paced environment and contribute to complex technical solutions.
• Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience).

• Experience with serverless and event‑driven architectures on AWS.
• Strong understanding of data lake and data warehousing concepts.
• Hands‑on experience with performance tuning and cost optimization in AWS data pipelines.
• Familiarity with reporting and BI tools such as Cognos.
• Experience working with large‑scale, high‑volume data processing systems.
• Exposure to CI/CD pipelines and Dev Ops practices for data engineering workflows.
• Strong problem‑solving skills with the ability to troubleshoot complex data and system issues.
• Excellent collaboration and communication skills in a cross‑functional environment.

The annual salary for this position is between $70,000 to $117,000 depending on experience and other qualifications of the successful candidate. This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long‑term/Short‑term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.

Please note, this role cannot offer visa transfer or sponsorship now or in the future.