Data Engineer

HI Our client is looking for a Senior Data
Engineer in Irving, TX / Wilmington, DE. Below is the detailed requirement.

Job positing
Title
:
Senior Data Engineer

Location
:
Irving, TX / Wilmington, DE

Required Skills
:
Apache Spark (PySpark / Scala), Cloudera Hadoop and CDC

• Bachelor's degree in computer science, Information Technology, or a related field
• Apache Spark (PySpark and/or Scala) in large-scale production environments
• Cloudera Hadoop ecosystem (HDFS, Hive, YARN, Spark on Cloudera)
• Strong SQL expertise with complex transformations, performance tuning, and reconciliation logic
• Enterprise RDBMS experience with Oracle and MS SQL Server
• Batch ingestion, incremental ingestion, and CDC processing patterns
• CDC concepts and tooling (tool-agnostic: Golden Gate, Debezium, or equivalent)
• Data merge, deduplication, watermarking, checkpointing, and SCD handling
• Google Cloud Platform services, including Dataproc, Composer and Dataplex
• Hybrid on prem to cloud data architecture and migration patterns
• Metadata-driven framework development and data quality validation techniques
• CI/CD pipeline implementation using enterprise tooling (Git Hub Actions, Jenkins, Dev Ops)
• Git-based development workflows, code reviews, and automated testing practices
• Experience using Copilot or similar AI-assisted development tools safely and effectively in enterprise environments
• Logging, monitoring, alerting, and operational readiness practices
• Secure coding, access control, and compliance-aware development
• Documentation of design artifacts, runbooks, and operational procedures