Lead Data Engineer

Job Details:

• Advanced expertise in ETL / ELT pipeline design
• Handling:
  • Batch data processing
  • Near real time / streaming data
• Experience with structured and semi structured data
• Strong knowledge of:
  • Incremental loading
  • CDC (Change Data Capture)
• Pipeline orchestration and dependency management
• Strong programming skills in Python or Scala or Java (nice to have)
• Performance optimization for large scale data processing
• Solid understanding of:
  • Dimensional modeling (Star / Snowflake)
  • Normalized and denormalized models
• Strong experience on:
  Azure, AWS, or GCP
• Hands on with Data Warehouses (Snowflake, Synapse, Big Query, Redshift)

• Design end to end data engineering architectures
• Define scalable solutions for:
  • Data lakes / lakehouse
  • Data warehouses
  • Streaming and real time systems
• Ensure alignment with enterprise architecture, security, and compliance standards
• Review and approve technical designs

• Lead development of ETL / ELT pipelines
• Handle:
  • Batch and real time ingestion
  • Structured and semi structured data
• Optimize pipelines for performance, reliability, and cost
• Manage schema evolution and data dependencies

• Establish data quality standards and validation rules
• Implement monitoring, alerting, and observability
• Perform root cause analysis for data incidents
• Drive operational excellence and stability

• Build CI/CD pipelines for data workloads
• Automate testing, deployment, and rollback
• Improve reliability through automation