Senior DataOps Engineer

Work type:

Office/Remote

Senior

Software Development

N-iX is looking for Senior Data Ops Engineer to join the team

Our client is an Azerbaijani telecommunications company, the largest mobile network operator in Azerbaijan. The main products are:
Fixed telephony, Mobile telephony, Internet services, Wireless broadband, and Value-added services.

The primary goal is to accelerate the client's Data & AI initiatives via a secure, hybrid cloud foundation on AWS while systematically modernizing the IT estate as part of the cloud migration.

• Cloud Foundation & Landing Zone:
  Deploy target hybrid network architectures, establishing a secure Landing Zone and hybrid Data/AI platforms on AWS.
• Security, Compliance & Governance:
  Operationalize on-prem tokenization (achieving zero raw PII in the cloud), resolve policy blockers to include AWS in the ISMS, and establish a Cloud Center of Excellence (CCoE) to govern Cloud adoption.
• AI Chatbot & Voicebot Design & Implementation:
  Develop and operationalize a flagship Customer Care Chatbot and Voicebot as the first hybrid-setup consumer.

• Design, implement, and maintain the AWS Data Platform foundation, including Amazon S3 lake layout, Apache Iceberg table format standardization, and AWS Glue Data Catalog integration.
• Build and optimize scalable batch and streaming data pipelines using Amazon EMR (Serverless and EMR-on-EKS), Apache Spark/PySpark, Apache Flink, and Amazon Athena with workgroup cost caps.
• Implement data tokenization and de-identification pipelines on the data side (PA-T) using Protegrity/Spark UDFs for batch, Spark Streaming for micro-batch, and Kafka Connect SMT for streaming PII masking prior to cloud transit.
• Build and manage real-time streaming architectures with Amazon MSK (Managed Streaming for Apache Kafka), MSK Replicator/Mirror
  
  Maker2, and Schema Registry integration.
• Implement Medallion Architecture (Bronze, Silver, Gold layers) for lakehouse data modeling, automating Iceberg table registration and backfill frameworks.
• Execute data migration waves across non-PII and PII datasets using AWS Data Sync, automated register steps, and streaming migration configs.
• Configure data access control and governance models using AWS Lake Formation, cross-engine authorization, AWS Macie for PII detection, and Informatica Data Catalog (Axon, EDC, BDQ) integration.
• Build automated schema-drift identification components, Git Lab CI/CD pipeline integration for dataset synchronization, and automated data contracts/circuit breakers.
• Implement Data Ops observability, centralizing logging via Amazon Cloud Watch, configuring Fin Ops cost & anomaly monitoring, and setting up automated alerts.
• Author technical documentation, operational runbooks, disaster recovery (DR) procedures, and cutover/rollback playbooks for data platform hardening.

• 4+ years of hands-on experience as a Data Engineer or Data Ops Engineer building enterprise-grade data platforms and pipelines.
• Strong expertise with AWS Data Analytics stack:
  Amazon S3, AWS Glue Data Catalog, AWS Lake Formation, Amazon EMR (EMR-on-EKS / Serverless), Amazon Athena, AWS Data Sync, and Amazon MSK.
• Deep experience with Apache Iceberg table format, cataloging, compaction, and schema evolution.
• Proficient in Apache Spark / PySpark and Spark Streaming for batch, micro-batch, and real-time data processing.
• Strong experience in Medallion Lakehouse Architecture design and implementation (Bronze, Silver, Gold layers).
• Practical experience in implementing data tokenization and encryption at scale (e.g., Protegrity, Thales, FPE, or Spark UDF-based de-identification pipelines).
• Solid…