Data Engineer

Role :
Data Engineer

We are seeking a highly skilled Senior Data Engineer & Database Expert to join our team building the next-generation Banking Foundation Platform (BFP). In this role, you will be instrumental in designing, optimizing, and maintaining our robust data pipelines and database systems that process millions of financial transactions daily. You will work at the intersection of big data processing and database excellence, ensuring our platform meets stringent performance, reliability, and scalability requirements.

• Design, build, and maintain scalable ETL data pipeline using ADLS Gen, Azure Blob storage, Azure Databricks, Python, Azure SQL Database and Azure Cosmos DB.
• Perform deep database performance tuning, query optimization, and indexing strategies across Azure SQL Database.
• Lead database migration initiatives, including strategic migration from Azure SQL Database and Cosmos
  
  DB to Postgre
  
  SQL.
• Implement efficient data models and manage data storage solutions using ADLS Gen and real time data streaming using ADF, Spark and Confluent Kafka.
• Develop and maintain data quality checks, monitoring, and alerting systems. Ensure data solutions comply with regulatory and security standards (PCI DSS).
• Optimize batch processing workflows for intra-day and end-of-day banking operations.

• years of hands-on experience in data engineering with strong database expertise.
• At least years of experience in implementing operational data store (ODS) for the retail banking space, which captures the multiple cross system transactions, providing high throughput and low latency solution using RDBMS or No
  
  SQL Technologies.
• Should have hands-on experience implementing solutions using ADLS Gen, Azure Blob storage, Azure Databricks, Azure SQL Database and Azure Cosmos DB.
• Should have hand on experience in writing queries using the Normalized Data model for the retail banking space.
• Expert-level skills in database performance tuning, query optimization, and execution plan analysis.
• Proven experience with large-scale database migrations (Azure SQL Database to Postgre
  
  SQL preferred).
• Strong programming skills in Python for data processing and automation.
• Experience with data modeling, ETL / ELT processes, and data warehouse concepts.
• Excellent problem-solving skills with ability to diagnose and resolve complex data pipeline issues.

• Can-do attitude with eagerness to tackle challenging problems.
• Strong communication skills for technical discussions and solution proposals.
• Collaborate with cross-functional teams to resolve complex data-related performance issues and ability to mentor junior engineers.
• Azure platform engineering using Power Shell, ARM Templates, Cloud Automation Frameworks.
• Familiarity with Azure Dev Ops, Git Lab, and metadata management tools (Data Governance, MDM, Lineage).

Bachelor or master degree or equivalent in Computer Science major.