Senior Data Engineer Natural Gas and Power; ETRM IT project

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions.

You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure, and aligned with the strategic goals of the energy business. In addition to hands‑on engineering, you will play a pivotal role supporting the data architecture roadmap, mentoring engineers, and driving innovation in data‑driven decision‑making across the Natural Gas and Power value chain.

• Contribute to the definition of the target data architecture (lake/lakehouse, streaming, event‑driven) and technology choices for high‑volume time‑series, market, and transactional data.
• Build and operate end‑to‑end pipelines (ingest → quality → transform → serve) with strong SLAs/SLOs, lineage, and observability.
• Establish coding, testing, CI/CD, and infrastructure‑as‑code standards; drive adoption of data governance, cataloging, and access controls.
• Own capacity, performance, reliability, and cost efficiency of data platforms across environments (dev/test/prod).
• Ensure data quality, lineage, and observability across all layers of the data stack.

• Master’s or Bachelor’s degree in Computer Science, Data Engineering, Applied Mathematics, or a related technical field.
• 7+ years of experience in data engineering, with at least 3 years in a senior development role.
• Strong and proven experience in Power (and ideally Natural Gas) trading commodities is mandatory, balancing mechanisms, and regulatory frameworks (e.g., REMIT, EMIR).
• Strong experience building and operating data platforms on AWS is required.
• Factory/Databricks Workflows, Key Vault, Azure Monitoring/Log Analytics;
  IaC with Terraform/Bicep; CI/CD with Azure Dev Ops or Git Hub Actions.
• Snowflake (on Azure or multi‑cloud):
  Warehousing design, Streams & Tasks, Snowpipe/Snowpipe Streaming, Time.
• Travel & Fail‑safe, RBAC & row/column security, external tables over ADLS, performance tuning & cost governance.
• Programming & Engineering Practices:
  Strong OOP in Python and Java/Scala; SDLC leadership, Dev Ops mindset, TDD/BDD, code reviews, automated testing (unit/integration/contract), packaging and dependency management, API design (REST/gRPC).
• Web & Data Acquisition:
  Robust web scraping and ingestion with Scrapy, Requests, Playwright/Selenium; scheduling, retries/exponential backoff, change‑data capture; ethical/legal collection practices (robots.txt, terms).
• Orchestration & Quality:
  Airflow/ADF/Databricks Jobs, data contracts, Great Expectations (or similar), lineage/catalog (e.g., Purview), metrics/observability (Prometheus/Grafana/Application Insights).
• Dataframe oriented programming: pandas, spark/snowpark data frames, SQL data transformation.

• Designing low‑latency pipelines for sub‑second to minute‑level telemetry, weather and market data; tuning Spark.
• Structured Streaming/Flink/Kafka Streams.
• Quality & Reconciliation for telemetry and market submissions (gap fill, resampling, deduplication, anomaly detection, schema evolution).
• Serving Patterns: time‑series stores and query layers (e.g., Delta Lake over ADLS, Iceberg, materialized views in Snowflake), APIs and event streams for downstream consumption.

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company.

We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.