Data Engineer

We are seeking a skilled Data Engineer to join the Cyber Data and Platform Team.

This role involves designing and building scalable data pipelines, processing complex data from APIs, and supporting analytics and reporting solutions.

The ideal candidate will have strong Python and SQL skills, experience with orchestration tools, and a passion for secure, production-grade deployments.

Key Responsibilities

• Design and build robust ETL pipelines using Python to process structured and unstructured data.
• Write complex SQL queries for data extraction, transformation, and analysis using MS SQL Server or Postgre
  
  SQL.
• Process large, paginated API data and manipulate complex JSON structures.
• Use workflow orchestration tools such as Airflow or Dagster to schedule and manage data workflows.
• Deploy and manage application code in production environments with a focus on security and reliability.
• Collaborate with cross-functional teams including data architects, developers, and stakeholders to deliver scalable data solutions.
• Support data curation and backend enhancements for self-service analytics platforms.

• 5+ years of experience in data engineering or a related field.
• Strong hands-on experience with Python for data processing and automation.
• Proficiency in SQL and experience with relational databases like MS SQL Server or Postgre
  
  SQL.
• Experience with API integration and handling complex JSON data.
• Familiarity with orchestration tools such as Airflow, Dagster, or similar.
• Proven ability to deploy secure, production-ready code.
• Excellent communication skills and ability to work across multiple teams.

• Familiarity with PySpark and distributed data processing.
• Exposure to Qlik or other self-service BI platforms.
• Experience working in regulated environments or with cybersecurity data.