Data Engineer

Department: Engineering

Employment Type: Permanent - Full Time

Location: New York

Compensation: $94,500 - $115,000 / year

We are looking for a Data Engineer with strong Microsoft SQL Server and Snowflake experience to join our Data & Analytics engineering team.

This role is ideal for an engineer who enjoys working with large-scale data, complex SQL, data pipelines, and production systems and wants to play a key role in modernizing a large SQL Server-based data platform to Snowflake and AWS.

You will work across both our existing SQL Server environment and our modern cloud data platform, developing new capabilities while helping migrate and optimize existing data processing.

• Languages
  : SQL, Python, C#; scripting experience
• Databases
  :
  Microsoft SQL Server, Snowflake
• Data Engineering
  : ETL/ELT, Apache Airflow, data pipelines
• Cloud
  : AWS, including S3 and other AWS data services
• Development
  :
  Git, CI/CD, Liquibase, automated testing and deployment
• Data
  :
  Market data, trade data, transaction cost analysis, and financial data

• Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, views, and data processing workflows.
• Design and develop scalable Snowflake data solutions, including data models, SQL transformations, loading processes, and analytical workloads.
• Participate in the migration of large volumes of data and processing from SQL Server to Snowflake.
• Analyze existing SQL Server logic and translate or redesign it for Snowflake where appropriate.
• Build and maintain ETL/ELT pipelines using SQL, Python, and workflow orchestration tools such as Apache Airflow.
• Develop data ingestion and processing workflows using AWS, including S3.
• Perform SQL Server and Snowflake performance tuning, including query optimization, execution plans, indexing, statistics, warehouse sizing, and workload optimization.
• Build data validation and reconciliation processes to ensure migrated and transformed data is accurate and complete.
• Troubleshoot production data issues, identify root causes, and implement reliable long-term solutions.
• Implement monitoring, logging, alerting, and operational controls for critical data pipelines.
• Collaborate with software engineers, service managers and implementation team, product teams, and Dev Ops.
• Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality.
• Work with large-scale trade, market, benchmark, and financial data.

Educational Background:

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.

• Hands-on experience with Snowflake and AWS
  Cloud services (particularly S3 and data services).
• Strong hands-on SQL development experience.
• Python & C# scripting experience
• Strong experience with Microsoft SQL Server
  , including complex queries, stored procedures, performance tuning, and troubleshooting.
• Experience working with large datasets and production data systems
  .
• Strong analytical and problem-solving skills.

• Experience migrating SQL Server workloads to Snowflake or another cloud data platform.
• Experience with Apache Airflow or similar orchestration technologies.
• Experience with Git, CI/CD, Liquibase and automated deployment processes.
• Experience with data quality, reconciliation, and data governance.
• Knowledge of capital markets, trading, market data, or financial systems.
• Experience with Transaction Cost Analysis (TCA) or other financial analytics.
• Snowflake or AWS certification.

• We encourage engineers to use modern AI-assisted development tools, such as Claude Code to accelerate development, debugging, testing, refactoring, and migration…