Senior Databricks​/Snowflake Data Architect – BestX, VP

We are seeking an experienced Senior Databricks / Snowflake Data Architect to join the BestX engineering team. In this role, you will lead the design and evolution of BestX's next-generation cloud-native data platform, leveraging Databricks, Snowflake, and modern data engineering technologies to support multi-asset Transaction Cost Analysis (TCA), analytics, and reporting capabilities. The ideal candidate combines strong data architecture expertise with a hands-on engineering mindset and a passion for evaluating emerging technologies.

You will help shape the strategic direction of our data platform through rapid prototyping, proof-of-concepts, and scalable production implementations.

• Design and develop the architecture for BestX's next-generation multi-asset TCA and analytics platform.
• Lead technology evaluations, proof-of-concepts, and rapid prototyping initiatives across modern data platforms and cloud-native technologies.
• Architect and implement scalable data lakehouse solutions using Databricks, Snowflake, and cloud-native services.
• Design high-performance data models, ingestion frameworks, and transformation pipelines supporting both real-time and batch processing workloads.
• Establish best practices for data governance, lineage, security, metadata management, and platform observability.
• Build and optimise analytical platforms capable of processing large-scale market, transaction, and reference datasets.
• Work closely with quantitative researchers, product teams, and engineering teams to translate business requirements into scalable technical solutions.
• Define architectural standards and technology roadmaps for data warehousing, lakehouse, streaming, and AI/ML workloads.
• Drive adoption of modern Agile, Dev Ops, CI/CD, Infrastructure-as-Code, and Data Ops practices.
• Develop a strong understanding of Transaction Cost Analysis (TCA), best execution workflows, and relevant regulatory requirements including MiFID II and MiFIR.
• Mentor engineering teams and provide technical leadership across strategic platform initiatives.
• Take ownership of architecture decisions from concept through production delivery.

• Experience in designing and implementing enterprise-scale data platforms.
• Strong hands-on experience with Databricks, including Delta Lake, Unity Catalog, Spark, Structured Streaming, and Lakehouse architecture.
• Strong hands-on experience with Snowflake, including data modelling, performance optimisation, Snowpark, data sharing, and governance capabilities.
• Expertise in Apache Spark, Python, SQL, and modern ELT/ETL frameworks.
• Proven ability to rapidly evaluate, prototype, and compare emerging technologies and architectural patterns.
• Experience designing large-scale analytical platforms supporting high-volume and high-velocity datasets.
• Strong understanding of data architecture principles including dimensional modelling, Data Vault, lakehouse methodologies, and distributed computing.
• Experience with cloud platforms, preferably AWS, including services such as S3, EMR, Glue, ECS/EKS, Lambda, and related analytics services.
• Experience building streaming architectures using technologies such as Kafka, Spark Streaming, Event Bridge, or equivalent.
• Deep understanding of data governance, security, lineage, and regulatory controls in financial services environments.
• Strong software engineering and Dev Ops mindset, including CI/CD and Infrastructure-as-Code.
• Excellent stakeholder management and communication skills, capable of influencing architecture decisions across multiple teams.

• Experience building analytics platforms for capital markets, including FX, Fixed Income, Equities, or Derivatives.
• Knowledge of Transaction Cost Analysis (TCA), execution…