Senior ML​/Data Ops Engineer II

Tabby creates financial freedom in the way people shop, earn and save by reshaping their relationship with money. Over 15 million users choose Tabby to stay in control of their spending and make the most out of their money.

The company’s flagship offering allows shoppers to split their payments online and in-store with no interest or fees. Over 40,000 global brands and small businesses, including Amazon, Noon, IKEA, and SHEIN use Tabby to accelerate growth and gain loyal customers by offering easy and flexible payments online and in stores.

Tabby generates over $10 billion in annual transaction volume for its partner brands and is the highest-rated, most-reviewed, largest, and fastest-growing Fin Tech in the GCC region.

Tabby launched in 2019 and has since raised +$1 billion in equity and debt funding from global and regional investors, and is now valued at $4.5 billion.

• Department: Infrastructure
• Employment Type: Full Time
• Location: Remote
• Workplace type: Fully remote
• Reporting To: Evgenii Perepelkin

LLM Serving & Model Management:

• Deep expertise in high-throughput serving using vLLM, NVIDIA Tensor
  
  RT-LLM, and sglang to minimize latency and maximize hardware efficiency.
• Hands-on experience deploying and optimizing large-scale open-weights models, specifically Deep Seek 3.1/3.2, Qwen, and GPT-OSS variants.
• Advanced optimization and security hardening of Docker specifically for GPU environments.
• Managing model weights and orchestration within Kubernetes (GKE) environments.
• Real-Time Data Engineering & CDC:
  Designing and maintaining high-throughput CDC (Change Data Capture) pipelines using the Apache ecosystem (e.g., Debezium, Kafka) to sync data from Cloud Postgre
  
  SQL.
• Deploying and tuning Click House for real-time analytics, ML feature storage, and high-speed logging.
• Orchestrating complex ML data workflows using Airflow (Google Cloud Composer) to ensure data reliability. Must

Core Infrastructure & Networking:

• Strong Linux systems expertise including internals, networking, and performance tuning for large-scale distributed systems.
• Experience with Istio service mesh to manage microservices communication and traffic.
• Provisioning and maintaining dedicated GPU nodes (A100/H100/H200/B200), including driver management and OS-level tuning using Ansible.
• Solid Kubernetes expertise: controllers, CRDs, CNI, and Ingress.
• CI/CD & Tooling:
• Implementing pipelines as code within Git Lab CI, managing runners, caching, and security scanning.
• Infrastructure as Code with Terraform and Terragrunt.
• Proficiency in Python/Bash for building custom automation and AI Agent tooling.

Load Testing & Observability:

• Conducting rigorous load testing for GenAI applications, focusing on metrics like TTFT, TPS, and RPS.
• Deploying and managing LiteLLM Gateway for unified API access, load balancing, and cost tracking.
• Experience with Datadog for monitoring GPU utilization, inference health, and log pipelines.

Soft Skills:

• Strong ownership mindset: balancing speed, reliability, and cost.
• Comfortable working cross-functionally with developers, security, and compliance.
• Excellent sense of responsibility and accountability.
• English B2 or higher.

Nice to Have: Experience with PCI-DSS, SOC2, or regulations compliance environments.

Our Tech Stack: Linux, Docker, Kubernetes, GCP (GKE, Cloud Postgre

SQL), Datadog, Git Lab, Apache CDC, Click House, Airflow, Istio, Terraform, Terragrunt, Ansible, vLLM, Tensor

RT-LLM, sglang, LiteLLM, Deep Seek, Qwen, Go, Python

• Full-time B2B contract
• Fully remote setup, work from anywhere in Europe
• Up to 20% tax allowance
• 22 paid leave days annually
• Stock options (ESOP) in a fast-scaling, pre-IPO company
• Flexi benefits you can use for wellness, travel, or learning
• Work alongside a high-performing, international engineering team in a global fintech unicorn

Relocation support is available to our hubs in Armenia, Georgia, Serbia, and Spain, including flights, temporary accommodation, and legal setup.

Tabby creates financial freedom in the way people shop, earn and save, by reshaping their relationship with money.

The company’s flagship offering allows shoppers to split their payments online and in-store with no interest or fees. Over 32,000 global brands and small businesses, including Amazon, Noon, IKEA and Shein use Tabby to accelerate growth and gain loyal customers by offering easy and flexible payments online and in stores.

Tabby has generated over $7 billion in transaction volume for its partner brands and has the highest rated, most reviewed, largest and fastest growing app of any fintech in the GCC region.

Tabby launched operations in 2020 and has raised +$1 billion in equity and debt funding from global and regional investors.

Not quite right? Register your interest to be notified of any roles that come along that meet your criteria.