DevOps Engineer Data

Описание:
The Data Engineering team builds and maintains data infrastructure that powers trading research and production systems.

• Design, implement, and maintain Dev Ops tooling for data pipelines and platforms
• Support and automate ETL workflows such as Spark and Airflow
• Build and manage monitoring and observability for data quality, pipelines, and storage systems
• Implement and maintain data storage infrastructure on AWS
• Integrate and support Project Nessie as a transactional catalog for Data Lakes with Git-like semantics
• Work closely with Data Engineers to ensure smooth deployment, versioning, and scaling of data jobs and pipelines
• Automate deployment and CI/CD processes with Git Lab CI/CD
• Ensure security best practices for handling sensitive data
• Write infrastructure automation using Python, Bash, and Ansible
• Document systems, pipelines, and Dev Ops processes

• 5+ Years in a Dev Ops, IT Ops, or Data Ops role, with hands‑on experience in data‑related infrastructure
• Strong Linux knowledge, including networking, kernel tuning, and performance optimization
• Hands‑on experience with Airflow, Click House, DBT, Spark, and Project Nessie
• Solid knowledge of AWS services, including S3, EC2, IAM, and networking
• Proficiency in Python, Bash, and Ansible scripting and automation
• Experience with Git Lab CI/CD pipelines
• Experience with Prometheus, Grafana, and ELK monitoring stacks
• Familiarity with Docker and Kubernetes
• Understanding of data governance concepts
• Strong communication skills and a proactive, ownership-driven mindset
• English proficiency at B2+ level
• Будет плюсом: real-time data streaming experience, Terraform, security in data engineering (IAM, encryption, access control), background in high-performance systems or trading environments

B2B engagement