Data Engineer
Singapore
Listed on 2026-01-12
-
IT/Tech
Data Engineer, Data Analyst, Data Science Manager, Data Security
Yirifi.ai is a Singapore-based company founded in 2023 by Saurav Bhatia (former Global Head of Digital Assets at Standard Chartered). It provides AI-driven solutions for digital asset risk management and regulatory compliance.
The platform offers tools like real-time crypto risk analytics, a global regulation database, a Web3 partner marketplace, and customizable compliance workflows. It mainly serves institutional investors, compliance officers, risk managers, regulators, and legal advisors.
Yirifi.ai is a small, privately held company (around 11–50 employees) and has achieved ISO/IEC 27001:2022 certification, showing strong focus on security and trust. Its mission is to bridge traditional finance and Web3 by making digital assets safer and more compliant.
Job DescriptionThis is a remote position.
We are seeking a Data Engineer to build and maintain our cutting‑edge ELT pipelines that transform raw, diverse data sources into reliable, structured datasets powering our analytics. You will play a pivotal role in transforming unstructured data into structured, actionable formats, enabling efficient and reliable data processing across Yirifi's operations. This includes designing and maintaining data architecture, building robust pipelines, and collaborating with cross‑functional teams to deliver scalable, high‑quality data solutions.
Requirements- Experience:
- Strong proficiency in Python
, including libraries such as Pandas, Num Py, and data parsing frameworks for unstructured data. - Proficiency in designing and implementing ETL/ELT workflows using dbt and Airflow
. - Experience with SQL and relational databases to build structured data repositories.
- In‑depth experience with AWS services like S3
, Glue
, Lambda
, and Cloud Watch
. - Analytical Thinking: Strong analytical and problem‑solving skills, particularly in working with unstructured data sources.
- Adaptability: Ability to work effectively in a fast‑paced, dynamic environment with competing priorities.
- Communication: Excellent communication skills to partner with data scientists, analysts, and stakeholders.
- Design and Build Scalable Data Pipelines: Develop scalable ETL/ELT pipelines to process and transform unstructured data into structured formats using Airflow, AWS Glue, Python, and dbt. Ensure pipelines handle diverse data sources (e.g., JSON, XML, text, and raw logs) and support structured outputs like relational databases or parquet files.
- Data Quality and Validation: Implement automated validation checks for data consistency, completeness, and accuracy using dbt tests, AWS Glue Data Quality, or custom Python scripts. Build a reporting dashboard to monitor data quality metrics and pipeline health.
- Metadata Management: Enhance and maintain metadata in AWS Glue Catalog, ensuring all datasets have clear descriptions, schema definitions, and lineage tracking. Create a centralized metadata repository for easy data discovery and governance.
- Pipeline Reliability and Performance Optimization: Establish monitoring mechanisms (e.g., AWS Cloud Watch) to track pipeline performance and detect bottlenecks or failures proactively. Optimize data workflows for speed and cost efficiency, particularly for high‑volume unstructured data processing.
- Collaborate with Stakeholders: Translate business and compliance requirements into technical specifications for data ingestion and transformation. Partner with data scientists and analysts to create tailored data structures for machine learning models and analytics.
- Emerging Technologies: Identify and pilot emerging tools and frameworks for handling unstructured data (e.g., text parsing with NLP libraries or distributed processing with Spark).
Be part of a rapidly growing company revolutionizing crypto risk and compliance. As a Data Engineer at Yirifi, you will have the opportunity to build innovative data solutions that directly impact our mission. Work with cutting‑edge technologies, solve complex challenges, and drive meaningful change in the digital assets space. Join us to accelerate your career and make a significant impact!
#J-18808-Ljbffr(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).