Data & AI Engineer
Listed on 2026-10-24
-
Software Development
Data Engineering
Dark Wolf is seeking a Data & AI Engineer specializing in Google Cloud Platform to architect, deploy, and scale advanced data, machine learning (ML) and generative artificial intelligence (AI) workflows in secure cloud environments. In this role, you will be responsible for leading the architectural development, scaling, and governance of enterprise‑grade data platforms. In this role you will leverage GCP’s AI and data ecosystem to transform complex unstructured data into production‑ready assets for agentic search, graph‑based entity resolution, and multi‑modal AI systems.
In addition, the ideal candidate will be responsible for designing secure, mission‑relevant data meshes, establishing automated data quality frameworks, optimizing distributed compute clusters, and ensuring high resilience across air‑gapped and multi‑cloud networks.
- Lead the architectural design and implementation of cloud‑native distributed, high‑throughput batch and streaming data platforms.
- Optimize distributed execution engines to handle petabyte‑scale datasets under strict SLAs.
- Implement and collaborate on Infrastructure as Code (IaC) to provision data platform assets across multi‑cloud infrastructure.
- Establish zero‑trust security controls, data lineage tools, and automated compliance scanning for regulated data environments.
- Design and manage ETL/ELT pipelines using cloud‑native, Google services such as Cloud Storage, Dataflow, Cloud Run, Agent Platform, and Big Query
- Understand big data processing frameworks for large‑scale data sets such as Apache Spark.
- Architect and process large‑scale datasets and cloud data warehouses using tools such as Google Big Query and Knowledge Catalog.
- Programming experience to build automation scripts, handle data structures and connect to APIs.
- Configure and manage GCP services such as Compute Engine, App Engine, Kubernetes Engine, Cloud Storage, Big Query, Dataflow, and Cloud SQL.
- Enforce cloud security best practices and support DoD/DISA Authority to Operate (ATO) processes.
- Act as Technical Pod Lead, driving Agile spring deliverables, establishing technical standards, and mentoring data engineering staff.
- Stay up-to-date on the latest GCP services and technologies.
- Work collaboratively within a fast paced Agile team environment.
- Bachelor's degree in computer science or a related field (or equivalent practical experience)
- 4+ years of data engineering experience.
- 4+ years of experience in architecting data structures for model grounding and engineering pipelines that transform raw data into tool‑accessible assets for agentic workflows.
- 4+ years of experience with Python, Scala, SQL, and Go for high‑performance data platform development.
- 4+ years of experience with distributed systems internals, LMS trees, column‑family stores, and data warehouse and lakehouse storage formats.
- 4+ years of experience with Kubernetes cluster management, custom operators for data platforms, and service mesh integration.
- 4+ years of experience with enterprise data strategy, conceptual‑to‑physical data modeling, and streaming data schema contracts.
- 4+ years of experience on GCP supporting AI/ML research, experimentation, and production delivery.
- Experience and expertise in Apache Spark, Flink, Kafka, Ray, and workflow orchestration engines.
- Experience architecting multi‑cloud and hybrid cloud data platform solutions (IaC via Terraform).
- Understanding of Dev Sec Ops pipelines, automated compliance testing, and secret rotation management .
- Strong understanding of GCP services and technologies.
- Excellent communication and teamwork skills.
- Must be a U.S. Citizen holding an active Secret Security Clearance.
- Proven track record architecting data solutions for deployment…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).