Specialist - Research Engineering

Job Title

Principal Duties

A solid experience and understanding of considerations for large scale solutioning and operationalization of data warehouses, data lakes, and analytics platforms on GCP is a must.

Works on creating a framework for ML and LLM Ops.

Works on processes and flow of AI Compliance Governance framework.

Monitors the Data Lake constantly and ensures that the appropriate support teams are engaged at the right times.

Create reports to monitor usage data for billing and SLA tracking.

Work with business and cross functional teams to gather and document requirements to meet business needs.

Provide support as required to ensure the availability and performance of ETL/ELT jobs.

Provide technical assistance and cross training to business and internal team members.

Collaborate with business partners for continuous improvement opportunities.

Requirements

Experience Skills Qualifications

6 years of experience in Data Engineering with an emphasis on Data Warehousing and Data Analytics.

Very strong hands on Python expertise.

Strong Data and GCP Vertex AI knowledge.

6 years of experience with one of the leading public clouds.

6 years of experience in design and build of salable data pipelines that deal with extraction transformation and loading.

6 years of experience with Python, Scala with working knowledge on Notebooks.

6 years hands on experience on GCP Cloud data implementation projects Dataflow, Data Proc, Cloud Composer, Big Query, Cloud Storage, GKE, Airflow, etc.

At least 5 years of experience in Data governance and Metadata Management.

Ability to work independently, solve problems, update the stakeholders.

Analyze, design, develop, and deploy solutions as per business requirements.

Strong understanding of relational and dimensional data modeling.

Experience in Dev Ops and CICD related technologies.