Platform Engineer Automation

Data Platform Engineer

Minimum 6+ years experience working on data platforms like Databricks or AWS Lakehouse and implementing modern data platforms using automation tools and techniques.

Minimum 6+ years experience working on big data environments with associated toolsets. Extensive experience with data pipelines.

Minimum 2 years experience on Crossplane or similar technology.

Extensive experience with automating associated platform tasks like patching, integrating with monitoring, cluster maintenance, capacity and automated troubleshooting.

6+ years experience working on automating data platform builds using IaC and config mgmt. Extensive experience on Terraform and Ansible.

2+ years experience in CI/CD tools including Git Lab.

4+ years of experience on concepts like cross account referencing in building datalakes using IaC tools in large environments.

6+ years of experience using scripting like Python, Power Shell and shell to automate data platforms. Ex – AZ CLI or AZ PS1 to script creation on datalakes, eventhubs, service bus etc.

6+ years of experience with working on data platform concepts like data ingestion, transformation, data enrichment, data processing, analytics.

8+ years of experience on Windows, Unix, databases and cloud services.

4+ years of experience in containers and at least one K8s platform like Open Shift or EKS or AKS.

2+ years experience in automation in security hardened environments with regulatory requirements.

4+ years of experience working in agile environments.