Data Platform Architect

Overview

Job Type: Contract

Experience: Minimum 15+ years

We are seeking a highly experienced Data Platform Architect to design and build scalable, high-performance data platforms. The ideal candidate should have a strong background in AWS and other Public cloud services, data engineering, AI platform development, data integrity, and schema design. The role demands expertise in ETL techniques, open-source tools, data migration, and enterprise data architecture.

• Architect and Design scalable and secure data platforms, ensuring high availability and performance.
• Develop and Optimize data pipelines and ETL processes using modern frameworks and methodologies.
• Implement AI & ML Platforms
  , ensuring seamless integration with enterprise data ecosystems.
• Ensure Data Integrity & Governance by enforcing best practices for security, compliance, and quality.
• Oversee Data Migration strategies and execution from legacy to modern cloud-based architectures.
• Leverage AWS Services
  , including but not limited to S3, Redshift, Glue, EMR, Athena, Lambda, Dynamo
  
  DB, and Kinesis.
• Lead Open Source Adoption
  , integrating tools like Apache Spark, Airflow, Kafka, and Flink for data processing.
• Collaborate with Cross-Functional Teams including Data Engineers, Data Scientists, and Dev Ops to streamline data workflows.
• Monitor Performance & Scalability
  , proactively addressing bottlenecks in data processing and analytics.
• Establish Best Practices for data modeling, schema design, and data architecture across various domains.
• Mentor and Guide engineering teams to enhance data capabilities within the organization.

• 15+ years of experience in data engineering, data architecture, and cloud-based platforms.
• Expertise in AWS Cloud Services and hands-on experience with data storage, compute, and analytics tools.
• Strong ETL and Data Processing Knowledge
  , including batch and real-time data streaming.
• Tools: Apache NiFi, Talend, Informatica Power Center, AWS Glue, Microsoft SSIS, Matillion, Fivetran, Stitch, dbt (data build tool)
• Proficiency in Open-Source Tools like Apache Spark, Hadoop, Airflow, Kafka, Flink, and Presto.
• Deep Understanding of AI & ML Workflows and their integration with data platforms.
• Proven Experience in Data Migration Strategies from on-premises to cloud.
• Expertise in Data Schema Design, Modeling, and Optimization for relational and No
  
  SQL databases.
• Solid Programming Skills in Python, SQL, and Spark.
• Strong Problem-Solving Abilities with an analytical and strategic mindset.
• Excellent Leadership and Communication Skills
  , capable of working with technical and business stakeholders.

Tools: Apache NiFi, Talend, Informatica Power Center, AWS Glue, Microsoft SSIS, Matillion, Fivetran, Stitch, dbt (data build tool)

• AWS Certified Solutions Architect or AWS Certified Data Analytics Certification.
• Experience working in AI-driven data platforms or MLOps environments
  .
• Familiarity with Kubernetes, Docker
  , and CI/CD pipelines for data workflows.

• Work with cutting-edge technologies in data and AI.
• Influence key architectural decisions and drive innovation.
• Competitive compensation and benefits package.
• A collaborative and high-performing team environment.

If you are passionate about data platforms and have a strong technical foundation, we invite you to apply and be part of our growing team!