Architect, Data Engineering

Job Description

Primary Skill: ETL Informatica Developer. Secondary:
Oracle, SQL.

Experience:

Minimum 10 years.

• Design, develop, and maintain ETL processes using Informatica Power Center or other relevant Informatica tools.
• Deep understanding of HDFS, YARN, Map Reduce, Hive, Pig, HBase, Flume, Sqoop, Zookeeper, Oozie.
• Experience with Spark, Kafka, No
  
  SQL databases.
• Experience in Agile Methodology.
• Experience with code versioning tools like Bit-Bucket.
• SQL Proficiency:
  Utilize SQL/PLSQL to extract, transform, and load data.
• Exposure to advanced transformations like data transformations, Parsing JSON/XML messages.
• Experience in Job scheduling tools like Autosys.
• Data Integration:
  Integrate data from various sources, ensuring data consistency and quality.
• Data Warehouse Design:
  Design and maintain data warehouses to support business intelligence activities.
• Performance Optimization:
  Optimize SQL script/queries for speed and efficiency.
• Troubleshooting:
  Identify and resolve issues in ETL processes.
• Documentation:
  Create and maintain technical documentation for ETL processes.
• Testing:
  Perform unit, integration, and system testing on ETL processes.
• Collaboration:
  
  Collaborate with cross-functional teams to ensure successful implementation of ETL processes.
• Data Quality:
  Ensure data quality by implementing data cleansing and transformation processes.
• Data Modeling:
  Develop and maintain relational and dimensional data models.

$100,000-$125,000 per year.

BACHELOR OF COMPUTER SCIENCE