Azure Data Engineer: ETL, ADF & PostgreSQL Expert

Azure Data Engineer job at Kanak Elite Services Inc. Weehawken, NJ.

Role: AZURE DATA ENGINEER

Location:
Weehawken, NJ - 5 days onsite (Need Local Candidates from NY, NJ)

Client:
Infosys/UBS
Need PP no. as well !!

Duration: 12 Months

Experience:
Need 10+ Years experience

Job Details:

We are seeking a skilled Azure Data Factory Engineer/Developer with strong Postgre

SQL knowledge to design, develop, and maintain data pipelines for extracting, transforming, and loading (ETL) data from various sources, including Postgre

SQL databases, into Azure data platforms

• Design, Develop, and Maintain ADF Pipelines:
  • Design, develop, and maintain robust and efficient ADF pipelines for data ingestion, transformation, and loading from Postgre
    
    SQL databases and other sources.
  • Optimize ADF pipelines for performance, scalability, and reliability.
  • Develop and implement data quality checks and validation rules within ADF pipelines.
• Postgre
  
  SQL Expertise:
  • Proficiently use SQL to query, manipulate, and extract data from Postgre
    
    SQL databases.
  • Understand Postgre
    
    SQL database architecture, performance tuning, and best practices.
  • Troubleshoot and resolve issues related to Postgre
    
    SQL connectivity, performance, and data integrity.
• Data Integration and Transformation:
  • Design and implement data transformation logic within ADF pipelines, leveraging various ADF activities and connectors.
  • Develop and maintain data mappings and transformations to ensure data consistency and quality.
  • Collaborate with data engineers and business stakeholders to understand data requirements and implement solutions.
• Monitoring and Optimization:
  • Monitor the performance and health of ADF pipelines and Postgre
    
    SQL databases.
  • Identify and resolve performance bottlenecks and data quality issues.
  • Implement and maintain monitoring and alerting mechanisms for ADF pipelines and Postgre
    
    SQL databases.
• Skills:
• Azure Data Factory (ADF):
  Strong experience in designing, developing, and maintaining ADF pipelines.
• Postgre
  
  SQL:
  Extensive knowledge of Postgre
  
  SQL database architecture, SQL, and performance tuning.
• SQL:
  Proficient in writing and optimizing SQL queries.
• Data Modeling:
  Experience in designing and implementing data models.
• ETL/Data Integration:
  Experience with ETL processes and data integration tools.
• Cloud Computing:
  Familiarity with Azure cloud services and technologies.
• Problem-Solving:
  Strong analytical and problem-solving skills.
• Communication:
  Excellent communication and collaboration skills.

Feel Free to reach out to me on