Data Engineer

Job #: 5024
Pay Rate:
Not Specified
Job type: contractor

Location:

Irving, TX

• Provide technical guidance or solutions; define, advocate, and implement best practices and coding standards for the team.
• Ensure process compliance in the assigned module, and participate in technical discussions or reviews as a technical consultant for feasibility study (technical alternatives, best packages, supporting architecture best practices, technical risks, breakdown into components, estimations).
• Develop and guide the team members in enhancing their technical capabilities and increasing productivity.
• Prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations.

• 9+ years of experience in Data Engineering and Data Analytics.
• Expert in Big Data Technologies including Spark, Kafka, Kudu, Impala, HBase, and Spark Scala programming.
• Experience with GCP, AWS, and data pipelines.
• Familiarity with scheduling tools such as Oozie, Airflow, and Composer.
• Basic knowledge of CI/CD processes using Jenkins, Java, and Spring Boot.
• Lead experience is highly preferred for this TEAM LEAD position.
• Strong programming skills in Python and R, with expertise in algorithms and data models.
• Experience in reporting and dashboarding tools like H2O, Tensor Flow, and Prediction.io.
• Knowledge of distributed data platforms like HDFS and data cleaning, wrangling, visualization, and reporting.
• Deep understanding of data mining, machine learning, natural language processing, or information retrieval.
• Experience processing large amounts of structured and unstructured data, integrating data from multiple sources.
• Familiarity with Elasticsearch, Splunk, Cassandra, and cluster compute technologies like Spark, Akka, No
  
  SQL DB.
• Exposure to Hortonworks toolset, Zookeeper, and distributed data.