Data Engineer – Streaming

Requirements Must have:

• 6+ years of experience in application development
• Minimum 2 years of data engineering experience using Kafka
• Proficiency in developing and executing applications on Linux
• 5 years of coding experience in at least one programming language:
  Python, Ruby, Java, C/C++, or Go
• Competence in SQL and database management
• Strong understanding of distributed systems architecture, design, and trade-offs
• Expertise in designing and implementing ETL pipelines using various technologies
• Ability to oversee the complete development cycle, including requirement definition, design, implementation, testing, and deployment
• Excellent communication skills for team collaboration
• Capacity to learn new technologies and work autonomously
• Familiarity with AWS or other cloud platforms (preferred)
• Knowledge of Elastic Search ELK (preferred)

• Develop applications and services to support data engineering needs
• Design and build ETL pipelines that efficiently process large volumes of data
• Collaborate with cross-functional teams to define application requirements
• Participate in all stages of the development lifecycle, from conception to deployment
• Conduct testing and debugging to ensure application accuracy and performance
• Maintain system documentation and architecture diagrams
• Communicate effectively with team members to facilitate project progress

We are seeking a talented Data Engineer (Streaming) to join our team, working onsite at either our Alpharetta, GA or Menlo Park, CA location. This role involves contributing to a major project for our client, Morgan Stanley, in the finance sector. We offer a competitive hourly rate based on experience and a collaborative work environment. The candidate must be local or able to travel to our office locations.

Our team values innovation and professional growth, making this a great opportunity for individuals eager to expand their skill set in the tech industry.