Register Here to Apply for Jobs or Post Jobs. X

Data Engineer

Job in Sunnyvale - Santa Clara County - CA California - USA
Company: Kforce Technology
Full Time position
Listed on 2020-10-29
Job specializations:
  • IT/Tech
    Java, Python
  • Software Development
    Java, Python, Software Engineer
Job Description & How to Apply Below

RESPONSIBILITIES:

Kforce has a client in search of a Data Engineer in Sunnyvale, CA. Key Tasks:
  • Building Big Data Platforms that can ingest hundreds of terabytes of data, for Business Analytics, Operational Analytics, Text Analytics, Data Services; Build Back end analytical applications
  • Work on performance optimizations; Debug complex production scenarios
  • Design and development of Java, Scala and spark based back end software modules, performance improvement and testing of these modules
  • Scripting using python and shell scripts for ETL workflow; Design and development of back end big data frameworks that is built on top of Spark with features like Spark as a service, workflow and pipeline management, handling batch and streaming jobs
  • Build comprehensive Big Data platform for data science and engineering that can run batch process and machine learning algorithms reliably
  • Design and development of data ingestion services that can ingest 10s of TB of data
  • Coding for Big Data applications on clickstream, location and demographic data for behavior analysis using Spark/Scala & Java
  • Optimized resource requirements including number of executors, cores per executors, memory for Spark streaming and batch jobs
  • Development of AI/ML modules and algorithms for Company ML use cases



Job Requirements:

REQUIREMENTS:

  • Bachelor's degree in Computer Science, Engineering, or a related field
8 years of experience in each of the following (except where otherwise noted):
  • Experience building and managing complex products/solutions
  • Experience working in Linux/Unix environment
  • Good problem solving/analytical skills & an absolute team player
  • 5 plus years of experience developing Restful web services in any Java framework
  • Minimum 5 years of experience on Hadoop Ecosystem (Spark/Scala/Python preferred) & Backend software modules using Scala/Spark & Java
  • Minimum 5 years of experience on performance optimizations on Spark, Hadoop, Any NoSQL
  • Minimum 5 years of experience on Testing and Debugging Data pipelines based on Hadoop and Spark
  • Expert level programming in Java, Scala & Python
  • Experience in developing ETL modules for the AI/ML use cases, developing algorithms & testing
  • Experience with debugging production issues & performance scenarios
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

Position Requirements
1 to 2 Years work experience
 
 
 
Search for further Jobs Here:
(Enter less keywords for more results. Suggestions may be selected)
Location
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
LOGIN Area - Jobsite