Sr Big Data Engineer at Beaverton, OR W2

Job Description:

Sr Big Data Engineer at Beaverton, OR

We have an immediate opportunity for a Sr Big Data Engineer with our direct client in Beaverton, OR. The ideal candidate will have a strong background in data engineering and experience working with big data technologies.

Location: Beaverton, OR

Duration: Long Term

Job Type: Contract

Expert data engineers will work with product teams across the client to help automate and integrate various data domains with a wide variety of data profiles into the client's next-gen data and analytics platform. This is an opportunity to work across multiple subject areas and source platforms to ingest, organize, and prepare data through cloud-native processes.

• 5+ years of professional development experience in Python (preferred) or Scala/Java; familiarity with both is ideal
• 5+ years of data-centric development with a focus on efficient data access and manipulation at multiple scales
• 3+ years of experience with the HDFS ecosystem of tools (any distro, Spark experience prioritized)
• 3+ years of significant experience developing within the broader AWS ecosystem of platforms and services
• 3+ years of experience optimizing data access and analysis in non-HDFS data platforms (Traditional RDMS's, No
  
  SQL / KV stores, etc)
• Direct task development and/or configuration experience with a remote workflow orchestration tool – Airflow (preferred), Amazon Data Pipeline, Luigi, Oozie, etc.
• Intelligence, strong problem-solving ability, and the ability to effectively communicate to partners with a broad spectrum of experiential backgrounds

• A demonstrably strong understanding of security and credential management between application / platform components
• A demonstrably strong understanding of core considerations when working with data at scale, in both file-based and database contexts, including SQL optimization
• Direct experience with Netflix Genie
• Prior experience with the operational backbone of a CI/CD environment (pipeline orchestration + configuration management)
• Clean coding practices, passion for development, being a generally good team player, etc, etc (and experience with Git Hub)

• Demonstrate accountability and integrity
• Be willing to learn and adapt every day

We are an equal opportunity employer and welcome applications from diverse candidates. All your information will be kept confidential according to EEO guidelines.