Data Engineer

Overview

Data Engineer

The Opportunity:

Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it’s gathered from disparate sources. We need an experienced data engineer to help our clients find answers in their data to impact important missions from fraud detection to cancer research, to national intelligence.

You’ll help build advanced technology solutions and implement data engineering activities on mission-driven projects. You’ll deploy and develop pipelines and platforms that organize and make disparate data meaningful. You’ll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. Manage the assessment, design, building, and maintenance of scalable data platforms for clients.

• Develop, deploy, and maintain data pipelines and platforms to organize structured and unstructured data.
• Collaborate with a multi-disciplinary team of analysts, engineers, and data consumers in a fast-paced, agile environment.
• Lead analytical exploration and data examination to derive insights.
• Design, build, and maintain scalable data platforms for clients.
• Guide project teams to scale, monitor, and operate data platforms.

• 5+ years of experience in application development.
• 5+ years designing, developing, operationalizing, and maintaining complex data applications at enterprise scale.
• 3+ years creating software for retrieving, parsing, and processing structured and unstructured data.
• 3+ years building scalable ETL or ELT workflows for reporting and analytics.
• Experience in a collaborative, cross-functional team environment.
• Ability to develop scripts and programs for converting data into usable formats; support scaling, monitoring, and operation of data platforms.
• Secret clearance (u.s. applicant) required.

• Experience with Python, Databricks, SQL, Scala, or Java.
• Experience with UNIX/Linux, including basic commands and Shell scripting.
• Experience with public clouds (AWS, Azure, or Google Cloud).
• Experience with distributed data or computing tools (Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka).
• Experience with real-time data and streaming applications.
• Experience with No
  
  SQL (Mongo
  
  DB or Cassandra).
• Experience with data warehousing (AWS Redshift, MySQL, or Snowflake).
• Experience with Agile engineering practices.
• TS/SCI clearance with a polygraph.