Data Engineer

Careers

Edgesource is seeking highly motivated individuals to contribute to our teams in a variety of roles. If you are dedicated to client success, have a desire to support leading programs, and value a culture of contribution, we want to talk to you!

Edgesource is an Equal Opportunity employer committed to offering competitive salaries and benefits packages for all employees.

Edgesource is committed to offering its employees a comprehensive benefits package that promote a healthy work-life balance, provide security and assurance that your individual health needs are met, and support your life goals as part of the Edgesource family! Below, you will find examples of some of the benefits we offer:

Edgesource trusts our employees to meet their job requirements and manage their time effectively.

A combination of remote and onsite work environments balance the needs of our employees and customers.

Edgesource is dedicated to contributing to your retirement future.

Edgesource is a family friendly company recognizing the importance of welcoming your new addition.

Providing an array of choices to meet your individual healthcare related needs are provided by the company.

Offering employees the opportunity to further their education and/or job related training.

McLean, VA

Full time

On-site

Engineering Data Engineering

• $130K – $145K

For over 25 years, Edgesource Corporation has served as an innovative technology service provider for the Department of Defense (DOD), Department of Homeland Security (DHS), Department of State (DOS), the U.S. Intelligence Community, Law Enforcement, and other federal, state, and commercial clients locally, nationally, and abroad. From providing boutique technical solutions in support of the DOD Counter Unmanned Aerial Systems (CUAS) mission set to addressing the most critical Cybersecurity threats facing our nation as a prime contractor with the DHS Cybersecurity & Infrastructure Security Agency (CISA), a career at Edgesource is an opportunity to do meaningful, interesting, and impactful work.

We are seeking a Data Engineer to work with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale.

• Building end-to-end data pipelines leveraging Python
• Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
• Containerizing and deploying applications in cloud environments like AWS.
• Working with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads.
• Leveraging industry standard tools for code control (Git, IaaC control, etc.)
• Working with data catalogs, tracking data lineage and handling a variety of data formats, including Geospatial.
• Using Bash scripting for automation and data processing tasks
• Integrating Al/ML services and models
• Work with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
• Leverage strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
• Leverage a background in large-scale data migration or platform modernization efforts
• Contribute to data engineering documentation, best practices, and design patterns.

• Active TS/SCI Full Scope Polygraph
• Minimum of 5 years' experience
• Demonstrated experience building production data pipelines and ETL/EL workflows at scale
• Proficiency with Apache Spark and PySpark for distributed data processing
• Advanced Python programming skills including data manipulation libraries (Pandas, Num Py) and data engineering best practices
• Understanding of data security, privacy, governance, and compliance…