Principal Data Processing Engineer

We have an immediate need for a Software Engineer with extensive expertise in dataflow design, data transport mechanisms, and Apache Spark distributed processing. In this high-impact role, you will be responsible for designing, implementing, and optimizing end-to-end data ingress and egress pathways. You will ensure the efficient, scalable, and highly reliable processing of enterprise-scale analytics workloads while maintaining strict data quality and system integrity.

ACTIVE SECURITY CLEARANCE AT THE TS/SCI POLYGRAPH LEVEL IS REQUIRED.

The annual base salary range for this role is $199,000-$235,000 (USD), which does not include discretionary bonus compensation or our comprehensive benefits package. Actual compensation offered to the successful candidate may vary from posted hiring range based upon geographic location, work experience, education, and/or skill level, among other things.

• Distributed Processing: Extensive experience with distributed Big Data processing engines, specifically Apache Spark.
• Software Development: Recent, hands-on software development experience using both Python and Java.
• Workflow Orchestration: Practical experience using Apache Airflow (DAG design, scheduling, operators, and sensors) for workflow management.
• Data Wrangling & Formats: Hands-on experience with data manipulation tools (pandas, Num Py, Jupyter Notebook) and working with formats including Parquet, JSON, CSV, and XML.
• SQL Technologies: Familiarity with relational database technologies (MySQL, MariaDB, PostgreSQL) for querying, joining, and aggregating large datasets.
• Data Quality: Familiarity with data quality principles, automated validation methods, and anomaly detection strategies.
• Linux & Automation: Strong operational experience with the Linux CLI, standard utilities, and writing Bash scripts for process automation.
• Version Control: Proficiency with Git source control workflows.

• HPC Scheduling: Familiarity with High-Performance Computing (HPC) job scheduling tools such as Slurm.
• Agile Tooling: Practical experience using the Atlassian Tool Suite (Jira, Confluence) for collaborative tracking and documentation.

Nyla Technology Solutions delivers exceptional Artificial Intelligence (AI), Data Science, and Software Engineering services for the U.S. Government. Nyla embraces a forward‑thinking and bold approach at every turn, earning us a solid reputation of technical trendsetters within the industry. We have a passion for developing solutions that have a quick and immediate impact on mission. Headquartered in Columbia, Maryland, our customers love how we tackle their most challenging problems and get things done.

If you have the unique experience and expertise we are seeking, along with the desire and determination to invest your time and energy as a part of Nyla’s team, we would love to hear from you.

• Nyla FLEX benefit program is designed to offer you flexibility in the 3 biggest areas of your life: your pay, your leave, and your schedule.
• PAY
  - Nyla starts with 4 weeks of Annual Leave plus 11 holidays and an additional day of Annual Leave for each year you’re at the company. You have the flexibility to cash out your annual leave hours, opt out of other Nyla benefits, and/or…