MD-Test Engineer 3- TS​/SCI w​/ Polygraph

Location:

Annapolis Junction, MD

Category:
Test Engineer 3

Travel Required:

No

Remote Type:
No

Clearance: TS/SCI w/ Polygraph

We are seeking a Senior Test Automation Engineer to design, build, and maintain automated test solutions across both back-end services (REST APIs) and web user interfaces. This role requires strong hands-on engineering skills in Linux command-line tooling, Python-based automation, containerized test execution (Docker/Podman), and CI/CD integration using Jenkins and Git Lab pipelines. The successful candidate will also help evolve our existing in-house automation framework, including planning and executing migration efforts from legacy Robot Framework implementations to newer platforms.

Analyzes system requirements and concept of operations documents, acquisition plans, and system descriptions to develop evaluation and test plans and procedures, prepare for and conduct the data collection and analysis, and report status and results. Supports the development of Government test and evaluation documentation e.g., Test & Evaluation (T&E) Strategy, Test & Evaluation Master Plan, Event Test Plans, Test Readiness Assessments, and T&E Reports.

Works with other test organizations to support T&E program integration. Provides specialized T&E capabilities tailored to system functions, level, maturity, and performance area as assigned in the SOW

• Develop, maintain, and enhance automated test suites for back-end REST APIs and web-based user interfaces.
• Build and maintain a scalable, reliable test automation harness (framework) including execution, reporting, data setup/teardown, and CI/CD integration.
• Implement and expand Python-based test automation using Pytest, including fixtures, test data strategies, and robust assertions/validation.
• Create and maintain Docker/Podman container images used to run automation consistently across developer environments and CI pipelines.
• Integrate automated test execution into Jenkins and Git Lab CI/CD pipelines, ensuring repeatable runs, clear reporting, and actionable results.
• Use Linx command-line tools and Bash shell scripting to locate, parse, transform, and report on large volumes of logs, test output, and system data.
• Support and extend UI automation using Robot Framework and the Python Selenium library, including test stability improvements and best practices.
• Collaborate with stakeholders to plan, estimate, and break down work for migrating the current in-house test harness from legacy Robot Framework to a modern alternative (e.g., Robot Framework AIO or Microsoft Playwright).
• Write and maintain SQL queries (using SQL Developer or similar tooling) and integrate database validation steps into automated tests were appropriate.
• Troubleshoot CI failures and test irregularity/volatility, improve test reliability, and contribute to continuous improvement of the overall QA automation approach.
• Assist with any or all of the Level I tasks as constrained by technical training and previous testing experience
• Conduct research into and apply knowledge of Government test and evaluation concepts all related engineering acquisition and operations activities as needed to suppo1t the T&E activities
• Plan and Execute Performance Analysis
• Review planned acquisition approaches to support T&B schedule alignment with decision maker needs for T&E support
• Analyze performance risk areas to focus T&B planning
• Specify, validate, and adapt Modeling and Simulation for T&E use
• Apply Statistical Analysis of variations in performance behavior to characterize confidence in
• performance estimates
• Select, develop, & use analysis tools
• Execute the evaluation plan of data collected by the Testing Task
• Plan and Execute Performance Data Collection
• Plan program and event level testing for collection of data required for analysis and to synch T&E events with supported decision points
• Establish and employ Data & Configuration Management capabilities
• Support Data Authentication group functions; and comply with program Discrepancy Reporting criteria and processes
• Assess operational and system performance requirements for testability and criticality to frame and prioritize T&E objectives and enable evaluation planning
• Coordinate with program Systems Engineering (SE) and review T&E-related SE information to leverage functional analysis, system descriptions parameter selection and dependencies, Modeling and Simulation, and initial performance risk assessments to inform evaluation planning
• Assess operational environments and priorities for evaluation attention and scenario selection, and to coordinate user participation in T&E
• Plan program and event level risk-tailored performance estimation and analysis of system and operational Effectiveness and Suitability metrics & conditions levels of T&E include inspection, demonstration paper analysis, survey simulation, and physical test
• Design surveys for evaluation of Subject Matter Expert (SE input and user as estimates of performance)
• Participate in…