Senior Software Engineer – Source & SWE-Bench Evaluation; Fully Remote

• Review coding tasks derived from real Git Hub issues and pull requests to assess technical soundness and reproducibility.
• Evaluate unit tests for correctness, coverage, and robustness, identifying flaky tests, missing dependencies, version conflicts, and environment issues.
• Determine whether tasks can be reliably reproduced across environments and provide clear recommendations on acceptance.

Requirements:

• 3+ years of professional software engineering experience, with strong experience in multi-file codebases.
• Strong understanding of unit testing, test coverage, and dependency management.
• Experience with Git and Git Hub workflows, and ability to analyze complex technical problems.

Nice to Have:

• Contributions to open-source projects or experience with SWE-Bench benchmarks.
• Experience with Python projects like Django, Flask, scikit-learn, or Sym Py.
• Knowledge of Docker, CI/CD, pip, conda, or dependency pinning.

Engagement:

• Work Type:
  Remote, part-time project-based consulting.
• Focus on software engineering, open-source code review, testing, and technical evaluation.

Anyone AI is a company that focuses on AI-related projects, particularly in evaluating software engineering tasks. They are a smaller organization with a culture that values technical expertise and attention to detail.