In short
Short-term contract (20-40 hrs/week, $22-25/hr) reviewing Java open-source code: triaging GitHub issues, Dockerizing and setting up repos, assessing unit test coverage, and running codebases locally to evaluate LLM bug-fixing performance alongside AI researchers.
About the role
Position: Code Reviewer - Java
Type: Short-term contract
Compensation: $22 - $25 per hour
Location: Remote
Commitment: 20-40 hrs/week
Role Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries.
- Set up and configure code repositories, including Dockerization and environment setup.
- Evaluate unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues challenging for LLMs.
Requirements
- Strong relevant experience with Java.
- Proficiency with Git, Docker, and basic software pipeline setup.
- Ability to understand and navigate complex codebases.
- Comfortable running, modifying, and testing real-world projects locally.
- Experience contributing to or evaluating open-source projects is a plus.
Application Process
- Apply via Easy Apply
- Check email for next steps
Requirements
- Strong relevant experience with Java
- Proficiency with Git, Docker, and basic software pipeline setup
- Ability to understand and navigate complex codebases
- Comfortable running, modifying, and testing real-world projects locally
Nice to have
- Experience contributing to or evaluating open-source projects