Remote | Senior Software Engineer – LLM Evaluation & Repository Validation

New York, NY · 5 days ago

About the job

We are sharing a specialised part-time consulting opportunity for experienced Senior Software Engineers with tech-lead-level expertise to contribute to advanced LLM evaluation, repository validation, and realistic software-engineering benchmark development. Selected professionals will work with high-quality public repositories to develop and validate verifiable software-engineering tasks, configure reproducible development environments, analyse open-source issues, assess test quality, and evaluate how advanced language models perform on realistic bug-fixing and code-modification scenarios. Key Responsibilities Repository Analysis & Issue Triage Analyse issues across well-maintained public...