Senior Software Engineer, LLM Evaluation

Help build datasets for training and benchmarking language models: curate code examples, write and correct solutions, evaluate AI-generated code for efficiency and reliability, and design automatic ways to verify solutions to software engineering tasks. Contractor, remote, 10 to 40 hours a week with partial Pacific Time overlap, for about a month with possible extension.

Who it suits

• Several years of software engineering, including 2+ years of continuous full-time work at a top-tier product company
• Strong full-stack and production experience
• Deep understanding of architecture, debugging and code review
• Clear written evaluation rationales

Skills

Python JavaScript React Java Rust Go Code review