Software Engineers: Paid Interview on AI Evaluation Tasks

Overview

Participate in a paid remote interview evaluating programming tasks and coding environments used to test AI agents. You will assess technical accuracy, complexity, realism, and alignment with software engineering practices.

What you'll do

• Review the quality of realistic programming tasks.
• Evaluate coding environments and technical evaluation harnesses.
• Assess the technical accuracy and complexity of coding challenges.
• Walk through the logic of evaluation environments.
• Identify flaws in code structures and testing environments.
• Provide feedback on challenge difficulty and realism.

What you'll need

• Professional experience as a software engineer or developer.
• Hands-on experience building, reviewing, or testing programming tasks.
• Familiarity with evaluation harnesses.
• Experience with code review.
• Comfort discussing technical architecture and testing methodologies.

Details

• Remote session.
• Compensation: $75 per hour.
• Location: United States.