South Asian Software Engineers: Coding Tasks for AI Evaluation
About this job
Terac is hiring South Asian Software Engineers for a contract role focused on coding tasks for AI evaluation. Terac builds a large pool of vetted human experts, helping researchers, AI labs, and product teams screen and pay study participants. In this position, you will participate in a paid study to test the effectiveness of coding evaluation harnesses used for AI agents. Your daily work involves walking through proposed programming challenges and environments in an AI-moderated session. You will review the structure, difficulty, and realism of these challenges, give technical feedback on evaluation harnesses, and propose improvements to make test suites more robust. This project ensures that AI coding assistants are tested against realistic software engineering scenarios, leveraging your professional background in building and reviewing complex codebases.
Responsibilities
- Review proposed coding tasks and programming environments for realism
- Provide technical feedback on the structure and difficulty of evaluation harnesses
- Walk through your approach to verifying complex code challenges
- Suggest improvements to make the test suites more robust
- Participate in an AI-moderated session to evaluate AI coding tools
Requirements
- Professional software engineer based in South Asia
- Experience building or reviewing realistic programming tasks
- Familiarity with coding evaluation harnesses or test automation
- Comfortable discussing technical workflows in an interview setting
Who should apply
This role suits experienced backend developers, test automation engineers, and full-stack engineers located in South Asia. If you have a strong background in building, reviewing, and verifying complex codebases, and feel comfortable discussing technical workflows during an AI-moderated session, you should apply. Please note that this opportunity requires professional software engineering experience, so freshers should check the requirements carefully before applying.
Frequently asked questions
What is the role of South Asian Software Engineers: Coding Tasks for AI Evaluation at terac?
The role involves reviewing proposed coding tasks and evaluation harnesses to help terac test the effectiveness of AI agents.
Where is the South Asian Software Engineers: Coding Tasks for AI Evaluation position located?
The posting specifies the location as India, with candidates required to be based in South Asia.
What type of employment is the South Asian Software Engineers: Coding Tasks for AI Evaluation job?
It is a contract position involving a paid study and AI-moderated sessions.
Who should apply for the South Asian Software Engineers: Coding Tasks for AI Evaluation opening at terac?
Experienced software engineers in South Asia with a background in reviewing complex codebases, test automation, or evaluation harnesses should apply.
Rojgar Point lists this job for information. Always apply on the official company page and never pay anyone for a job.