We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US$1,000 per task, and you can do as many tasks as you want.

You turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models.

Remote, any location. US$1,000 per task that passes review. Minimum of one task a week, about 10 hours a week.

How it works

Apply. Complete a short screener interview and upload your resume.
Propose. Once you're selected, pick a change from a repository you know and submit a short proposal. We approve it or suggest a better candidate.
Build. In our platform, set up the repository as it was before the change, then write the brief, the correct solution and the grading checks.
Stress-test. Try lazy, incorrect and shortcut solutions and make sure your checks catch them.
Model testing. Run your task against leading AI models until strong models often fail but a skilled engineer can clearly solve it.
Review. A reviewer checks your task and you revise it. Most tasks take more than one round.
Next task. Once your task is accepted, start another.

Requirements

2+ years of professional software engineering
Code merged into a public open-source repository, ideally one you know well. A private codebase you own may also qualify (not employer or client code)
Strong in at least one of Python, TypeScript, Go, Rust, Java or C++
Solid with Docker, Linux, Git and automated testing
Regular use of an AI coding tool
Experience writing tests, rubrics or evaluation criteria, ideally for AI models
You can explain a change clearly and concisely, in your own words
At least 10 hours a week, starting now
A secure personal or work computer (no public or shared machines)

Nice to have

Deep expertise in one area, such as databases, compilers, distributed systems, security or infrastructure
Experience building agent tasks or RL environments

Terms

US$1,000 for each task that passes our quality review, paid directly to you
Once your proposal is qualified, you sign Askable's contract and accept its terms
The work is used for AI training. The change and your solution must be your own, and you must be free to license them to us
Don't publish the work anywhere: no public pull request or public fork

Apply at https://www.askable.com/experts/roles/senior-software-engineer

All verified jobs in India

Browse by city

Results for "a/b testing"

Manager II, Engineering - Kubernetes Platform

Machine Learning Engineer, Assistance Engineering

Risk Analyst

Software Engineer, AI Coding Tasks

Software Engineer AI Coding Tasks

SAP RE FX Consultant

APAC Python

Customer Success Associate

Manager, Engineering - Identity Threat Protection

Senior Analyst, Advanced Analytics - Gurugram

Principal Product Manager Strategic Initiatives

Principal Software Engineer

Graphic Designer & Video Editor

Senior Software Engineer, Payments

Technical Customer Support

Senior Sales Executive Central Region

Product Design Director

Research Staff, Voice AI Foundations [Remote]

Research Staff, Voice AI Foundations [UK - Remote]

Research Staff, Voice AI Foundations - Remote

Manager Clinical Data Management

Academic Dean for MiaPrep Online Academy of Ohio

Software Development Work From Home Part Time Internship

Software Engineer - QA

Full Stack Development Internship

UI/UX Developer - React Fresher

Associate Consultant - Testing

AI Agent Development Internship

Engineer I Firmware Engineering IX

Java Development Intern

Intern - System Test

Robotics Trainer Internship

Python Development Intern

UI/UX Designer (Work From Home, Fresher)

QA Engineer - PD

Software Testing Internship

Cyber Security Work From Home Internship

Digital Solutions Manager (Recruiting Tech & Learning Platforms)

Compliance Lead

Project Manager

Quality Assurance & Standards Manager

Security Software Engineer II, Detection and Response

Senior Software Engineer, Native Mobile

Back End Developer Internship

Systems Platform QA and AI Engineer

Full Stack Developer Internship

Data Scientist Intern

Software Developer Internship (Remote)

Associate, Quality Services, Auto Software (Smart Vehicles), Amazon Smart Vehicles

IT Security Engineer

React Native Engineer

Bluetooth developer

UI/UX Designer (Fresher)

ETL Tester (SQL & Cloud)

Flutter Developer

Web Development Work From Home Internship

Software Test Engineer (Fresher)

Cyber Tester Executive

Product Designer - UX/UI Focus Internship

Software Development – Full Stack & Mobile Internship in Bangalore