Remote Web Developer – AI Agent Evaluation

About the role

We are looking for a remote Web Developer to help design, evaluate, and improve autonomous AI agents across multiple large language models. You will provide expert feedback to AI organisations and contribute to training LLMs for complex, multi‑step workflows.

Key responsibilities

• Write clear evaluation rubrics with objective pass/fail criteria for AI agents.
• Debug agent traces to identify failure patterns and stress‑test agents against edge cases, prompt injection and tool misuse.
• Assess production‑grade modular software architectures and analyse multi‑turn system interactions.
• Provide high‑density technical feedback to improve LLM training.
• Complete onboarding assessments and undertake flexible, task‑based assignments.

Required profile

• Experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production‑grade software with modular separation (e.g., distinct services for data parsing, logic processing, reporting).
• Strong command of at least two major programming languages and experience with SQL databases.
• Hands‑on experience building for live, non‑mocked environments and handling multi‑turn system interactions.

Required skills

• Python
• JavaScript
• Go
• Java
• SQL
• Backend engineering
• AI automation
• Modular software architecture
• Live environment development
• Multi‑turn interaction handling

What we offer

• Hourly compensation ranging from $30 to $50, based on experience and task complexity.
• Weekly payments via supported payout platforms.
• Flexible, remote work across Finland, France, Italy, and Norway.