Remote Web Developer – AI Agent Evaluation

About the role

We are looking for a remote Web Developer to help design, evaluate and improve autonomous AI agents built on large language models. The work involves coding, testing and providing detailed feedback to advance agentic AI systems across health, education, daily‑life and other real‑world domains.

Key responsibilities

• Write clear evaluation rubrics and conduct pass/fail testing of AI agents.
• Debug agent execution traces to pinpoint failure patterns.
• Stress‑test agents against edge cases, prompt‑injection and tool‑misuse scenarios.
• Assess production‑grade modular software architecture and multi‑turn system interactions.
• Deliver high‑density technical feedback to support LLM training.
• Complete onboarding assessments and manage flexible task assignments.

Required profile

• Experience in backend engineering, AI automation or complex systems integration.
• Proven ability to build and maintain production‑grade software with modular separation of services.
• Strong command of at least two major programming languages and experience with SQL databases.
• Hands‑on experience building for live, non‑mocked environments and handling multi‑turn interactions.

Required skills

• Python
• JavaScript
• Go
• Java
• SQL
• API integration (e.g., Supabase, Gmail)

What we offer

• Hourly rate of $30–$50 based on experience and task complexity.
• Weekly payments via supported payout platforms.
• Fully remote work across Finland, France, Italy and Norway.