LLM Trainer – Remote AI Agent Evaluation

About the role

We are looking for a skilled LLM Trainer to help design, evaluate, and improve autonomous AI agents across diverse real‑world domains. This fully remote position focuses on providing high‑quality human feedback to leading AI organisations, enabling the development of robust, multi‑step workflows.

Key responsibilities

• Write clear evaluation rubrics with objective pass/fail criteria for AI agents.
• Debug agent execution traces to pinpoint failure patterns.
• Stress‑test agents against edge cases, prompt injection, and tool misuse.
• Assess production‑grade modular software architectures and multi‑turn system interactions.
• Deliver dense technical feedback to guide LLM training.
• Complete onboarding tasks, upload required documentation, and start earning through flexible assignments.

Required profile

• Experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production‑grade software with modular separation.
• Strong command of at least two major programming languages.
• Hands‑on experience with SQL databases and live, non‑mocked environments.
• Ability to handle multi‑turn system interactions.

Required skills

• Python
• JavaScript
• Go
• Java
• SQL
• Backend engineering
• AI automation
• Modular software architecture
• API integration (e.g., Supabase, Gmail)

What we offer

• Hourly compensation ranging from $30 to $50, based on experience and task complexity.
• Weekly payments via supported payout platforms such as PayPal or AirTM.
• Fully remote work across Finland, France, Italy, and Norway.
• Flexible task assignments allowing you to work when you choose.