LLM Trainer – Remote AI Agent Evaluation

About the role

We are looking for a skilled LLM Trainer to help design, evaluate, and improve autonomous AI agents across diverse real‑world domains. The role is fully remote and focuses on providing high‑quality human feedback to advance large language model capabilities.

Key responsibilities

• Write clear evaluation rubrics with objective pass/fail criteria for AI agents.
• Debug agent execution traces to uncover failure patterns.
• Stress‑test agents against edge cases, prompt injection, and tool misuse.
• Assess production‑grade modular software architectures and multi‑turn system interactions.
• Deliver dense technical feedback to support LLM training cycles.

Required profile

• Proven experience in backend engineering, AI automation, or complex systems integration.
• Track record of building and maintaining production‑grade, modular software services.
• Hands‑on experience with live, non‑mocked environments and multi‑turn interactions.

Required skills

• Python
• JavaScript
• Go
• Java
• SQL databases
• Backend engineering
• AI automation
• Modular software architecture
• API integration (e.g., Supabase, Gmail)

What we offer

• Hourly compensation ranging from $30 to $50, based on experience and task complexity.
• Weekly payouts via supported platforms such as PayPal or AirTM.
• Flexible task assignments allowing you to work on projects that match your expertise.