Junior Software Developer – Remote AI Agent Evaluation

About the role

We are looking for a Junior Software Developer to help design, evaluate, and improve autonomous AI agents that operate across multiple large language models. The work focuses on real‑world domains such as health, education, and daily life, and is performed entirely remotely.

Key responsibilities

• Write clear evaluation rubrics with objective pass/fail criteria for AI agents.
• Debug agent execution traces to identify failure patterns.
• Stress‑test agents against edge cases, prompt injection, and tool misuse.
• Assess production‑grade modular software architectures and multi‑turn system interactions.
• Provide high‑density technical feedback to improve LLM training.
• Complete onboarding steps, upload required documents, and undertake flexible task assignments.

Required profile

• Experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production‑grade software with modular separation (e.g., distinct services for data parsing, logic processing, and reporting).
• Strong command of at least two major programming languages.
• Practical experience building for live, non‑mocked environments and handling multi‑turn system interactions.

Required skills

• Python
• JavaScript
• Go
• Java
• SQL databases
• API integration (e.g., Supabase, Gmail)

What we offer

• Hourly compensation ranging from $30 to $50 USD, based on experience and task complexity.
• Weekly payments via supported payout platforms such as PayPal or AirTM.
• Fully remote work with flexible task assignments.
• Opportunity to shape the future of agentic AI systems by providing expert feedback to leading AI organisations.