Junior Software Engineer – Remote AI Agent Evaluation

About the role

We are looking for a Junior Software Engineer to help design, evaluate, and improve autonomous AI agents that operate across multiple large language models. The work is fully remote and focuses on real‑world domains such as health, education, and daily life, with all coding tasks performed by the candidate.

Key responsibilities

• Write clear evaluation rubrics with objective pass/fail criteria for AI agents.
• Debug agent execution traces to uncover failure patterns.
• Stress‑test agents against edge cases, prompt injection, and tool misuse.
• Assess production‑grade modular software architectures and multi‑turn system interactions.
• Provide high‑density technical feedback to support LLM training.

Required profile

• Experience in backend engineering, AI automation, or complex systems integration.
• Proven ability to build and maintain production‑grade software with modular separation.
• Strong command of at least two major programming languages.
• Hands‑on experience with SQL databases and live, non‑mocked environments.

Required skills

• Python
• JavaScript
• Go
• Java
• SQL
• Modular software architecture
• API integration (e.g., Supabase, Gmail)
• Session‑tracking and persistent state patterns

What we offer

• Hourly compensation ranging from $30 to $50, based on experience and task complexity.
• Weekly payments via PayPal or AirTM.
• Flexible task assignments allowing you to work on diverse AI projects.