Model Behavior Monitor

About the role

Tech Pipeline is looking for a Model Behavior Monitor to act as the human validation layer for its internal AI models. You will ensure that AI‑driven workflows remain reliable, catching drift or illogical outputs before they impact critical business operations.

Key responsibilities

• Review daily model output logs to detect inaccuracies, drift, or logical failures.
• Configure alerts in monitoring tools to flag responses that breach safety parameters.
• Document failure points and update SOPs with new guardrails or instruction sets.
• Design manual fallback routes to keep processes running when models fail.
• Collaborate with operations to reroute data through platforms such as Zapier or Make when model triggers break.
• Write and test concise prompts that limit variance of internal AI assistants.
• Audit data entry points to ensure correct piping of model outputs into ERP or CRM systems.

Required profile

• Logical problem‑solving mindset with strong attention to detail.
• Ability to explain technical failures in clear, non‑technical language.
• Preference for building sustainable, long‑term solutions.
• Self‑discipline to manage workload in a fully remote environment.

Required skills

• Experience with Zapier or Make (Integromat) for workflow automation.
• Familiarity with ERP and CRM systems integration.
• Prompt engineering for AI assistants.
• Use of monitoring and alerting tools for AI model performance.

What we offer

• Fully remote work schedule with performance‑based metrics.
• Structured onboarding on proprietary AI workflow frameworks.
• Opportunity to directly reduce operational drag across the organization.
• Exposure to internal infrastructure projects during critical growth phases.