AI productMaking an AI product more reliable before production
LLM QAAPISalesforceLinear
- Challenge
- Secure AI-product workflows where edge cases, integrations and LLM outputs could degrade the experience before production.
- Approach
- Turn test feedback into actionable tickets and create a common language across product, technical and operations teams.
- Contribution
- I tested workflows in the Sandbox, checked API and Salesforce integrations, evaluated LLM prompts and followed 200+ incidents in Linear through to resolution.
- Outcome
- Continuous visibility on workflow quality and more usable feedback to prioritise fixes before deployments.
!
↗
✦
✓
Key figures
Non-confidential information200+
Incidents tracked
Dev → Prod
Stages
Sandbox & API
Scope
My approach⌄
- Formalised test scenarios covering business workflows and edge cases.
- Checked LLM outputs for consistency and usability.
- Qualified, documented and tracked incidents in Linear.
- Coordinated feedback across Sandbox, API, Salesforce and internal teams.