Announcements, hands-on expertise and honest comparisons from the team building EvaliQA. One problem per post, from the work we do with clients.
2 posts tagged Online evaluation. Clear filters
A coding agent that edits a test to make it pass still produces an ordinary pull request. This post shows how to trace every Claude Code or Codex session into EvaliQA, score it as it arrives with detectors, metrics and the AI Analyst, and promote the bad sessions into your test dataset.
Read the postA production AI failure you fixed but never wrote an AI test for comes back with the next prompt change or AI update. This is how to turn the trace behind it into a golden-set row, with an expected output and a metric that catch the failureof AI, that CI checks on every pull request.
Read the post
