The evaluation harness runs scripted provider responses through the workspace assistant coordinator with synthetic Contacts, Invoices, feature counts, and Documents. It checks saved evidence, follow-up turns, task dependencies, permission denials, partial provider failures, and write retries without changing assistant defaults or reading Magpie data. Live-model mode remains an explicitly authorized evaluation command; the existing first-call benchmark remains a separate metric.
Evaluate complete workspace assistant workflows
Added an offline complete-workflow corpus and runner for workspace assistant evaluation.