Claude Enterprise 'smart reports' count off-topic chats; Anthropic says don't use them to evaluate individuals
30 views
Anthropic offers Claude Enterprise admins "smart reports" that analyze team conversations. One section counts sessions that were personal or off-topic and their cost, which Mashable on Nov. 4 described as telling bosses when workers go off-topic.
Per Anthropic's help page, Claude reads a sample of transcripts from the team and products an admin chooses, covering up to the last 28 days, groups them into workstreams and output types, and attaches spend. Reports include task outcomes, pain points, inefficiencies, the most expensive sessions and answers to custom questions. The "inefficiencies" section counts sessions that produced nothing usable and sessions that were personal or off-topic, shown "only as an aggregate count and cost, with no summaries or drilldown."
The feature is off by default and limited to Enterprise owners, admins and custom roles with analytics access. Ten reports per organization per month are free. Organizations using CMEK, a HIPAA configuration or a hybrid deployment are excluded. Anthropic says the reports "aren't designed and should not be used for evaluating individual performance or making employment decisions."
Criticism centers on a model deciding what is "off-topic": Anthropic has not published an error rate, and workplace-surveillance concerns were raised by outlets including AbsoluteGeeks. Anthropic says employees' personal chats show up as totals, not content.
