Skip to content

Review Pioneer AI usage and conversations

Every model call Pioneer AI makes is recorded in your Outpost, whichever source answered it. This page shows how to see that usage, so you can find where AI spend goes, and how a reviewer reads a technician’s conversations.

  • Usage needs ai:manage. Conversations needs ai:review. The owner holds both by default. Without the permission, the tab is shown but cannot be opened, and says which permission it needs.
  • Usage counts every source. What Outpost bills for Outpost Cloud AI appears on your invoice. See Invoices, taxes, and payments.
  1. Go to Settings > AI > Usage.
  2. In From and To, choose the dates. The default is the first of this month (UTC) to today.
  3. In Group by, choose Person, Feature, Source, Model, or Conversation.

Each row shows Calls, Input tokens, Output tokens, Cached tokens, Thinking tokens, and Cost, with a Total row. Select a column heading to sort by it.

Grouped by Feature, the rows name what each call was for:

FeatureWhat made the calls
ChatPioneer AI answering in conversations
AI safety reviewAutomatic approval reviewing proposed actions
Summarizing long conversationsPioneer AI summarizing earlier messages to stay within the model’s context
Conversation titlesTitling a conversation after its first reply
Ticket summariesWriting the note for Save to ticket
Remote controlPioneer AI reading screenshots and choosing actions while it controls a remote session
Shell command checksJudging the impact of a shell command that the fixed rules do not cover. See Shell commands.
Workflow AI stepsThe Ask AI step in workflows
VerifyVerify on Settings > AI

Sub-agent work and web searches appear as their own rows. Grouped by Person, each workflow’s AI steps appear as Workflow: followed by the workflow’s name.

Cost is an estimate. For Outpost Cloud AI it is calculated at your rates for each call, and your invoice is the bill. For your own endpoint it is calculated from the prices entered on Settings > AI, and is zero when no prices are entered. Outpost never bills your own endpoint.

A technician sees the tokens and cost of their own conversation on the meter under it. See Use Pioneer AI.

  1. Go to Settings > AI > Conversations. The list shows every technician’s conversations, newest activity first, with the Technician, Last activity, Tokens, and Cost.
  2. Select a conversation.

It opens read-only, with the banner You are reviewing followed by the technician’s name and It is read-only, and this view is recorded in the audit log. You cannot send messages, answer its approval cards, or change it. Each conversation you open is recorded in the audit log.

Under the conversation, Trace lists every model call, tool call, and web search in it, in order. Select Show trace to load it. Each step shows its Time, Step, What, Tier, Decision (how an action was approved or refused), Outcome, Duration, Tokens, and Cost. Showing another technician’s trace is recorded in the audit log.

Conversations past their retention period are deleted and no longer listed. See Pioneer AI data and privacy.

Usage for the current month shows a Chat row once anyone has used Pioneer AI, and Conversations lists that conversation.

Content is licensed CC BY 4.0. Code samples are MIT. Outpost and the Outpost mark are trademarks of Outpost Business Solutions, PBC and are not covered by either license.