Review your AI spend and consumption

Learn how to monitor AI app consumption and spend, set budgets and alerts, and receive alerts for usage spikes with AI Spend and Consumption Management in 1Password SaaS Manager.

AI Spend and Consumption Management in 1Password SaaS Manager gives you a centralized report of the cost and utilization of AI apps within your organization.

With AI Spend and Consumption Management, you can:

  • Monitor token consumption and spend across AI apps in a single dashboard.
  • Filter the reported usage by time period, AI app, team, and more.
  • Set budgets for apps, teams, cost centers, and API keys, and track burn rate against your contractual commitments.
  • Configure alerts to receive notifications before a budget or prepaid balance runs out.
  • Specify thresholds for alerts when AI usage spikes unexpectedly.
  • Review data for specific AI apps to see usage by team, cost center, model, product, project, account, and API key.
  • Export AI usage to share with people who don’t use SaaS Manager.
  • Let people see their own AI consumption from the App catalog.
  • Manage API key names and assignments to teams and cost centers.

Connect your team’s AI apps

To see data about your team’s AI usage in SaaS Manager, make sure your teams in SaaS Manager are set up to match your organization’s structure by importing teams from your IdP or HR system or by setting them up manually. You should do this before you connect your team’s AI apps to make sure that AI usage data is assigned to the appropriate teams and cost centers.

After you make sure your teams are properly set up, follow the steps to turn on AI Consumption for at least one of the supported AI apps:

You can also start connecting a supported AI app from the AI Spend and Consumption dashboard. Select AI Spend and Consumption in the sidebar, select Integrations, then select Connect next to the app you want to set up.

Note

If you’ve previously set up the integration for one of these AI apps, you may need to reconnect it with an API key with different permissions to start ingesting AI usage data.

After you connect an AI system, data will start to sync automatically and may take up to 24 hours to initially populate. Historical data may take a few days to fully collect.

Ongoing usage data will continue to sync on a daily basis. You can see the last time usage data synced on the Overview tab for the AI app integration.

Set a credit rate for credit-based apps

Some AI apps, like OpenAI ChatGPT Enterprise and GitHub Copilot, report usage in credits rather than currency. To see spend for these apps, set what one credit costs:

  1. Select AI Spend and Consumption in the sidebar.
  2. In the table below the chart, find the app and select Set a rate in the Est. spend column.
  3. Enter the cost of one credit, then save.

The first rate you set applies to all of the app’s historical usage, as well as to new usage. If the price of a credit changes later, add a new rate with the date it takes effect, and earlier usage keeps the previous rate. To set or change rates, you need permission to manage AI Consumption.

Where an AI app reports them, SaaS Manager shows two credit figures:

  • Credits: All credits consumed, including credits that were included with your AI app subscription or discounted.
  • Billed credits: The credits you’re billed for after allowances and discounts.

When you set a credit rate, estimated spend is calculated from billed credits, so usage that’s fully covered by your subscription has no spend. If you haven’t set a credit rate, SaaS Manager uses the spend reported by the AI app, if it provides one.

Analyze your team’s AI consumption

To analyze your team’s AI consumption, select AI Spend and Consumption in the sidebar. The AI Spend and Consumption dashboard provides a chart that plots your organization’s AI usage and spend across all of your configured AI apps.

You can view your team’s consumption over time as an incremental or cumulative chart, grouped by AI app, team, person, cost center, model, project, or API key. To change how usage is grouped over time, use the menu next to the incremental and cumulative options above the chart to choose Daily, Weekly, or Monthly. If you don’t choose one, SaaS Manager picks one based on the length of the time period you’re viewing.

You can also select Filters to limit the data shown in the chart, or select the name of an entry in the table below the chart to quickly apply a filter.

If you group consumption by AI app or team, you can expand the entries in the table below the chart to see additional data, like specific products for an AI app or team hierarchy.

To view more information about a specific AI app or person, select View details on an app entry or View person on person entry in the table. If you view the details for an AI app, you’ll see the app’s AI Consumption tab. Depending on the data the AI app provides, you’ll see additional options to group usage data, such as by team, cost center, model, product, project, account, or API key.

Tip

The page address keeps your current grouping, filters, and time period. You can bookmark the page to come back to the same view, or copy the address to share it with another SaaS Manager user.

Customize the table

By default, the table below the chart shows the Est. spend, Share of spend, Change, Credits, Tokens, and Requests columns:

  • Est. spend: The estimated spend for each entry. Estimated spend may differ from what the AI app provider bills you, because of delays in the data the provider supplies.
  • Share of spend: Each entry’s part of total spend, with your current filters applied.
  • Change: The change in spend since the previous period of the same length. To see the change as an amount, hover over or focus the value. Entries with spend in the current period but none in the previous one show New.
  • Tokens: The total tokens used for each entry. To see the number of input, output, cache read, and cache write tokens, hover over or focus the value.

To show, hide, or reorder columns, select the vertical ellipsis above the table, then select Choose columns. You can also add these columns:

  • Compared to average: Each entry’s spend compared with the average entry at the same level, with your filters applied. For example, 2× means twice the average.
  • Cost per request: Estimated spend divided by the number of requests.
  • Cost per 1M tokens: Estimated spend for every million tokens, counting input, output, cache read, and cache write tokens.
  • Billed credits, and a column for each token type.

The column that names each entry and the Est. spend column are always shown. SaaS Manager remembers the columns you choose the next time you open the page.

Export usage data

You can share usage with people who don’t use SaaS Manager:

  1. Select the vertical ellipsis above the chart, then select Export.
  2. Choose a time period, or select Custom range to choose your own dates.
  3. Choose whether to use any filters applied on the page, then select Export.

The export is a CSV file with a row for each day of usage, including the app, team, cost center, person or API key, model, spend, credits, and tokens. Exports can include up to 100,000 rows. If your export is larger than that, choose a shorter time period or apply filters. Exports only include data you have permission to view.

Manage API keys

If you connect an AI app that returns usage data for API keys, you can choose to assign keys to a team, a cost center, or both, rename them, or delete them from your reports. Any changes made to API keys are recorded in the audit log.

To manage your API keys, select View details for the AI app on the AI Spend and Consumption dashboard. In that app’s AI Consumption tab, group the chart by API key. You’ll then see the options to assign, rename, or delete keys in the entries below the chart.

If you change the team or cost center a key is assigned to, your usage data will be recalculated, so you may need to refresh your browser after a few moments to see the updates reflected. If you delete a key in SaaS Manager but not in the AI app itself, it will reappear the next time SaaS Manager syncs your usage data.

Configure budgets and alert thresholds

You can set budgets to track actual spend against a target or contractual commitment. A budget can cover one or more AI apps, and you can narrow it further to specific teams, cost centers, or API keys. If you add more than one filter, the budget only includes usage that matches all of them. For example, a budget for Cursor and the Engineering team only tracks Engineering’s Cursor spend.

To create a budget:

  1. Select AI Spend and Consumption in the sidebar, select the Budgets tab, then select New budget.
  2. Under Scope, choose the apps the budget applies to. To narrow the budget to specific teams, cost centers, or API keys, select Add filter.
  3. Choose the budget period. Budgets can start on a future date or up to a year in the past. To create a budget longer than one year, choose an end date more than a year after the start date.
  4. Enter the budget amount. For credit-based apps, you can set the budget in credits instead of spend.
  5. Optionally, add owners and notes, then select Create budget.

You can create more than one budget for the same app, even if their dates overlap. For example, you can track a quarterly budget and an annual budget for the same app side by side. Each budget has its own alerts and projections. An app’s AI Consumption tab only shows budgets that are scoped to that app alone.

After you create a budget, you can’t change its scope, period, or unit. To change these, delete the budget and create a new one.

After you set a budget, SaaS Manager calculates the projected total spend for the duration of the budget, based on the burn rate from the start of the budget period to the current date. You can view past budgets, but the daily spend chart isn’t available for budgets that started more than a year ago.

Add budget owners

Budget owners are people responsible for a budget. Owners can see the budgets they own on the Budgets tab and review each budget’s spend and usage, even if they don’t otherwise have access to AI spend data. Owning a budget doesn’t give access to other budgets or other spend data, or the ability to change the budget.

To add or remove owners, edit the budget and update Owners. You’ll need permission to edit the budget.

Set alert thresholds and recipients

By default, the warning and critical alert thresholds are set to 75% and 90% respectively. To change budget alert thresholds, navigate to Settings > Spend > AI Consumption > Budget thresholds.

To determine who receives budget alerts and data gap notifications, or to turn off these notifications, navigate to Settings > Notifications > AI Consumption budget alerts. You can choose budget owners as recipients.

Note

Budget alert thresholds are global values, so if you update these values, alerts for all budgets will also update.

Run a workflow when a budget threshold is crossed

To respond automatically when spend approaches or exceeds a budget, build a workflow with the AI Consumption budget threshold crossed trigger. Choose an app, and optionally a specific budget for that app. If you don’t choose a budget, the workflow runs for any active budget for the app, including budgets you create later.

The workflow runs once each time a budget crosses the warning threshold, the critical threshold, and 100% of the budget.

Detect spikes in AI usage

Along with budget alerts, SaaS Manager can monitor for and alert you about usage spikes across your team’s AI apps.

To configure your threshold settings for usage spikes, select the Alerts tab from the AI Spend and Consumption dashboard, then select Alert thresholds. You’ll be able to configure the following options:

  • Spike threshold: The percentage above an AI app’s median daily spend that must be reached.
  • Minimum daily spend: The minimum amount in your currency that an AI app’s spend must reach before triggering a spike.
  • Baseline window: The number of days needed to establish normal usage to measure spikes against. SaaS Manager won’t send spike alerts until an AI app has at least 14 days of recorded usage.
  • Cooldown: The number of days to wait before triggering another spike alert for an AI app.

If you receive a spike alert, select the Alerts tab from the AI Spend and Consumption dashboard. In the “Spike alerts” table, select the spike you want to review. You’ll be shown a chart of usage in the AI app leading up to the spike, as well as a “What drove it” table that breaks down the increased usage that contributed to it. If spend data isn’t available for an entry, like an API key, the table shows token usage instead. As you review the spike, you can also update its status to reflect the progress in your investigation.

To determine who receives spike alerts, navigate to Settings > Notifications > AI Consumption spike alerts.

Note

Spikes are recorded in Alerts even if no one is set to receive a notification for them.

Manage access to AI spend data

To give people access to AI spend and consumption without access to your other spend data, create a custom user role and grant it access to AI Consumption only.

If needed, you can restrict the ability to view or export AI usage reports based on individual users to comply with legislation in your region. To do so, navigate to Settings > Spend > AI Consumption > Permissions, then turn on the option to restrict reports.

Let people see their own AI consumption

You can let people see their own AI consumption from the App catalog. This feature is in beta and is off by default.

To turn it on, select Settings > App catalog, then turn on the My AI consumption setting. Anyone who can see the App catalog can then select My AI consumption to review their own usage by AI app or model.

Considerations

Note

AI usage data is calculated using the APIs provided directly by the AI app providers. SaaS Manager relies on AI app providers to supply data accurately and in a timely manner. We recommend using AI Spend and Consumption Management as a part of a larger budget monitoring system.

If a user in SaaS Manager belongs to multiple teams, their AI usage will be reported as part of each team, which may result in the presented spend totals across teams appearing higher than the spend for the app overall.

Team and cost center assignments for users in SaaS Manager are captured as a snapshot when you first set up an integration to record usage for an AI app. If you change a user’s team membership or cost center association, SaaS Manager won’t reflect the changes in any historical usage data. Only usage data moving forward will reflect the assignment changes.

By default, usage from teams you delete stays assigned to them, and is shown as Deleted teams. To move it to the teams people and API keys are in now, navigate to Settings > Spend > AI Consumption > Team settings, then turn on the option to reallocate usage. When you reallocate usage, SaaS Manager no longer keeps a record of which team the usage originally belonged to.

SaaS Manager keeps daily usage data for one year and monthly usage data for five years. When you view a time period that goes back further, reports use monthly or yearly totals instead. Credit rates that apply to usage older than a year are locked and can’t be changed.



Published: