FrontierCUA

FrontierCUA leaderboard

Rankings

FrontierCUA leaderboard, ranked by pass@1
RankModelProviderReasoningpass@1avg@1Mean cost per rollout
1Gemini 4 CarbonGooglehigh42.5%0.606$54.47
2GPT-6.1 SolOpenAIhigh25.0%0.495$6.00
3Fable 5.2Anthropichigh25.0%0.397$49.48
4GPT-6 AstraOpenAIhigh20.0%0.440$47.94
5MiniMax M3.1 FlashMiniMaxhigh17.5%0.439$1.10
6Opus 5Anthropichigh17.5%0.431$12.30
7Fable 5.1Anthropichigh15.0%0.453$18.92
8Fable 5Anthropichigh15.0%0.440$29.10
9Opus 5.5Anthropichigh12.5%0.442$10.52
10Muse WonderMetahigh12.5%0.419$55.08
11Kimi K3Moonshothigh12.5%0.392$8.23
12Sonnet 5Anthropichigh12.5%0.381$8.76
13MiMo V2.6 FlashXiaomihigh12.5%0.322$1.31
14Muse EmberMetahigh7.5%0.408$1.37
15GPT-6 SolOpenAIhigh7.5%0.307$5.18
16GPT-6.1 TerraOpenAIhigh7.5%0.297$0.92
17Grok 4.7xAIhigh7.5%0.275$71.96
18GPT-5.6 SolOpenAIhigh7.5%0.271$7.43
19MiMo V2.6 ProXiaomihigh5.0%0.276$2.48
20Kimi K3.1 ProMoonshothigh2.5%0.282$4.91
21GLM 5.3 FlashXZ.aihigh2.5%0.257$5.94
22DeepSeek V4.1 FlashDeepSeekhigh2.5%0.243$1.12
23Qwen 3.8 Max PrimeAlibabahigh0.0%0.201$28.15
24Muse Spark 1.3Metahigh0.0%0.110$54.32

Every configuration uses a computer-use adapter.

Results by domain

Each cell is a model’s avg@1 on the workflows in that domain, and how many of them it passed.

ModelCustomer support (9 workflows)Site reliability (7 workflows)CRM & sales (4 workflows)Marketing & retail (4 workflows)HR (4 workflows)Finance (3 workflows)IT access (3 workflows)Comms (2 workflows)Legal (2 workflows)IT service management (1 workflow)Engineering (1 workflow)
Gemini 4 Carbon0.45, 1 of 9 passed0.86, 5 of 7 passed0.68, 2 of 4 passed0.69, 2 of 4 passed0.52, 1 of 4 passed0.68, 2 of 3 passed0.70, 2 of 3 passed0.50, 1 of 2 passed0.21, 0 of 2 passed1.00, 1 of 1 passed0.02, 0 of 1 passed
GPT-6.1 Sol0.52, 2 of 9 passed0.68, 4 of 7 passed0.40, 0 of 4 passed0.63, 2 of 4 passed0.27, 0 of 4 passed0.45, 0 of 3 passed0.73, 2 of 3 passed0.19, 0 of 2 passed0.58, 0 of 2 passed0.11, 0 of 1 passed0.02, 0 of 1 passed
Fable 5.20.32, 1 of 9 passed0.38, 2 of 7 passed0.75, 3 of 4 passed0.40, 1 of 4 passed0.30, 1 of 4 passed0.58, 1 of 3 passed0.28, 0 of 3 passed0.20, 0 of 2 passed0.29, 0 of 2 passed1.00, 1 of 1 passed0.00, 0 of 1 passed
GPT-6 Astra0.30, 1 of 9 passed0.68, 4 of 7 passed0.31, 0 of 4 passed0.47, 1 of 4 passed0.47, 0 of 4 passed0.22, 0 of 3 passed0.84, 2 of 3 passed0.42, 0 of 2 passed0.49, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
MiniMax M3.1 Flash0.48, 1 of 9 passed0.59, 3 of 7 passed0.50, 1 of 4 passed0.47, 1 of 4 passed0.28, 0 of 4 passed0.47, 1 of 3 passed0.39, 0 of 3 passed0.45, 0 of 2 passed0.22, 0 of 2 passed0.14, 0 of 1 passed0.05, 0 of 1 passed
Opus 50.70, 4 of 9 passed0.60, 3 of 7 passed0.35, 0 of 4 passed0.37, 0 of 4 passed0.31, 0 of 4 passed0.24, 0 of 3 passed0.24, 0 of 3 passed0.13, 0 of 2 passed0.40, 0 of 2 passed0.14, 0 of 1 passed0.05, 0 of 1 passed
Fable 5.10.59, 2 of 9 passed0.60, 3 of 7 passed0.54, 1 of 4 passed0.36, 0 of 4 passed0.38, 0 of 4 passed0.45, 0 of 3 passed0.24, 0 of 3 passed0.20, 0 of 2 passed0.40, 0 of 2 passed0.14, 0 of 1 passed0.07, 0 of 1 passed
Fable 50.68, 2 of 9 passed0.68, 4 of 7 passed0.19, 0 of 4 passed0.44, 0 of 4 passed0.32, 0 of 4 passed0.23, 0 of 3 passed0.39, 0 of 3 passed0.10, 0 of 2 passed0.33, 0 of 2 passed0.14, 0 of 1 passed0.05, 0 of 1 passed
Opus 5.50.61, 2 of 9 passed0.51, 2 of 7 passed0.28, 0 of 4 passed0.37, 0 of 4 passed0.37, 0 of 4 passed0.51, 1 of 3 passed0.39, 0 of 3 passed0.48, 0 of 2 passed0.33, 0 of 2 passed0.14, 0 of 1 passed0.12, 0 of 1 passed
Muse Wonder0.48, 0 of 9 passed0.68, 4 of 7 passed0.34, 0 of 4 passed0.30, 0 of 4 passed0.26, 0 of 4 passed0.41, 1 of 3 passed0.41, 0 of 3 passed0.48, 0 of 2 passed0.25, 0 of 2 passed0.14, 0 of 1 passed0.05, 0 of 1 passed
Kimi K30.52, 3 of 9 passed0.66, 2 of 7 passed0.33, 0 of 4 passed0.44, 0 of 4 passed0.30, 0 of 4 passed0.22, 0 of 3 passed0.24, 0 of 3 passed0.20, 0 of 2 passed0.07, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
Sonnet 50.38, 1 of 9 passed0.61, 3 of 7 passed0.26, 0 of 4 passed0.45, 1 of 4 passed0.32, 0 of 4 passed0.46, 0 of 3 passed0.37, 0 of 3 passed0.17, 0 of 2 passed0.18, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
MiMo V2.6 Flash0.46, 2 of 9 passed0.51, 2 of 7 passed0.22, 0 of 4 passed0.42, 1 of 4 passed0.20, 0 of 4 passed0.11, 0 of 3 passed0.32, 0 of 3 passed0.10, 0 of 2 passed0.13, 0 of 2 passed0.11, 0 of 1 passed0.00, 0 of 1 passed
Muse Ember0.54, 2 of 9 passed0.49, 1 of 7 passed0.29, 0 of 4 passed0.37, 0 of 4 passed0.31, 0 of 4 passed0.45, 0 of 3 passed0.26, 0 of 3 passed0.71, 0 of 2 passed0.23, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
GPT-6 Sol0.35, 0 of 9 passed0.60, 3 of 7 passed0.27, 0 of 4 passed0.38, 0 of 4 passed0.26, 0 of 4 passed0.17, 0 of 3 passed0.18, 0 of 3 passed0.10, 0 of 2 passed0.01, 0 of 2 passed0.00, 0 of 1 passed0.02, 0 of 1 passed
GPT-6.1 Terra0.30, 1 of 9 passed0.48, 2 of 7 passed0.26, 0 of 4 passed0.34, 0 of 4 passed0.28, 0 of 4 passed0.27, 0 of 3 passed0.24, 0 of 3 passed0.13, 0 of 2 passed0.17, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
Grok 4.70.30, 1 of 9 passed0.33, 1 of 7 passed0.14, 0 of 4 passed0.47, 1 of 4 passed0.30, 0 of 4 passed0.44, 0 of 3 passed0.19, 0 of 3 passed0.07, 0 of 2 passed0.07, 0 of 2 passed0.14, 0 of 1 passed0.05, 0 of 1 passed
GPT-5.6 Sol0.27, 1 of 9 passed0.50, 2 of 7 passed0.27, 0 of 4 passed0.39, 0 of 4 passed0.17, 0 of 4 passed0.17, 0 of 3 passed0.19, 0 of 3 passed0.09, 0 of 2 passed0.07, 0 of 2 passed0.11, 0 of 1 passed0.00, 0 of 1 passed
MiMo V2.6 Pro0.17, 0 of 9 passed0.40, 1 of 7 passed0.35, 1 of 4 passed0.39, 0 of 4 passed0.34, 0 of 4 passed0.19, 0 of 3 passed0.34, 0 of 3 passed0.12, 0 of 2 passed0.21, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
Kimi K3.1 Pro0.32, 1 of 9 passed0.36, 0 of 7 passed0.30, 0 of 4 passed0.36, 0 of 4 passed0.29, 0 of 4 passed0.22, 0 of 3 passed0.25, 0 of 3 passed0.10, 0 of 2 passed0.13, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
GLM 5.3 FlashX0.28, 0 of 9 passed0.46, 1 of 7 passed0.14, 0 of 4 passed0.30, 0 of 4 passed0.21, 0 of 4 passed0.20, 0 of 3 passed0.26, 0 of 3 passed0.04, 0 of 2 passed0.12, 0 of 2 passed0.11, 0 of 1 passed0.02, 0 of 1 passed
DeepSeek V4.1 Flash0.21, 0 of 9 passed0.40, 1 of 7 passed0.11, 0 of 4 passed0.38, 0 of 4 passed0.28, 0 of 4 passed0.23, 0 of 3 passed0.15, 0 of 3 passed0.20, 0 of 2 passed0.10, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
Qwen 3.8 Max Prime0.13, 0 of 9 passed0.41, 0 of 7 passed0.14, 0 of 4 passed0.36, 0 of 4 passed0.11, 0 of 4 passed0.18, 0 of 3 passed0.19, 0 of 3 passed0.10, 0 of 2 passed0.08, 0 of 2 passed0.11, 0 of 1 passed0.05, 0 of 1 passed
Muse Spark 1.30.09, 0 of 9 passed0.13, 0 of 7 passed0.05, 0 of 4 passed0.15, 0 of 4 passed0.16, 0 of 4 passed0.07, 0 of 3 passed0.17, 0 of 3 passed0.07, 0 of 2 passed0.07, 0 of 2 passed0.11, 0 of 1 passed0.00, 0 of 1 passed

Workflows

  • Meridian SLA, Customer support. Reconcile third-quarter SLA credits from Datadog monitors into the Notion credit record. Apps: Datadog, Notion.
  • Dormant contacts, Customer support. Find contacts who went quiet in March 2026 and list the outreach they still need. Apps: Zendesk, Google Docs, Google Sheets.
  • First contact H1, Customer support. Measure first contact resolution for tickets created January to June 2026 and closed out, including closed tickets that no default view shows: count follow-ups by month in a new sheet tab and tag June’s follow-up tickets. Apps: Zendesk, Google Sheets.
  • First contact Q2, Customer support. Measure first contact resolution for tickets created April to June 2026: count by month the tickets where the customer wrote again after the first reply, record them in a new sheet tab, and tag June’s follow-up tickets. Apps: Zendesk, Google Sheets.
  • Group FCR escalation H1, Customer support. Find the support group to put on a coaching plan: for tickets closed out in the first half of 2026, compare each group’s first contact resolution (FCR) by how often customers wrote again after the first reply, and name the worst group. Apps: Zendesk, Google Sheets.
  • Second response lag Q1, Customer support. Measure how long customers waited for a second response in the first quarter of 2026, and record the counts in a new Google Sheets tab. Apps: Zendesk, Google Sheets.
  • Winback, Customer support. Build a win-back list from Zendesk tickets between 18 Nov 2025 and 1 Feb 2026: customers never refunded in Shopify or Square who qualify under the returns policy, grouped into spend tiers with totals. Apps: Zendesk, Shopify, Square, Google Docs, Google Sheets.
  • Refund queue tagging, Customer support. Queue the double-charged customers on a shared worksheet for the finance refund run by tagging their help desk tickets, skipping anyone already repaid, then email finance the queue. Apps: Zendesk, Gmail, Google Sheets, Square.
  • Service credits, Customer support. Work out each customer’s service credit for an alert delivery incident, record it on the request ticket and the subscription deal, send the right ones to Finance, and log the incident. Apps: Zendesk, HubSpot, Linear, Notion.
  • CF reconcile, Site reliability. Reconcile Cloudflare (CF) security rules added by hand in the dashboard: file a Jira change record for each rule not yet fully reconciled under the emergency-change runbook, and list what each still needs in one tracking issue. Apps: Cloudflare, GitHub, Jira, Postman.
  • Freeze exceptions, Site reliability. Decide the freeze-exception requests left on pull requests merged during the June change freeze against the exception policy, label each approved pull request, and reply to every request with the decision and why. Apps: GitHub, Jira, Postman, Cloudflare.
  • Incident remediate, Site reliability. Find the deploy that broke a failing Postman check, carry out what the incident runbook says for that case, and open a Jira incident naming the severity, the owner and the offending pull request. Apps: Postman, GitHub, Jira, Cloudflare.
  • Merge audit, Site reliability. Audit every pull request merged into three repositories from 15 May through July 2026 and file one issue listing each merge that broke policy, such as merging over an unresolved changes-requested review. Apps: GitHub, Jira, Postman, Cloudflare.
  • Fixes never live, Site reliability. Find fixes that landed in Bitbucket but never reached the Sentry release customers are running. Apps: Sentry, Bitbucket.
  • SLO report, Site reliability. Produce the September 2026 SLO report: fill the September rows on the SLO sheet from the SLO notebook under the error budget policy, and email the summary. Apps: Datadog, Google Sheets, Gmail.
  • Incident severity review, Site reliability. Prepare the fortnightly incident review: grade every incident since the last review, record severities and postmortem flags, work out each service’s budget charge, and post the asks. Apps: Datadog, Linear, Notion, Slack.
  • CRM kickoff, CRM & sales. Find the kickoff that was rebooked before the deal closed, and correct the HubSpot record and the calendar hold. Apps: HubSpot, Google Calendar.
  • Close date realign, CRM & sales. Move each deal on the Q4 forecast review sheet to the close date agreed on the pipeline call, leave any that cannot move, and email the forecasting lead what changed. Apps: HubSpot, Gmail, Google Sheets.
  • Company dedupe, CRM & sales. Clear the CRM’s duplicate-company report before the commission run, merging pairs that are one customer and keeping genuinely separate companies apart. Apps: HubSpot, Xero, Gmail.
  • Inbound lead routing, CRM & sales. Route a webinar’s demo requests: existing shippers go to the owner of the account they ship under, new business goes to regional sales reps, then set the CRM owners and post the split. Apps: HubSpot, Zendesk, Notion, Slack.
  • Retail order review, Marketing & retail. Review one deep Shopify order and finish the follow-ups it still needs, including the Google Business Profile. Apps: Shopify, Google Business Profile.
  • POS channel publish, Marketing & retail. Publish the pop-up launch products on the go-live worksheet to the in-person Point of Sale channel before the pop-up opens, and email the retail manager what went live. Apps: Shopify, Gmail, Google Sheets.
  • Autumn sale reprice, Marketing & retail. Set the products on an autumn sale pricing worksheet to their new sale prices in the store, and email back the prices set and anything left as it was. Apps: Shopify, Google Sheets, Gmail.
  • Subject test readout, Marketing & retail. Read out the autumn email subject tests in Klaviyo the way the playbook and earlier readouts do, record the calls in the readout doc, and share the results. Apps: Klaviyo, Notion, Google Docs, Slack.
  • Reorg reporting lines, HR. Move the people on a reorg worksheet into their new team organizations in Workday under the named team leads, and email back who moved and who was held. Apps: Workday, Gmail, Google Sheets.
  • New starter accounts, HR. Stage sign-in accounts for the January starters on HR’s cleared-to-start list, and email the hiring managers their starters’ sign-in names. Apps: Workday, Okta, Gmail.
  • Pay cycle load, HR. Load an autumn promotion and market pay cycle for four companies from the pay review doc, with prorated joiners, budget limits and payroll effective dates. Apps: Google Docs, Workday, Google Calendar, Slack.
  • Leave balances, HR. Work the back-filed Q3 time-off requests in People Ops’ inbox against the team calendars and leave handbook, then reply with each person’s balances and carry-over. Apps: Slack, Notion, Google Calendar, Workday.
  • Receivables chase, Finance. Run the October credit-control chase for a plumbing wholesaler: email reminders on past-due invoices and write the collections hand-off document. Apps: Xero, Gmail, Google Docs.
  • Pre-order drop, Finance. Tag the pre-orders on a release sheet into a limited sneaker drop under the product’s allocation terms, and email back what was released and what was held. Apps: Shopify, Google Sheets, Gmail.
  • Supplier wires, Finance. Pay three failed supplier payment runs by wire from the operating account, splitting each day’s spare cash across the runs, and report what was paid and what waits. Apps: Tipalti, NetSuite, Kyriba, Bank portal, Outlook.
  • Rehire access, IT access. Set up access for a former employee returning as an agency contractor, handle her manager’s access request in the IT channel, and close the IT step. Apps: Slack, Workday, Okta.
  • Access group, IT access. Add the operations staff on an onboarding worksheet to a new Okta access group before go-live under the directory’s separation-of-duties rules, and email a summary. Apps: Okta, Google Sheets, Gmail.
  • Seat true-up, IT access. Run the Q4 help desk seat round for seven portfolio companies: seat shared support analysts, answer the admin elevation queue, handle leavers, and name the cover seat holders. Apps: Zendesk, Okta, Linear, Notion, Slack.
  • Rivergate notes, Comms. Find release-train notes that were never fixed, and file the Jira follow-ups the train still owes. Apps: Microsoft Teams, Jira.
  • Outage notices, Comms. After a regional database outage, email notices to the affected tenants using the tenant map and template in the team channel, and post who was notified. Apps: Slack, Datadog, Gmail.
  • Matter closing, Legal. Work a law firm’s October 2026 closing list: close the matters the file closing policy allows and put a hold task on the rest naming what holds them. Apps: Clio, Google Docs, Gmail.
  • Legal hold release, Legal. Release a settled matter’s legal hold custodian by custodian, update the hold register and claims log, and send the final preservation-cost claim to the insurer. Apps: Outlook, SharePoint, Microsoft Teams, DocuSign.
  • Stale ticket closure, IT service management. At quarter end, solve the stale tickets in the help desk pending view that have waited on the customer past the cut-off, and email back the solved list. Apps: Zendesk, Gmail, Google Sheets.
  • Leave cover handoff, Engineering. Hand a platform engineer’s open issues to cover for her parental leave, balancing each cover’s load, placing every issue in its cycle, then tell the team and log the leave. Apps: Linear, Google Calendar, Slack, Notion.