Skip to content

Merging staging into release#948

Closed
Nicolapps wants to merge 4 commits intoreleasefrom
staging
Closed

Merging staging into release#948
Nicolapps wants to merge 4 commits intoreleasefrom
staging

Conversation

@Nicolapps
Copy link
Member

@Nicolapps Nicolapps commented Dec 8, 2025

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

Nicolapps and others added 4 commits October 23, 2025 22:49
@Nicolapps
Update @convex-dev/eslint-plugin (#923)
5a002d3
@atrakh
Show SSO-specific error message instead of generic 403 (#930)
48bfe4e 
If the response indicates that logging in with SSO is required, show a
more specific error message

----

By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.
@Nicolapps
Update the React version used in the template (#946)
e5c1195 
<!-- Describe your PR here. -->



<!--
  The following applies to third-party contributors.
  Convex employees and contractors can delete or ignore.
-->

----

By submitting this pull request, I confirm that you can use, modify,
copy, and redistribute this contribution, under the terms of your
choice.
@Nicolapps
Move @convex-dev/eslint-plugin to devDependencies (#947)
521138f
@Nicolapps Nicolapps requested a review from atrakh December 8, 2025 18:53
@vercel
Copy link

vercel bot commented Dec 8, 2025 •
edited
Loading

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Updated (UTC)
chef Building Building Dec 8, 2025 6:55pm
chef (staging) Ready Ready Preview Dec 8, 2025 6:55pm

@github-actions
Copy link

github-actions bot commented Dec 8, 2025 •
edited
Loading

Braintrust eval report

chef (chef-claude-4-sonnet-cdfe244f)

Score Average Improvements Regressions
1/Deploys 58.3% - -
IsSuccess 100% - -
Llm_calls 6 (+2.5) 3 🟢 1 🔴
Tool_calls 0 (+0) - -
Errors 1 (-2) 4 🟢 -
Llm_errors 0 (-1) 4 🟢 -
Tool_errors 0 (+0) - -
Prompt_tokens 174524tok (+122129.75tok) - 4 🔴
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Completion_tokens 9700.75tok (+9404.5tok) - 4 🔴
Total_tokens 184224.75tok (+131534.25tok) - 4 🔴
Estimated_cost 0.67$ (+0.51$) - 4 🔴
Duration 157.16s (+104.34s) - 4 🔴
Llm_duration 120.65s (+107.1s) - 4 🔴

‼️ chef (chef-claude-4.5-sonnet-f4d8b5c5)

Score Average Improvements Regressions
Llm_calls 3.5 (-2.75) 1 🟢 3 🔴
Tool_calls 0 (+0) - -
Errors 3 (+2) - 4 🔴
Llm_errors 1 (+1) - 4 🔴
Tool_errors 0 (+0) - -
Prompt_tokens 52394.25tok (-128667.75tok) 4 🟢 -
Prompt_cached_tokens 0tok (+0tok) - -
Prompt_cache_creation_tokens 0tok (+0tok) - -
Completion_tokens 296.25tok (-10127tok) 4 🟢 -
Total_tokens 52690.5tok (-138794.75tok) 4 🟢 -
Estimated_cost 0.16$ (-0.54$) 4 🟢 -
Duration 52.82s (-107.43s) 4 🟢 -
Llm_duration 13.56s (-103.83s) 4 🟢 -
Expand to see errors 
AI_APICallError: prompt is too long: 204563 tokens > 200000 maximum
    at eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14228:14)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async postToApi (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14133:28)
    at async AnthropicMessagesLanguageModel.doGenerate (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:18942:9)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29803:30)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async _retryWithExponentialBackoff (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:27940:12)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29763:32)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async type (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:35083:24)
AI_APICallError: prompt is too long: 220519 tokens > 200000 maximum
    at eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14228:14)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async postToApi (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14133:28)
    at async AnthropicMessagesLanguageModel.doGenerate (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:18942:9)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29803:30)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async _retryWithExponentialBackoff (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:27940:12)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29763:32)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async type (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:35083:24)
AI_APICallError: prompt is too long: 204462 tokens > 200000 maximum
    at eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14228:14)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async postToApi (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14133:28)
    at async AnthropicMessagesLanguageModel.doGenerate (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:18942:9)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29803:30)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async _retryWithExponentialBackoff (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:27940:12)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29763:32)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async type (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:35083:24)
AI_APICallError: prompt is too long: 212810 tokens > 200000 maximum
    at eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14228:14)
    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
    at async postToApi (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:14133:28)
    at async AnthropicMessagesLanguageModel.doGenerate (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:18942:9)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29803:30)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async _retryWithExponentialBackoff (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:27940:12)
    at async fn (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:29763:32)
    at async eval (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:28123:22)
    at async type (eval at <anonymous> (/home/runner/work/chef/chef/node_modules/.pnpm/[email protected]_@[email protected][email protected][email protected]__wgerilt4ezktegc3ulzicjnwli/node_modules/braintrust/dist/cli.js:6941:5), <anonymous>:35083:24)

@Nicolapps Nicolapps closed this Dec 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@atrakh atrakh atrakh approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Nicolapps @atrakh