# Benchmark Results

> Generated by `npm run benchmark -- report`. Methodology: [METHODOLOGY.md](METHODOLOGY.md).

## saleor

| arm | passed/graded (rate) |
|---|---|
| baseline | 19/25 (76%) |
| wiki | 22/25 (88%) |

Total session cost: $55.37

| ticket | merged | baseline | wiki |
|---|---|---|---|
| #19298 Password login mode set to "customer" strips staff access from third-party tokens, causing "not authenticated" errors for OIDC logins | 2026-06-08 | ✅ | ✅ |
| #19289 Password login mode restriction wrongly applies to app/app-extension access tokens, breaking `app { extensions { accessToken } }` for OIDC staff users | 2026-06-08 | ✅ | ✅ |
| #19286 "Invalid OIDC access token format" logged on every request when using opaque (non-JWT) access tokens | 2026-06-08 | ❌ tests-failed | ❌ tests-failed |
| #19280 Add support for EditorJS table syntax in product descriptions | 2026-06-08 | ✅ | ✅ |
| #19253 KeyError when a subscription query selects `channel` on channel-agnostic account events | 2026-06-01 | ❌ tests-failed | ✅ |
| #19251 TypeError: SimpleLazyObject not JSON serializable when resolving default channel slug on product types | 2026-06-03 | ✅ | ✅ |
| #19229 Checkout delivery invalidation crashes with IntegrityError on the unique_for_checkout constraint when stale duplicate CheckoutDelivery rows exist | 2026-05-20 | ✅ | ✅ |
| #19228 IntegrityError crash during checkout delivery invalidation when stale duplicate CheckoutDelivery rows exist | 2026-05-20 | ❌ tests-failed | ✅ |
| #19179 RequestDataTooBig from oversized request bodies is unhandled and reported to Sentry | 2026-05-05 | ❌ tests-failed | ❌ tests-failed |
| #19174 CUSTOMER_DELETED webhook event does not support subscription queries | 2026-05-08 | ✅ | ✅ |
| #19173 CUSTOMER_DELETED webhook does not support subscription queries | 2026-05-08 | ✅ | ✅ |
| #19114 Add `checkoutDelete` mutation | 2026-04-27 | ❌ tests-failed | ❌ tests-failed |
| #19123 AvataxPlugin treats failed Avatax requests as successful, yielding "None" as the currency code | 2026-04-22 | ✅ | ✅ |
| #19122 Failed Avatax requests are treated as successful responses, producing "None" as the currency code | 2026-04-21 | ❌ tests-failed | ✅ |
| #19120 Failed Avatax requests are treated as successful, resulting in "None" as the currency value | 2026-04-21 | ✅ | ✅ |
| #19116 Apps cannot modify staff user metadata — all metadata mutations are blocked for APP requestors targeting staff users | 2026-04-20 | ✅ | ✅ |
| #19111 Apps cannot add/update/delete metadata on staff users even with sufficient permissions | 2026-04-20 | ✅ | ✅ |
| #19085 accountRegister skips password validation, email normalization, and language code when account confirmations are disabled | 2026-04-13 | ✅ | ✅ |
| #19084 GraphQL mutations crash with HTTP 500 when no channel exists in the database | 2026-04-13 | ✅ | ✅ |
| #19083 accountRegister skips password validation, language code, and email normalization when account confirmations are disabled | 2026-04-13 | ✅ | ✅ |
| #19082 GraphQL mutations crash with HTTP 500 when no channel exists in the database | 2026-04-13 | ✅ | ✅ |
| #19070 accountRegister skips password validation, language code, and email normalization when account confirmation is disabled | 2026-04-13 | ✅ | ✅ |
| #19068 GraphQL mutations crash with HTTP 500 when no channel exists in the database | 2026-04-13 | ✅ | ✅ |
| #19045 collectionAddProducts rejects products without variants, while productUpdate allows assigning them to collections | 2026-04-10 | ✅ | ✅ |
| #19044 collectionAddProduct rejects products without variants, while productUpdate allows assigning them to collections | 2026-04-09 | ✅ | ✅ |