freshyo/docs/test reports/pending-test-cases-2026-10-18.md
2026-10-18 18:19:15 +05:30

27 KiB
Raw Permalink Blame History

Pending Test Cases — Freshyo Full Regression (Run FR-2026-10-18-01)

Generated from docs/test reports/full-regression-2026-10-18.md (results so far) against the catalogue in docs/test-cases/*.md (45 files, 855 cases).

How this list was derived (reproducible, script-based). Every case id in the catalogue was extracted from the | ID | P | title | criteria | tables and matched against every id that appears anywhere in the results report. An id that never appears in the report is treated as pending. Ids that appear but were recorded as SKIPPED, PARTIAL, BLOCKED or re-opened are listed in §2/§3 from the narrative.

Bucket Count
Catalogue (all cases) 855
Appear in the results report 714
Never appear in the report (pending) 141
of which excluded by owner instruction 53
of which runnable when next picked up 88

Results so far: 855 catalogued · 60 SKIPPED · ~736 executed (~92%) · 61 defects (defect 35 withdrawn; 56–61 open). Per-case evidence for everything executed is in docs/test reports/full-regression-2026-10-18.md.

Caveat: "appears in the report" includes ids mentioned only in a SKIPPED/blocked narrative. If a case was folded into an aggregate sentence in §1–§55 without its id, it will not be counted as pending here — re-check before re-running a group. Criteria for every id live in its source file (last column below).


1. Excluded by owner instruction

Owner instruction: "don't do anything related to OTP or Notifications, skip those"; queue/scheduled-job cases and fallback/legacy UI were also parked. Cases are retained in the catalogue and marked SKIPPED in the report — they are listed here only so nothing is silently dropped.

1.1 OTP/one-time-code flows — excluded by owner instruction (15)

Source: docs/test-cases/otp-authentication.md

ID P Case Note
OTP-03 P0 Existing password account verifies same mobile. Excluded by owner instruction — retained, marked SKIPPED.
OTP-04 P0 Wrong/empty/malformed OTP, no prior send or expired credentials. Excluded by owner instruction — retained, marked SKIPPED.
OTP-05 P0 OTP for mobile A submitted with mobile B. Excluded by owner instruction — retained, marked SKIPPED.
OTP-06 P0 Reuse successful code/verification ID. Excluded by owner instruction — retained, marked SKIPPED.
OTP-10 P0 Bounded abuse/rate-limit checks in isolated adapter. Excluded by owner instruction — retained, marked SKIPPED.
OTP-13 P0 Verification returns token/cookie/logs. Excluded by owner instruction — retained, marked SKIPPED.
OTP-01 P1 Approved test mobile requests code then verifies provider-valid code. Excluded by owner instruction — retained, marked SKIPPED.
OTP-02 P1 Verify approved new mobile without pre-existing account. Excluded by owner instruction — retained, marked SKIPPED.
OTP-07 P1 Resend code before verifying previous code. Excluded by owner instruction — retained, marked SKIPPED.
OTP-08 P1 Expiry exact boundary and client clock skew. Excluded by owner instruction — retained, marked SKIPPED.
OTP-09 P1 Invalid phone length/prefix/country format/whitespace. Excluded by owner instruction — retained, marked SKIPPED.
OTP-11 P1 Provider timeout/error on send or verify. Excluded by owner instruction — retained, marked SKIPPED.
OTP-12 P1 Concurrent valid verifies for same new mobile. Excluded by owner instruction — retained, marked SKIPPED.
OTP-14 P1 Suspended/deleted-account mobile uses OTP. Excluded by owner instruction — retained, marked SKIPPED.
OTP-15 P2 UI requests resend/verification then background/back/offline retry. Excluded by owner instruction — retained, marked SKIPPED.

1.2 Push notifications — excluded by owner instruction (17)

Source: docs/test-cases/notifications.md

ID P Case Note
PUSH-03 P0 Logout U1, login U2 on same device. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-05 P0 Send targeted message to approved U1 fixture. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-06 P0 B staff submits A/private target IDs or customer calls send API. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-09 P0 Notification with private order/complaint link clicked by wrong account. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-16 P0 Sensitive payloads/logs, admin/internal notes. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-02 P1 Same token repeated or refreshed token/new device. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-04 P1 Register staff token, trigger authorized test order notification. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-07 P1 Missing/invalid/expired token and empty title/body. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-08 P1 Duplicate user/token IDs, many supported recipients. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-10 P1 Cold/background/foreground tap on supported deep link. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-11 P1 Invalid/deleted target route or unsupported link scheme. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-12 P1 Order/cancel/complaint queue event retried. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-13 P1 Provider timeout/token invalidation. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-14 P1 Notifications denied/OS token unavailable. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-17 P1 Staff deleted/reassigned after token registration. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-18 P1 Scheduled/event send delayed past cancellation/deletion. Excluded by owner instruction — retained, marked SKIPPED.
PUSH-15 P2 Physical-device receipt vs emulator queue acceptance. Excluded by owner instruction — retained, marked SKIPPED.

1.3 scheduled/queue jobs — excluded by owner instruction (8)

Source: docs/test-cases/jobs-health.md

ID P Case Note
JOB-04 P1 New write during existing generation. Excluded by owner instruction — retained, marked SKIPPED.
JOB-05 P1 Flash enable/disable at intended regional schedule boundaries. Excluded by owner instruction — retained, marked SKIPPED.
JOB-06 P1 Midnight/IST/UTC crossover and delayed scheduler tick. Excluded by owner instruction — retained, marked SKIPPED.
JOB-07 P1 Retry same queue event or duplicate scheduler invocation. Excluded by owner instruction — retained, marked SKIPPED.
JOB-08 P1 DB/KV/storage/provider unavailable during job. Excluded by owner instruction — retained, marked SKIPPED.
JOB-09 P1 Job interrupted/restarted midway. Excluded by owner instruction — retained, marked SKIPPED.
JOB-13 P1 Regional versions and in-memory store freshness after initialization. Excluded by owner instruction — retained, marked SKIPPED.
JOB-14 P2 Logs/alerts on permanent failure. Excluded by owner instruction — retained, marked SKIPPED.

1.4 fallback/legacy UI — excluded by owner instruction (low priority) (13)

Source: docs/test-cases/fallback-legacy-pages.md

ID P Case Note
LEGACY-02 P0 Anonymous/customer visits operational user/order/super-admin routes. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-03 P0 User/order detail with guessed foreign IDs. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-06 P0 Standalone coupon creation from staff A vs customer/B/global attempt. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-12 P0 API environment/base URL in standalone deployment. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-04 P1 Supported location marker saves intended order/address coords. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-05 P1 Missing/malformed marker params/coords and permission denied. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-07 P1 User-connect flow with approved identity/link. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-08 P1 Vendor page expired/permanent/missing snippet. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-10 P1 Browser refresh/back/cold direct route. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-11 P1 Active backend endpoint changed since legacy UI shipped. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-13 P1 Network/asset error, corrupt local state. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-09 P2 Inauguration/demo promotional page. Excluded by owner instruction — retained, marked SKIPPED.
LEGACY-14 P2 Mobile browser keyboard/safe-area/maps and desktop layout. Excluded by owner instruction — retained, marked SKIPPED.

2. Open / partial results that need another pass

These do appear in the report, but were recorded as PARTIAL, RE-VERIFY, BLOCKED or N/A, or rest on structural-only evidence. Their ids are therefore also absent from §3.

ID P What is needed
CLS-02 P0 RE-VERIFY: defect 35 withdrawn (viewport-only screen dump); needs the coupon sheet scrolled past the first viewport. (Inspect a disabled row.)
CLS-03 P0 RE-VERIFY: defect 35 withdrawn — as CLS-02. (Coupon scoped to another region.)
CLS-04 P0 RE-VERIFY: defect 35 withdrawn — as CLS-02. (First-order-only coupon, customer already ordered.)
CLS-05 P1 RE-VERIFY: defect 35 withdrawn — as CLS-02. (minOrder above cart subtotal.)
CLS-06 P1 RE-VERIFY: defect 35 withdrawn — as CLS-02. (Targeted coupon matching no cart items.)
SAUTH-10 P1 Blocked: correct admin.staffUser.login input shape unresolved (my attempts returned 400). (Slow/double login, logout during pending request.)
SAUTH-15 P1 Blocked: needs admin-web running (not started in this environment). (Admin-web reload on a region-scoped screen, specifically Vendor Snippets.)
UX-15 P1 Blocked: in-app update prompt cannot appear inside Expo Go (needs a dev/prod build). (App build older/newer than supported version policy.)
UX-20 P2 Blocked: admin parity needs admin-web; flash parity on web/Android not driven. (Run same critical flow native/web/admin native/admin-web.)
ADDR-23 P2 Blocked: needs device — BottomDialog delete-error/keyboard/scroll; component has since moved to RawBottomDialog. (BottomDialog deletion error, keyboard/scroll, readonly checkout address.)
ADDR-25 P1 Blocked: OTP-gated (excluded by owner instruction). (Signed-out user drafts an address, then logs in/registers.)
CART-17 P1 Blocked: OTP-gated (excluded by owner instruction). (Logout/login U2 with U1 cart.)
CART-21 P0 Blocked: OTP-gated (excluded by owner instruction). (Network unavailable; attempt submit from cached cart.)
LOC-07 P0 Partial: structural PASS recorded; a literal request-generation-counter proof needs network throttling. (Rapid A→B→A with delayed catalog responses.)
LOC-10 P1 Partial: needs device re-run with a controllable in-flight request. (U1 A/B addresses; default B while browsing A.)
LOC-18 P0 Recorded FAIL on structural evidence; the device interleaving itself was not driven. (Change region while submit request is pending.)
ADDR-16 P0 Partial: needs device re-run. (Foreign default address when browsing A.)
CACHE-09 P1 Partial: direct discovery-KV blob deletion not performed; verdict rests on code path + the live CFG-14 result. (Missing/corrupt discovery KV in approved fixture.)
FLASH-11 P1 Partial: the clock/midnight/timezone half needs the excluded scheduled-job harness. (Exact schedule boundary/midnight/timezone change.)
CGRD-03 P0 Partial: recorded PARTIAL in §40 — needs device re-run of the blocked path. (Item whose selected slot's freeze time has passed.)
CGRD-05 P1 Partial: recorded PARTIAL in §40 — needs device re-run of the blocked path. (Out-of-stock item present.)
CGRD-06 P1 Partial: recorded PARTIAL in §40 — needs device re-run of the blocked path. (Flash-delivery cart.)
STORE-15 P1 Half verified: the persistence half is recorded PASS (report §50, "A successful store mutation is persisted and immediately readable"); the cache/upload-cleanup-failure half is not yet verified. (Successful mutation followed by cache/upload-cleanup failure.)
EDIT-14 P0 Policy case — owner decision required (recorded as POLICY in the report). (Lower new goods below historic discount.)
ORDER-22 P2 N/A by specification. (Open a historical pre-migration order whose stored total already included a coupon discount.)
SEC-24 P1 Blocked: needs a rate-limit/throttle harness (no request-flood tooling in this run). (Repeated auth/code requests in approved bounded harness.)
USR-01 P1 Blocked: create-user harness needs bcryptjs, not installed for the Bun/tsx runner. (bun run create-user -- --mobile <m> --password <p> [--name --email].)

3. Pending — runnable when next picked up (88)

Grouped by source file; P0 first. Every one of these has no blocker recorded in the report.

addresses.md (1)

ID P Case Note
ADDR-11 P1 Deny location, invalid map link/coordinates or outside service. Not reached in this run — no blocker recorded.

banners.md (4)

ID P Case Note
BANNER-10 P1 Delete image cleanup fails. Not reached in this run — no blocker recorded.
BANNER-12 P1 Save timeout/double create/concurrent reorder. Not reached in this run — no blocker recorded.
BANNER-14 P1 A/B edits within same publication window. Not reached in this run — no blocker recorded.
BANNER-13 P2 Carousel swipe, autoplay if supported, orientation/text scale. Not reached in this run — no blocker recorded.

cache-publication.md (2)

ID P Case Note
CACHE-19 P1 Concurrent version increments in A. Not reached in this run — no blocker recorded.
CACHE-22 P1 Deleted/deactivated region metadata or bound priority change. Not reached in this run — no blocker recorded.

cancellation.md (5)

ID P Case Note
CANCEL-08 P0 Multiple coupons on fully cancelled group. Not reached in this run — no blocker recorded.
CANCEL-12 P0 Cancellation races packaging/delivery. Not reached in this run — no blocker recorded.
CANCEL-16 P1 Notification/Telegram fails after cancellation saved. Not reached in this run — no blocker recorded.
CANCEL-17 P1 Cart after cancellation. Not reached in this run — no blocker recorded.
CANCEL-18 P2 Cancel confirmation/back/error dialog. Not reached in this run — no blocker recorded.

cart.md (3)

ID P Case Note
CART-02 P1 Add same SKU again vs explicit Update Item. Not reached in this run — no blocker recorded.
CART-14 P1 Catalog ID missing after product deletion or region switch. Not reached in this run — no blocker recorded.
CART-15 P1 Slow price refresh while cart visible. Not reached in this run — no blocker recorded.

catalog-search.md (4)

ID P Case Note
CAT-08 P1 Multi-SKU product detail; select each variant and quantity. Not reached in this run — no blocker recorded.
CAT-09 P1 Missing MRP/image/description/slot; zero data sets. Not reached in this run — no blocker recorded.
CAT-17 P1 Available product loses all valid slots. Not reached in this run — no blocker recorded.
CAT-15 P2 Missing/deleted product direct URL, browser back/reload. Not reached in this run — no blocker recorded.

combos.md (8)

ID P Case Note
COMBO-12 P0 Coupon targets combo SKU vs component SKU only. Not reached in this run — no blocker recorded.
COMBO-03 P1 Component marked combo-only. Not reached in this run — no blocker recorded.
COMBO-10 P1 Attempt suspend component of active combo. Not reached in this run — no blocker recorded.
COMBO-11 P1 Component regular-only but combo flash-enabled. Not reached in this run — no blocker recorded.
COMBO-13 P1 Global combo shown in A/B with regional prices. Not reached in this run — no blocker recorded.
COMBO-14 P1 Component product rename/delete after historical combo order. Not reached in this run — no blocker recorded.
COMBO-15 P1 Long/missing features and missing component image. Not reached in this run — no blocker recorded.
COMBO-16 P1 Save fails during component writes, retry. Not reached in this run — no blocker recorded.

complaints.md (2)

ID P Case Note
SUPPORT-14 P1 Network loss during create/resolve, retry after checking state. Not reached in this run — no blocker recorded.
SUPPORT-15 P2 Photos slow/broken, multiline response/text scale. Not reached in this run — no blocker recorded.

coupon-application.md (3)

ID P Case Note
CPA-21 P1 Cancel only one sibling vs every sibling, then first-order/usage retry. Not reached in this run — no blocker recorded.
CPA-26 P1 Coupon query fails, relogin U2, region changes. Not reached in this run — no blocker recorded.
CPA-27 P1 Small target contribution rounds below minor unit. Not reached in this run — no blocker recorded.

coupon-stacking-and-cart-guards.md (5)

ID P Case Note
USR-02 P1 Repeat without --update. Blocked: same bcryptjs/create-user harness gap.
USR-03 P1 Repeat with --update. Blocked: same bcryptjs/create-user harness gap.
USR-06 P1 Inspect the stored hash. Blocked: same bcryptjs/create-user harness gap.
USR-04 P2 --show-sql. Blocked: same bcryptjs/create-user harness gap.
USR-05 P2 --remote. Blocked: same bcryptjs/create-user harness gap.

customer-management-incidents.md (2)

ID P Case Note
CUSTOMER-10 P1 User profile edited/soft-deleted after incident/order. Not reached in this run — no blocker recorded.
CUSTOMER-16 P2 Search slow/error, large details/history, mobile number copy/link. Not reached in this run — no blocker recorded.

delivery-operations.md (2)

ID P Case Note
DELIVERY-12 P1 Concurrent reorder/update and network failure. Not reached in this run — no blocker recorded.
DELIVERY-13 P2 Map load failure, offline tiles, zoom/resize/back. Not reached in this run — no blocker recorded.

fulfillment.md (5)

ID P Case Note
FUL-10 P1 Two admins toggle same item; cancel races with delivery. Not reached in this run — no blocker recorded.
FUL-12 P1 Status filters/pagination change after action. Not reached in this run — no blocker recorded.
FUL-13 P1 Mutation error, offline or timeout after commit. Not reached in this run — no blocker recorded.
FUL-15 P1 Delivery timestamp around midnight. Not reached in this run — no blocker recorded.
FUL-16 P2 Large order list, item switches, keyboard/dialog overlays. Not reached in this run — no blocker recorded.

global-products.md (3)

ID P Case Note
GP-02 P0 Set different A/B prices, flash/stock/offer flags. Not reached in this run — no blocker recorded.
GP-21 P1 Open global-product Create, type a draft, click Edit on another product, then click Create again. Not reached in this run — no blocker recorded.
GP-20 P2 Regional readonly badge/details and superadmin image picker. Not reached in this run — no blocker recorded.

global-stores.md (7)

ID P Case Note
GSTORE-06 P0 Assign global product to regional store. Not reached in this run — no blocker recorded.
GSTORE-05 P1 Global store with no products, one global product, many variants. Not reached in this run — no blocker recorded.
GSTORE-09 P1 Delete unused store then requery A/B. Not reached in this run — no blocker recorded.
GSTORE-10 P1 Region created after global store. Not reached in this run — no blocker recorded.
GSTORE-11 P1 Image URL already normalized vs asset key. Not reached in this run — no blocker recorded.
GSTORE-12 P1 Concurrent edit/delete or upload failure. Not reached in this run — no blocker recorded.
GSTORE-13 P2 Global badge/read-only affordance in regional UI. Not reached in this run — no blocker recorded.

location-region-switching.md (3)

ID P Case Note
LOC-15 P1 Force-quit during confirmed switch/state clearing. Not reached in this run — no blocker recorded.
LOC-16 P1 Resolve request offline/timeout, then restore network. Not reached in this run — no blocker recorded.
LOC-14 P2 Browser refresh/SSR/private-mode. Not reached in this run — no blocker recorded.

order-edits-rebalance.md (1)

ID P Case Note
EDIT-18 P2 Notes/rebalance confirmation cancel and reopen detail. Not reached in this run — no blocker recorded.

orders.md (2)

ID P Case Note
ORDER-15 P1 Queue/Telegram/push fails after persistence. Not reached in this run — no blocker recorded.
ORDER-20 P2 Native/browser deep links/back/reload to success/detail. Not reached in this run — no blocker recorded.

prices-stock-suspension.md (5)

ID P Case Note
STOCK-08 P0 Reopen suspended global SKU, edit price only, save. Not reached in this run — no blocker recorded.
STOCK-14 P0 Anonymous/customer/A admin supplies unauthorized SKU. Not reached in this run — no blocker recorded.
STOCK-09 P1 Globally suspended SKU opened by regional admin. Not reached in this run — no blocker recorded.
STOCK-19 P1 Stock/availability publication fails or delayed. Not reached in this run — no blocker recorded.
STOCK-20 P2 Stock dialog cancel, scrolling variants, rapid taps. Not reached in this run — no blocker recorded.

pricing-delivery-fees.md (1)

ID P Case Note
MONEY-08 P1 Equal-goods slots and reverse insertion order. Not reached in this run — no blocker recorded.

product-groups.md (1)

ID P Case Note
GROUP-08 P1 Edit membership after slots reference the group. Not reached in this run — no blocker recorded.

product-tags-ordering.md (3)

ID P Case Note
TAG-13 P1 Save order after some products deleted. Not reached in this run — no blocker recorded.
TAG-14 P1 Rapid A/B tag edits; customer fresh/open sessions. Not reached in this run — no blocker recorded.
TAG-15 P2 Drag reorder on native/web; scroll, cancel and reload. Not reached in this run — no blocker recorded.

regional-products.md (3)

ID P Case Note
PROD-12 P1 Re-send owned image keys; change only one variant's image. Not reached in this run — no blocker recorded.
PROD-14 P1 Duplicate SKU/feature IDs in payload; repeated component entry. Not reached in this run — no blocker recorded.
PROD-15 P1 Cancel form, then reopen existing product. Not reached in this run — no blocker recorded.

regional-stores.md (2)

ID P Case Note
STORE-11 P1 Large product list with deleted/hidden variants. Not reached in this run — no blocker recorded.
STORE-14 P2 Deep link unknown/deleted store, refresh/back. Not reached in this run — no blocker recorded.

reserved-coupons.md (2)

ID P Case Note
RES-15 P1 Repeat generation or concurrent admin requests. Not reached in this run — no blocker recorded.
RES-16 P1 Cancel generated coupon use then fully cancel its order group. Not reached in this run — no blocker recorded.

reviews.md (1)

ID P Case Note
REVIEW-10 P1 Text contains HTML/script/links. Not reached in this run — no blocker recorded.

scheduled-slots.md (4)

ID P Case Note
SLOT-08 P0 Regular order sends null slot; flash order supplies arbitrary slots. Not reached in this run — no blocker recorded.
SLOT-20 P0 Customer/anonymous/B admin attempts A slot mutation. Not reached in this run — no blocker recorded.
SLOT-13 P1 Selected S1 removed/closed while S2 valid. Not reached in this run — no blocker recorded.
SLOT-17 P1 Empty slot and slot with only hidden/deleted SKUs. Not reached in this run — no blocker recorded.

staff-management.md (1)

ID P Case Note
STAFF-08 P0 Anonymous/customer calls staff CRUD or role mutation. Not reached in this run — no blocker recorded.

uploads-images.md (1)

ID P Case Note
UPLOAD-18 P1 Public fetch caching after image replacement. Not reached in this run — no blocker recorded.

vendor-snippets.md (2)

ID P Case Note
VENDOR-09 P1 Duplicate/empty SKUs, duplicate code and invalid expiry. Not reached in this run — no blocker recorded.
VENDOR-13 P1 Packaging races admin cancellation/delivery. Not reached in this run — no blocker recorded.

4. Resume instructions

  • Results file: docs/test reports/full-regression-2026-10-18.md (Run ID FR-2026-10-18-01) — append a new numbered section; keep the tally line updated at the end.
  • Catalogue: docs/test-cases/*.md — never delete a case; mark it SKIPPED/PARTIAL instead.
  • Environment: backend http://localhost:8787 (wrangler dev — do not restart), user-ui Metro :8081, admin-ui Metro :8082, web :4174, superadmin :4176; admin-web and apps/fallback-ui are not running. iOS simulator 5A64695E-F4D4-4E2E-90F3-EC3493A2B457; Maestro app id host.exp.Exponent.
  • Harness: /tmp/freshyo/ (client.mjs, tokens.json, fixtures.json, phase*.mjs, results/*.json).
  • Method warning (cost us defect 35): inspect_screen returns only nodes in the viewport — always scroll to the end (or confirm via the API) before concluding "the app does not show X".
  • Repo rules: log every non-.md/.txt file change in change-log.txt before editing; never run drizzle migrations or the test suite unless asked; no git operations.