In this video· click a step to jump to it
S
Passed ✓
Test recording
Scoply — app walkthrough
56,782 ms · 0 pixels changed · matches baseline
We built this regression test for scoply-v2.vercel.app — it's yours to keep, free.
Take this test with you
This is a real Playwright test, recorded against scoply-v2.vercel.app. Claim it into your own workspace and re-run it on every deploy — free.
export async function test(page, baseUrl, screenshotPath, stepLogger) {
// storage_state (Supabase magic-link session, project plan pre-saved) is
// attached via setupOverrides.extraSteps — this test starts authenticated
// for the /app phase with no inline login code.
const findings = [];
const shot = (n, slug) => screenshotPath.replace('.png', `-${n}-${slug}.png`);
const SAVED_PLAN_TEXT = 'Redesign our client onboarding flow with a simple 3-step wizard: collect company name, upload logo, and choose a plan.';
// The app's own /api/account and /api/sow calls consistently 401 on the
// Lastest EB network path even with a genuinely valid session (verified:
// the identical cookie/session succeeds on a direct connection). This is aChecks run
0
Diff px
57s
Duration
A
Accessible
WCAG 2.2 · 100
C
Fast
Web Vitals · 70
Notes from the demo run
AI-generatedScoply is a single-page marketing site with a clean, dark, orange-accented dashboard behind /app: paste a call/ticket transcript, get an AI scope-creep risk score plus a dollar revenue-impact estimate with evidence + boundary cards, and a client-safe protection plan.
Highlights
- Clear core loopPaste transcript -> AI flags new-scope items -> each gets an 'evidence' + 'boundary' card with a $ impact line, plus a one-click 'Open protection plan'. Tight, well-scoped demo of the product's value.
- Built-in sample call'Try a sample call' renders the full result screen instantly with no API dependency -- a smart, resilient onboarding shortcut that also let this demo reliably show the core value prop.
- No-password onboardingMagic-link only; workspace pre-fills a saved project plan so repeat analyses need zero re-entry.
Friction points
- Session validation intermittently fails on first paintThe app's own /api/account and /api/sow calls sometimes 401 immediately after a valid magic-link sign-in even though the session is genuinely valid (confirmed: the identical session succeeds on a direct connection, and errors clear on some retries but not others). This bounces signed-in users back to the 'Add your project plan' onboarding step instead of the main analysis screen -- worth hardening the server-side session check, especially for users on VPNs/proxies/less-common network paths.
- Hydration flashFor ~1-1.5s after /app loads, the header briefly shows a stale 'Sign up to start' pill simultaneously with 'Workspace ready' / 'Signed in as'.
Share this run
Earned · Lastest awards
Proof your app is not AI slop
Badges stay live, ratchet upward, only downgrade on confirmed regression.
57,388 test runs recorded · 1,174 products tested with Lastest
This test was built for scoply-v2.vercel.app — claim it free
One click copies the test and baseline screenshots into your own Lastest workspace. Re-run on every deploy and catch regressions before your users do — free, no card required.