Recording of the visual regression run on chatpdf.aadityasingh.dev · ChatPDF — app walkthrough.

In this video· click a step to jump to it

C
Passed ✓

Test recording

ChatPDF — app walkthrough

129,772 ms · 1,177,827 pixels changed

We built this regression test for chatpdf.aadityasingh.dev — it's yours to keep, free.

Take this test with you

This is a real Playwright test, recorded against chatpdf.aadityasingh.dev. Claim it into your own workspace and re-run it on every deploy — free.

export async function test(page, baseUrl, screenshotPath, stepLogger) {
  const Q1 = 'What is the default screenshot comparison threshold, and how long are videos retained?';
  const Q2 = 'What is the support email, and what is the average first response time on the Team plan?';
  const Q3 = 'Which browsers are supported, and what licence is the platform released under?';
  let n = 0;
  const shot = async (slug) => {
    n += 1;
    await page.waitForTimeout(700);
    await page.screenshot({ path: `${screenshotPath}/Step_${n}_${slug}.png`, fullPage: true });
    stepLogger.log('captured ' + slug);
  };
  const ask = async (q, slugTyped, slugAnswered) => {
+39 more lines — claim the test to get the full code.

Checks run

Run
✓
Visual
37.26%
Text
—
DOM
✓
Network
+27 −0
Console
✓
A11y
C
Perf
315 over
URL
36 diverged
Variables
—
Full report
Log in →
1,177,827
Diff px
2m 10s
Duration
C
Accessible
WCAG 2.2 · 78
Review
Fast
Web Vitals

Notes from the demo run

AI-generated

We signed in to ChatPDF with Google, uploaded a three-page product spec, and then asked it three questions it could only answer from that document. It got all three right and quoted the exact figures: the 0.1 percent screenshot threshold, the 30-day video retention, the support address and the 4-hour Team-plan response time. The RAG pipeline is doing its job, and the answers are short and quotable rather than padded. The whole loop from Google sign-in to a grounded answer took under two minutes.

Highlights
  • The answers are grounded and terse
    Three questions, three exact quotes from the document, no hedging preamble and no invented detail. That is the hard part of a RAG product and you have it working.
  • The limits are stated before the upload, not after
    'PDF only, max 5MB, max 50 pages' sits inside the drop zone, so nobody discovers the ceiling by having an upload rejected.
  • The transcript survives a reload
    We reloaded mid-session and every question and answer was still there with timestamps. Plenty of chat-with-your-docs demos lose this.
Friction points
  • New PDF has no way back to the conversation at 1280px
    Clicking New PDF replaces the chat with the upload drop zone, and on a 1280-wide viewport the Knowledge Sources sidebar is collapsed, so there is no visible control to return to the document you were already talking to. A reload keeps you on the upload view. A Cancel button, or leaving the sidebar open at desktop widths, fixes it.
  • The only way in is Google
    /auth offers Continue with Google and nothing else. Anyone evaluating on a work machine without a Google identity, or who simply will not grant profile scope to try a tool, bounces at the first screen.
Couldn't reach
  • second PDF upload·We opened the add-another-PDF view but did not upload a second file - one seeded document was enough to exercise the retrieval path.

7 visual changes

Step 1157,254 px changed
Before
Before
After
After
Diff
Diff
Step 2158,128 px changed
Before
Before
After
After
Diff
Diff
Step 3181,716 px changed
Before
Before
After
After
Diff
Diff
Step 4184,178 px changed
Before
Before
After
After
Diff
Diff
Step 5160,656 px changed
Before
Before
After
After
Diff
Diff
Step 665,204 px changed
Before
Before
After
After
Diff
Diff
Step 7270,691 px changed
Before
Before
After
After
Diff
Diff

Share this run

Earned · Lastest awards

Proof your app is not AI slop

LASTEST
starter
regressions
0
Badges stay live, ratchet upward, only downgrade on confirmed regression.
57,226 test runs recorded · 1,151 products tested with Lastest

This test was built for chatpdf.aadityasingh.dev — claim it free

One click copies the test and baseline screenshots into your own Lastest workspace. Re-run on every deploy and catch regressions before your users do — free, no card required.