In this video· click a step to jump to it
Test recording
ChatPDF — app walkthrough
129,772 ms · 1,177,827 pixels changed
We built this regression test for chatpdf.aadityasingh.dev — it's yours to keep, free.
Take this test with you
This is a real Playwright test, recorded against chatpdf.aadityasingh.dev. Claim it into your own workspace and re-run it on every deploy — free.
export async function test(page, baseUrl, screenshotPath, stepLogger) {
const Q1 = 'What is the default screenshot comparison threshold, and how long are videos retained?';
const Q2 = 'What is the support email, and what is the average first response time on the Team plan?';
const Q3 = 'Which browsers are supported, and what licence is the platform released under?';
let n = 0;
const shot = async (slug) => {
n += 1;
await page.waitForTimeout(700);
await page.screenshot({ path: `${screenshotPath}/Step_${n}_${slug}.png`, fullPage: true });
stepLogger.log('captured ' + slug);
};
const ask = async (q, slugTyped, slugAnswered) => {Checks run
Notes from the demo run
AI-generatedWe signed in to ChatPDF with Google, uploaded a three-page product spec, and then asked it three questions it could only answer from that document. It got all three right and quoted the exact figures: the 0.1 percent screenshot threshold, the 30-day video retention, the support address and the 4-hour Team-plan response time. The RAG pipeline is doing its job, and the answers are short and quotable rather than padded. The whole loop from Google sign-in to a grounded answer took under two minutes.
- The answers are grounded and terseThree questions, three exact quotes from the document, no hedging preamble and no invented detail. That is the hard part of a RAG product and you have it working.
- The limits are stated before the upload, not after'PDF only, max 5MB, max 50 pages' sits inside the drop zone, so nobody discovers the ceiling by having an upload rejected.
- The transcript survives a reloadWe reloaded mid-session and every question and answer was still there with timestamps. Plenty of chat-with-your-docs demos lose this.
- New PDF has no way back to the conversation at 1280pxClicking New PDF replaces the chat with the upload drop zone, and on a 1280-wide viewport the Knowledge Sources sidebar is collapsed, so there is no visible control to return to the document you were already talking to. A reload keeps you on the upload view. A Cancel button, or leaving the sidebar open at desktop widths, fixes it.
- The only way in is Google/auth offers Continue with Google and nothing else. Anyone evaluating on a work machine without a Google identity, or who simply will not grant profile scope to try a tool, bounces at the first screen.
- second PDF upload·We opened the add-another-PDF view but did not upload a second file - one seeded document was enough to exercise the retrieval path.
7 visual changes
Share this run
Proof your app is not AI slop
This test was built for chatpdf.aadityasingh.dev — claim it free
One click copies the test and baseline screenshots into your own Lastest workspace. Re-run on every deploy and catch regressions before your users do — free, no card required.




















