Every content project used to start the same way: clicking through a client’s site page by page, copying text and saving images one at a time.
Free tools only got me part of the way: a page here, some text there, images left behind. Paid tools did the whole job, but it was a job I could build myself. So why pay for it?
So I built a scraper that crawls the whole site in a single pass. It snapshots every page, pulls down every image and every line of copy, and links all the pages together, so the result works as an active archive you can click through, mapped to the site’s real structure.
That local copy becomes the reference point for everything that follows. I can check what a page said before the rewrite, pull an asset without chasing the client for it, and feed the entire site straight into my competitive analysis.
- Real browser engine
- Built on Playwright, so JavaScript-heavy sites, lazy-loaded images and pop-ups render exactly as a visitor sees them.
- Human-paced crawling
- It scrolls, waits for content to load and varies its timing like a real visitor, so sites that turn away bots still load cleanly.
- Three formats per page
- A full-page screenshot, the raw HTML and clean Markdown, ready for AI analysis.
- Self-linking archive
- Internal links are rewritten to point at the local copy, which turns a folder of files into a site you can click through.
- Full-page snapshots
- Every image, downloaded
- Every page linked: a clickable archive
- URL and site-structure map
- Dated local snapshots




