zshot/cliDownload

--crawl-deny-url

ValueGLOB
LicensePRO

Skip URLs matching this glob during a sitemap walk or link crawl. Repeatable. Re-permit individual matches with --crawl-allow-url, which wins over deny.

Example

zshot -t warc -f site.warc.gz --crawl-url-is-sitemap xml \
  --crawl-deny-url "*/admin/*" https://example.com/sitemap.xml