https://blog.scrapingisnotacrime.com/ 2026-10-06 daily 1.0 https://blog.scrapingisnotacrime.com/posts 2026-10-06 daily 0.8 https://blog.scrapingisnotacrime.com/about monthly 0.5 https://blog.scrapingisnotacrime.com/privacy monthly 0.3 https://blog.scrapingisnotacrime.com/a/cameron-lynch 2026-10-06 weekly 0.7 https://blog.scrapingisnotacrime.com/a/dana-fletcher 2026-10-06 weekly 0.7 https://blog.scrapingisnotacrime.com/a/david-campbell 2026-10-06 weekly 0.7 https://blog.scrapingisnotacrime.com/a/liam-watson 2026-10-06 weekly 0.7 https://blog.scrapingisnotacrime.com/p/rate-limiting-in-web-scraping-explained-server-limits-crawl-rates-and-backoff 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/how-to-read-a-robotstxt-file-and-apply-its-rules-before-you-scrape-a-website 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/ensuring-ethical-web-scraping-how-scrapingisnotacrime-sets-the-standard-for-data-privacy 2026-08-18 monthly 0.6 https://blog.scrapingisnotacrime.com/p/debunking-myths-about-web-social-media-scraping-why-scrapingisnotacrime-is-the-smart-choice 2026-08-17 monthly 0.6