https://blog.scrapingisnotacrime.com/ 2026-10-07 daily 1.0 https://blog.scrapingisnotacrime.com/posts 2026-10-07 daily 0.8 https://blog.scrapingisnotacrime.com/about monthly 0.5 https://blog.scrapingisnotacrime.com/privacy monthly 0.3 https://blog.scrapingisnotacrime.com/a/cameron-lynch 2026-10-07 weekly 0.7 https://blog.scrapingisnotacrime.com/a/cassandra-long 2026-10-07 weekly 0.7 https://blog.scrapingisnotacrime.com/a/david-campbell 2026-10-07 weekly 0.7 https://blog.scrapingisnotacrime.com/a/ian-norris 2026-10-07 weekly 0.7 https://blog.scrapingisnotacrime.com/a/sydney-griffin 2026-10-07 weekly 0.7 https://blog.scrapingisnotacrime.com/p/robots-meta-tags-x-robots-tag-and-tdm-reservations-opt-out-signals-explained 2026-10-07 monthly 0.6 https://blog.scrapingisnotacrime.com/p/keywords-hashtags-or-account-lists-choosing-how-to-sample-public-social-media-data 2026-10-07 monthly 0.6 https://blog.scrapingisnotacrime.com/p/how-to-test-a-scraper-against-saved-pages-before-running-it-on-a-live-site 2026-10-07 monthly 0.6 https://blog.scrapingisnotacrime.com/p/scraper-maintenance-eating-your-teams-time-where-the-hours-go-and-how-to-cut-them 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/how-to-deduplicate-scraped-records-keys-normalization-and-near-duplicate-checks 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/copyright-and-database-rights-in-scraped-data-the-key-terms-explained 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/7-questions-to-answer-before-collecting-public-social-media-data-for-research 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/browser-extensions-no-code-tools-frameworks-or-a-managed-service-choosing-how-to-scrape 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/how-to-use-a-websites-xml-sitemap-to-plan-a-scraper-instead-of-crawling-every-link 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/how-to-read-a-websites-terms-of-service-before-you-scrape-it-a-practical-guide 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/planning-a-competitor-price-monitoring-project-a-hypothetical-retailer-step-by-step 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/6-myths-about-collecting-public-personal-data-under-the-gdpr-and-ccpa 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/scraper-returning-empty-fields-common-causes-and-how-to-fix-each-one 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/9-data-quality-checks-to-run-on-every-scraped-dataset-before-you-use-it 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/official-apis-vs-scraping-public-pages-for-social-media-data-how-to-choose 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/rate-limiting-in-web-scraping-explained-server-limits-crawl-rates-and-backoff 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/how-to-read-a-robotstxt-file-and-apply-its-rules-before-you-scrape-a-website 2026-10-06 monthly 0.6 https://blog.scrapingisnotacrime.com/p/ensuring-ethical-web-scraping-how-scrapingisnotacrime-sets-the-standard-for-data-privacy 2026-10-09 monthly 0.6 https://blog.scrapingisnotacrime.com/p/debunking-myths-about-web-social-media-scraping-why-scrapingisnotacrime-is-the-smart-choice 2026-10-09 monthly 0.6