How to Deduplicate Scraped Records: Keys, Normalization and Near-Duplicate Checks
Duplicate rows inflate every count built on scraped data. A seven-step method to define duplicates, choose keys, normalize URLs an...
C
Author
Cassandra Long
2 Posts
9 Data Quality Checks to Run on Every Scraped Dataset Before You Use It
Schema, null rates, duplicates, units, ranges and drift: nine checks that catch the silent errors scraped data picks up between th...