Comments on: Web Scraping for Me, But Not for Thee (Guest Blog Post) https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm Fri, 01 Sep 2023 11:41:35 +0000 hourly 1 By: We Love the Internet 2023/35: The End of the googleverse edition | Curiously Persistent https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-4012 Fri, 01 Sep 2023 11:41:35 +0000 https://blog.ericgoldman.org/?p=25442#comment-4012 […] Web Scraping for Me, But Not for Thee […]

]]> By: AI #27: Portents of Gemini | Don't Worry About the Vase https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-4010 Thu, 31 Aug 2023 12:33:11 +0000 https://blog.ericgoldman.org/?p=25442#comment-4010 […] Web scraping for me but not for thee, all the major players are both scraping the entire web and suing to prevent anyone from scraping them in return. […]

]]> By: c1ue https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-4009 Wed, 30 Aug 2023 15:59:00 +0000 https://blog.ericgoldman.org/?p=25442#comment-4009 This isn’t rocket science. Anyone wanted to scrape, needs to do the homework of setting up a large network of people who do it for them – or at least license their legitimate access.
These big scrapers were just lazy – sending millions and billions of requests from an easily identifiable set of access IPs.

]]> By: Web Scraping Hypocrisy | mtanenbaum https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-4003 Tue, 29 Aug 2023 12:48:23 +0000 https://blog.ericgoldman.org/?p=25442#comment-4003 […] Credit: Professor Eric Goldman […]

]]> By: patrickamsterdam https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-4002 Mon, 28 Aug 2023 12:32:00 +0000 https://blog.ericgoldman.org/?p=25442#comment-4002 In reply to The Smart Factory.

Yes you can already do that via robots.txt file

]]> By: Tobi z_z https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-4000 Sun, 27 Aug 2023 12:16:00 +0000 https://blog.ericgoldman.org/?p=25442#comment-4000 Data is information stored in a digital way. Scraping, is simply collection of public information.

Companies have no right on seeking lawful orders to deny other companies to make use of this public information.

In fact, by trying to limit access to public information, they are breaking the Right to Information law, which is a fundamental right for the improvement of society.

]]> By: The Smart Factory https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-3999 Sat, 26 Aug 2023 20:55:00 +0000 https://blog.ericgoldman.org/?p=25442#comment-3999 Can’t a website just put a single line of code that scrapers respect to stop scrapping?

]]> By: Friday assorted links - Marginal REVOLUTION https://blog.ericgoldman.org/archives/2023/08/web-scraping-for-me-but-not-for-thee-guest-blog-post.htm#comment-3989 Fri, 25 Aug 2023 16:03:09 +0000 https://blog.ericgoldman.org/?p=25442#comment-3989 […] 2. Web scraping for me but not for thee. […]

]]>