Hacker News new | past | comments | ask | show | jobs | submit login

That's... the whole point.



And it's an invalid point. Scraping prevention is the most stupid thing Cloudflare has ever done, and that's after a very long list.


It’s not an invalid point. Setting aside Government and business services, you aren’t morally entitled to clean, uninterrupted access to any random website. If a webmaster chooses to make your life difficult for any reason, that’s entirely their prerogative.


I'm saying anti-scraping is a misconception and if you buy it (or get one for free) you just paid for a placebo and it's also worse than nothing. Is there anything confusing about this?


I don't want you scraping my sites, and I can see the hundred of thousands of requests from scrapers/bots blocked by Cloudflare. Seems like it works here.


If it's a misconception, why did you complain that Cloudflare caused you "a really hard time making a web scraper"?


You just confused me with someone else. Cloudflare gives me a hard time as a user only. When you view a page with a proxy or shared IP address, you have to solve a captcha or enable JS to see any text with @ in it, and such insanities. Scraping is a user use case. Web crap is meant to be automateable and automatically navigible (though as a cattle user who sees it as an interactive one time experience, like someone walking into a shop, I can see how you see otherwise). Anyway it's easy to scrape even with Cloudflare, it just causes more bumps and adds to your fingerprint and makes the internet as a whole more insecure.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: