Hacker News new | past | comments | ask | show | jobs | submit login
Tell HN: Craigslist seems to have removed its RSS feeds
19 points by JeremyNT on Oct 20, 2020 | hide | past | favorite | 11 comments
Craigslist has, since very early on, supported RSS feeds for searches[0]. Over time this feature has been more or less reliable, with some occasional (seemingly accidental) breakage that was eventually resolved.

In recent years I observed issues retrieving feeds from certain IP ranges (perhaps due to rate limiting / blacklisting some service providers), but found that switching to another source IP would always resolve the issue.

Now, all of my own searches result in 410 (Gone) responses. Of their sample feeds, only "Best of" still functions, the rest 404.

[0] https://www.craigslist.org/about/rss




I very infrequently use Craigslist, but as a coincidence I just started looking for something as this HN submission came out. I had it in the back of my mind to set up some feeds; I was moments away from finding out first-hand that the feature is not there when I spotted this story on HN.

With this dumb move, Craigslist has become monumentally less usable.

Craigslist was my main use case for RSS. I would set up complex searches, "RSS them", and just watch items drip into the mail-inbox-like UI abstraction of the feed reader. I could browse the items. Mark them read and unread, like e-mails. I could delete unwanted items and thereby make them disappear forever. The items are beautifully condensed in a tight list view.

None of this is possible with the regular Craiglist web UI. Repeat the same search and the same crap is there.

I noticed the e-mail alerts feature next to the search box, so I created an account to try it out.

It works sporadically; the e-mails are not timely. It takes hours and hours to report on a new item. If it's something hard to find and in demand, someone will snag it before you. RSS refresh intervals can be tuned, like once an hour or whatever, and they execute exactly as specified.

It reported a few new items. But now, I just received an e-mail from it which regurgitated sixty old items, which existed long before the time before I created the alert for the very search which found those items.

Pretty useless. Phooey!


I miss the days when RSS was just about everywhere. You’d add a feed to your blog reader and have a convenient format just fetched for you when you wanted. Now you have to hope that the social media algorithms show you your favorite blogs are updated and see it in the noise.


Whilst it's a little less common - I've found that most of the sites that I enjoy reading still have an RSS feed.

Those that don't, typically have some sort of email newsletter - at least with Feedbin you have your own email address that receives the newsletters and shows them in your feed, which I find to be a fairly decent way of keeping up with my favourite non RSS sites.



It's because people use those feeds commercially to their own ends. And craigslist has been a really good/ethical service imo as far as I know. I first noticed when they got rid of the job feeds many many moons ago. It broke my codeignitor job site aggregator, made before indeed. Now I don't think any of craigslist/hotjobs/monster/careerbuilder have RSS?


The commercial endeavors will happily switch to just web scraping. This doesn't hurt anyone but the end-users (it was super useful to have an RSS feed of a specific search with parameters if you were hunting for an apartment, for example, which would then notify you on your phone with an RSS reader app).


Some sites at least detect scraping and make it a little harder, but if people are doing it, must have some effect and more than to just the end-user down the line. If you are just completely bypassing a site to read text on your phone in an unrelated app, how do you expect that service to survive?


You realize CL doesn't have ads in the first place right? It makes no difference to them, revenue-wise, whether I read their content in a web browser or in an RSS feed -- if anything, I'm saving them bandwidth. They make money by charging for making posts in certain categories in certain locations.


Traditional ads aren't the only form of revenue. All I'm saying is that by bypassing the site completely people maybe aren't helping them survive, which could just be what the market decides and we need a craigslist full of ads, wikipedia too.

https://www.craigslist.org/about/help/paid_posting_accounts


Back to beautifulsoup


Too bad :-/




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: