Is Apify the Best Scraper for Sites Without RSS?

problem
#1

NewsBlur is great but we need to build our own scraper for websites that don’t support RSS. Is Apify the best tool for this? Thanks for your suggestions.

#2

I plan on supporting RSSHub soon as part of the NewsBlur Pro subscription, which will be $199/year.

2 Likes
#3

I’ve built bespoke scrapers. I should update this list. The AWS release notes feed is the busiest. The far side one has caused the most (legal) annoyance. The tindie feeds are my fave.

1 Like
#4

What about rssbridge? https://github.com/RSS-Bridge/rss-bridge

#5

With a little trial and error, I’ve found this hosted tool from FiveFilters very helpful: https://createfeed.fivefilters.org/

#6

What’s the status of NewsBlur Pro?

#7

Not for a year at least, we just launched archive and it’s still rising.

#8

With more and more sites not offering RSS or having a broken RSS feed and not caring, we had to find a solution. I wanted to let everyone know that we’re now using RSS.app and it’s very impressive. It works better than some native RSS feeds. We have already replaced a problematic Feedburner feed with a custom one using RSS.app. RSS.app has filters so you can even remove third party ads from a feed. The combination of NewsBlur’s ability to store all past articles and RSS.app to create custom RSS feeds is unbeatable. I have no idea who owns the company but I think they’re based in New York.

#9

Thanks for the Far Side one! Awesome!