Hello,
I have that error for one of my feeds for over a day.
In the “Fix misbehaving site” window, I have the HTTP Error (406) in the RSS/XML URL section, and in the Website URL, I have this:
Feed has no original page: No data found (404)
When using the same RSS URL in Outlook, the feeds are fetched just fine, so it indicates a problem with Newsblur and not the website itself. The URL is:
https://forums.redflagdeals.com/feed/forum/9
Any idea?
Thanks!
Hello fellow Redflagger! I came here looking to post about the same problem. I have also tried the RSS feed in Feedbro and Google Sheets without issue. I wonder if its a problem with user-agent or cloudfare like some of the other HTTP error posts.
This is a strange one! They are returning the HTTP status code 406 with no content. It’s not sniffing user agent, because my local dev install works fine. But the staging server, which is not publicly listed, also fails, which means they are likely blocking an entire IP address block.
Try reaching out to them and asking if they changed anything 2 days ago. It’s likely they checked a “Aggressively block bots” checkbox somewhere.
Thanks!
I sent them an email. I will update the thread when I hear from them.
Okay they already responded this:
“Our servers automatically block requests from IPs that send usually large amounts of requests to our web servers. This is done to prevent our services from slowing down and affecting the real visitors to the website.”
So apparently the threshold has been busted for your servers. Do you have an IP address or a range of IP that I could try to have them whitelisted?
Sure, send them https://www.newsblur.com/api/ip_addresses
Someone posted about this issue on the RFD forum and the admin has requested that you get in touch with them using the website’s contact form. Would you be willing to do that when you have time?
Forum post
https://forums.redflagdeals.com/problems-rss-feeds-2723404/
Contact form
https://www.redflagdeals.com/info/contact/
Great, I sent them this message:
Hi, I run NewsBlur, and a couple of my users alerted me about your RSS feed not working in NewsBlur. We’re getting a 406 HTTP status code, which is not something I’ve encountered before. I assume NewsBlur is being blocked because it’s fetching too often. However, we’re fetching every few minutes and if our feed fetchers see a 429, we back off and fetch less frequently.
If you like, here is a list of our IP addresses that you can whitelist: https://www.newsblur.com/api/ip_addresses/
Thanks!
Sam
Have you heard anything back from the RFD admins?
They haven’t responded. I suggest emailing them again to let them know it’s still an issue.
