Bookmarklet not picking up some sites

problem
#1

I’ve just tried to add a site using the bookmarklet. It opens correctly in page and prompts me to add the site to a folder, then comes up with this prompt.

The site in question is http://smcwilliam2.wordpress.com/ and it definitely has an RSS feed at http://smcwilliam2.wordpress.com/feed/

Any idea why it wouldn’t be picked up?

1 Like
#2

It’s because their site has this in http://smcwilliam2.wordpress.com/robo…:

This file was generated on Sun, 13 May 2012 15:56:42 +0000

User-agent: *
Disallow: /

So my robot feedfinder is dying. I went ahead and disabled the gatekeeper robots check, since I’m not a crawler. Let me know if that works now. (It should.)

1 Like
#3

Worked a treat, thanks Samuel.