Feed entries from arXiv.org incomplete, out of order

problem
#1

NewsBlur does not seem to be getting all the entries from http://export.arxiv.org/rss/astro-ph and the ones it does display are out of order.

This website updates its feed once per day with a bunch of entries all at once. Tonight there were 92 new entries in the raw rss feed but NewsBlur only showed 83 of them. The 83 were not in the right order (with no pattern that I could figure out). The missing entries were near the bottom of the original feed but were not simply the last 9 entries.

Both the website and the ios app show the same behavior.

Any ideas?

1 Like
#2

I should add that this happens every night (not just one time), with different numbers of entries missing each time (and the out-of-order always occurs).

Thanks for taking the time to look into it!

#3

I don’t think there’s anything I can do about the out-of-order. They publish the feed without timestamps, so it comes in and gets reassembled by the database.

As for the incorrect number, I loaded the feed and it showed 58 entries, and when I ran the feed fetcher it also found 58 entries. So I’m not sure what’s going on there.

#4

Thanks for checking it out.

For the ordering it looks like the feed is using inside the tag to give the sequence (http://web.resource.org/rss/1.0/spec#s5.3.5)

E.g.

http://arxiv.org/">
…
  • http://arxiv.org/abs/1701.01113" />
  • http://arxiv.org/abs/1701.01114" />
  • http://arxiv.org/abs/1701.01115" />
  • http://arxiv.org/abs/1701.01116" />

    …


    • ....


    Is this something that can be incorporated into newsblur?


    For the missing items, I'll keep an eye on it and see if it's a recurring issue.

    Thanks again!