The news service provided by Speeple has been indexing content for over a year and half now and in this post I will outline some basic statistics.

• 80000+ XML news feeds (72% RSS 2.0, RSS 0.91 14% and 1.4% Atom 1.0)

• News in 50+ languages, top 5 languages:

  1. English - 60%
  2. German - 8%
  3. Spanish - 5.5%
  4. Chinese - 5%
  5. Russian - 4.6%
• 37+ million news items indexed (150+ thousand added daily)
• 1.2+ million unique tags

The news crawler retrieves 8000+ news items per hour, taking 0.5 hours to process the full feed list.