We made a minor change to the statistics engine over the last couple of days that should hopefully improve the daily ranks and counts.
If you happened to view the statistics Wednesday or Thursday morning, you may have noticed that there were some topics that seemed out of place. For instance "Iran" (+nuclear) was down approx 2800% with zero instances in the news.
This oddity was a result of our statistics engine capturing fresh news stories too early in the day.
Right now, we're a little limited in the information we can capture but we're working on implementing we've implemented a more frequent scanning system for the current phase so that we can keep the graphs fresher throughout the day until Phase 2 is available.
Also, we're working on coming up with some sort of dashboard view for the home page of the site. It seems as though the main page is a little bit long alread with only 8 terms.
We have a couple of concept dashboards in the works and would like to hear your thoughts on what information you would like to see at a glance on the home page.
Some Random Information:
Total Webpages In Database: 41,333
Webpages Excluded from Results: 16,193*
Webpages Returning HTTP Errors: 1,658
* Webpages excluded include those missing the given term, having an unknown date (working on this), or returning HTTP errors.