Why You Should Not Discard Rare Facts

If you perform a search about a subject, and create a frequency histogram words or facts found about such a subject, you will discover that the histogram looks like the following.  The subject current position within an organization will have high frequency, as well as, the organization the subject works for.  These facts, will overshadow many facts about the subject.  

f1..f9 represent facts

In many cases, a fact or a news can overshadow all other facts or news about a subject.  For instance, in February 2010, the production of SAW over shadowed any other facts about Mark Burg, producer of SAW and Two And Half Men.  Low frequency facts were totally lost in the midst of more frequently reported facts.  Mark Burg tight relationship with Oren Koules was lost amid SAW news.


So, what make a fact low frequency?  Low frequency facts are facts that the public or the press was not aware of, or did not see their relevance.  When trying to understand a subject, any fact when mixed with other facts can bring knowledge.  For instance, ex-Gov. Haley Barbour knows Newt Gingrich, this is a fact supported by 375,000 websites.  

Mr. Barbour, as a lobbyist, was well known to work for Tobacco industry.  In 1997, Barbour met with Newt Gingrich, the next day, Mr. Gingrich tried to pass a bill to reduce taxes on Tobacco firms.  Fortunately, the congress crashed the gift before it became a reality;  At that instance, journalists came to the conclusion that the meeting between Barbour and Gingrich was on behalve of the tobacco industry.  This fact is scattered through 540 websites.  Finding it, implies one will put Barbour, Gingrich, and Tobacco together and create a query.  A pin in the hay stock, but an important pin, as it shows Mr. Barbour power of negotiation.

So, the question is how to "stir" the search engines to find the gold?