The web, with its low barrier to entry and permeable social boundaries, is the ultimate medium through which to explore the finer points of the wisdom of crowds.
You need a few things to enable online crowds to be wise.
SimplicitySystems based on the Wisdom of Crowds can tackle surprisingly complicated projects, but each project must first be broken down to its simplest possible components.
One of the reasons discussions do not lead to wise results is that there’s no aggregation—the conversation just happens. But WOC systems are there to produce a result. This requires an aggregator (like you) and an algorithm.
A defining element of any WOC system is that the more participants it has, the better it gets. Discussion systems and chat rooms fall apart when too many voices get involved. If your community feature gets worse the more people use it, it’s not a WOC system.
It’s counter-intuitive, but the wisest crowds are the ones made up of individuals who are thinking about their own needs, not the needs of the group.
Leaderboards create a problem for Wisdom of Crowds systems. How you display the wisdom of your crowd can be as important as how you ask for it in the first place.
In working on your own WOC systems, pay attention to when you can glean implicit feedback without having to ask for it directly.