How to build meta search engine
Meta Search engine is nothing but a search engine which searches more than one search engine and combines or filters the results. Each search engine has its own proprietary ranking mechanism to rank the results. When combined the search results from all leading search engines would be more informative and useful. With less page traversals we will end up our destination.
Google, Yahoo and Bing search engines are most used and provide an api to search. Call their web service API, get the results independently. Now we have 3 set of results, we need to combine or filter them. How to do that? This is the most trickiest part and it requires better algorithm.
- An open source search results clustering engine could be used to cluster the results. It has two kinds of algorithm (Lingo, STC)to cluster the results. All the above APIs has support of REST interface and it is easy to code in your desired programming language.
Most of the search engines support API to search web, news, videos, images etc. You could search based on your need. Another good use case would be, most of the companies monitor the web, social networking sites to get feedback (good and bad news) about their product, about their competitor products, search on the keyword across the searchengine, cluster the results and analyze the results for research.