How to build meta search engine

We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.

How to build meta search engine

We aggregate and tag open source projects. We have collections of more than one million projects. Check out the projects section.

Meta Search engine is nothing but a search engine which searches more than one search engine and combines or filters the results. Each search engine has its own proprietary ranking mechanism to rank the results. When combined the search results from all leading search engines would be more informative and useful. With less page traversals we will end up our destination.

Google, Yahoo and Bing search engines are most used and provide an api to search. Call their web service API, get the results independently. Now we have 3 set of results, we need to combine or filter them. How to do that? This is the most trickiest part and it requires better algorithm.

Carrot2 - An open source search results clustering engine could be used to cluster the results. It has two kinds of algorithm (Lingo, STC)to cluster the results. All the above APIs has support of REST interface and it is easy to code in your desired programming language.

Most of the search engines support API to search web, news, videos, images etc. You could search based on your need. Another good use case would be, most of the companies monitor the web, social networking sites to get feedback (good and bad news) about their product, about their competitor products, search on the keyword across the searchengine, cluster the results and analyze the results for research.

Reference:

Sponsored:
To find embedded technology information about MCU, IoT, AI etc Check out embedkari.com.

Subscribe to our newsletter.

We will send mail once in a week about latest updates on open source tools and technologies. subscribe our newsletter

Uber's open source technology stack

Uber, a taxi aggregation platform operates around the globe. It was started as monolith application and later re-architected as bunch of microservices, which gives them scalability. Uber uses lot of open source tools and they have contributed quite a lot projects back to the community. This article is about analyzing Uber's open source technology stack.

Open source projects used in LinkedIn

LinkedIn is a social network for professionals. LinkedIn handles millions of searches as well as hundreds of thousands of updates daily. They sponsored many projects to open source. Here are the list of open source products used by LinkedIn.

Open source projects used to in Wikipedia

Wikipedia is a multilingual, collaboratively edited encyclopedia. It is one of the busiest site in the world. It has more than 8 million articles and accessed by millions of users around the world. This article briefly discuss about the open source software used in Wikipedia.