Open source projects used in LinkedIn
LinkedIn is a social network for professionals. It is built using open source products. They sponsored many projects to open source. Here are the list of open source products used by LinkedIn.
Programming language: LinkedIn uses C++, Java, Scala, Python and Ruby.
Hadoop is a framework for running applications on large clusters built of commodity hardware. http://hadoop.apache.org/
Azkaban is simple batch scheduler for constructing and running Hadoop jobs or other offline processes. It is a workflow system for Hadoop which allows a program to be built out of small reusable pieces that need not know about one another. By declaring dependencies, you can control sequencing. http://sna-projects.com/azkaban/
Pig is a high-level data-flow language and execution framework for parallel computation. http://pig.apache.org/
Zoie is a real-time search and indexing system built on Apache Lucene. http://sna-projects.com/zoie/
Bobo is a Faceted Search implementation in Java, an extension of Apache Lucene. http://sna-projects.com/bobo/
Sensei is a distributed, elastic, realtime, searchable database. It is designed to handle billions of rows. http://sna-projects.com/sensei/
ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. http://zookeeper.apache.org/
Netty provides an asynchronous event-driven network application framework and tools. It is a NIO client server framework which enables quick and easy development of network applications such as protocol servers and clients. http://www.jboss.org/netty
Norbert is a library that provides easy cluster management and workload distribution. It is implemented in Scala. It helps to create a highly scalable architecture capable of handling heavy traffic. http://sna-projects.com/norbert/
Voldemort is a distributed key-value storage system. It is highly scalable as the data gets automatically replicated and partitioned across servers. http://project-voldemort.com/
kafka is a distributed publish/subscribe message queue system. http://sna-projects.com/kafka/
Kamikaze is a utility package for performing operations on compressed arrays of sorted integers. Search indexes, graph algorithms, and certain sparse matrix representations make heavy use of integer arrays, and special compression techniques are needed to get good compression performance on this data. http://sna-projects.com/kamikaze/
Krati is a simple persistent data store with very low latency and high throughput. It relies on hash-based indexing which is suitable for random reads and writes. http://sna-projects.com/krati/
comments powered by Disqus
Wikipedia is a multilingual, collaboratively edited encyclopedia. It is one of the busiest site in the world. It has more than 8 million articles and accessed by millions of users around the world. This article briefly discuss about the open source software used in Wikipedia.
Twitter uses many open source products and also contributes most of the code to open source. Here is the list of open source products used by Twitter. This list does not include the projects sponsored by twitter.
Facebook a leading social networking website predominantly uses open source technologies to build its application. Here is the list of open source products used and contributed by Facebook.
Pinterest is a tool for collecting and organizing things you love. It is a social networking site where users could pin images and write a note for that. It is now currently serving billions of pages every month. Check out the open source products used in Pinterest.
SourceForge.NET is most popular and widely used Forge. It helps to host software projects. It has integrated support for Wiki, Forum, Tracker and Full text search. The code base named allura, is completely built on open source stack. This article explains few important one used to build SourceForge.NET.
Zimbra is a Enterprise messaging and collaboration software. It is a good alternative to Microsoft Exchange server. Zimbra is a Email Server but they have not written anything related to SMTP server, rather they have integrated well know open source email server in to its package. Zimbra is a system of well connected / integrated multiple open source software which delivers enterprise quality to it. This article explains most important components which helps to build the enterprise product.
Tumblr is a microblogging platform that allows users to effortlessly share anything. Tumblr now hosts over 70 million blogs with over 34 billion posts to date. Below is the list of open source used in Tumbler.
Magnolia CMS is one among popular java based CMS. It has support of CMS, DMS, Wiki, Forum and lot more features. This article discusses about the open source software used to build Magnolia CMS.
opentaps Open Source ERP + CRM, is a fully integrated application suite that supports eCommerce, Customer Relationship Management, Warehouse and Inventory Management, Supply Chain Management, and Financial Management to Business Intelligence and mobility integration out-of-the-box. This article discusses about the open source software used to build Opentaps ERP.
Barack Obama election fundraising campaign was hosted online and the platform was built using open source products. The campaign stayed for 6 months and it has more than 8 million page views. This article explains the open source products used to build the platform.