A high-throughput, persistent, distributed, publish-subscribe messaging system based on memory mapped file and Thrift RPC. 
Its design objectives are: 
<ol>
<li>Fast: close to the speed of direct memory access, both produding and consuming are close to O(1) memory access.</li>
<li>Persistent : all data in the system is persisted on disk and is crash resistant.</li>
<li>High-throughput: even with modest hardware Luxun can support handreds of thousands of messages per second.</li>
<li>Realtime : messages produced by producer threads should be immediately visible to consumer threads.</li>
<li>Distributed : explicit support for partitioning messages over Luxun servers and distributing consumption over a cluster of consumer machines while maintaining per-partition ordering semantics.</li>
<li>Multiple clients support : use <a href="http://thrift.apache.org/">Thrift RPC</a> as communication infrastructure, easy to generate different clients for different platforms.</li>
<li>Flexible consuming semantics : supports typical consume once queue, fan out queue, even supports consume by index when needed.</li>
</ol>

A high-throughput, persistent, distributed, publish-subscribe messaging system based on memory mapped file and Thrift RPC.

Luxun - A high-throughput, persistent, distributed, publish-subscribe messaging system based on memo

Discover open source projects across all platforms

Projects

Luxun - A high-throughput, persistent, distributed, publish-subscribe messaging system based on memo

TechStack

Tagcloud

License

Suggested keywords:

Projects

Luxun - A high-throughput, persistent, distributed, publish-subscribe messaging system based on memo

TechStack

Tagcloud

License