Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Pelikan: Twitter's unified cache back end (twitter.github.io)
82 points by myautsai on April 10, 2016 | hide | past | favorite | 6 comments


How does Pelikan cache compare to memcached/redis/...?

We envision Pelikan to have significant overlap, in terms of functionality, with many popular cache server implementations. After all, we are aiming to replace our use of Memcached (Twemcache) and Redis at Twitter with Pelikan. However, Pelikan is not a strict superset or subset of any of them. Without trying to be comprehensive, here are some notable similarities and differences:

* pelikan_twemcache fully replaces twemcache, and supports most of the commands specified by the memcached ASCII/text protocol. However, unlike memcached, pelikan_twemcache only has one worker thread per instance. * pelikan_redis (in progress) will support a subset of data structures provided by Redis. However, we have no plan to add features such as master/slave replication, message queue, or on-disk data persistence. We also will manage memory using slabs/items instead of directly relying on external memory allocators. * All binaries come with the ability to log each command for traffic analysis, which are not part of Memcached or Redis. * pelikan_slimcache implements cuckoo hashing to store bounded-sized key/value pairs with minimum (~6-byte) overhead. * Pelikan enforces the separation of data-plane and control-plane functionalities by using separate threads; further more, server and worker run on different threads as well, and there are no locks anywhere in our system.


How Pelikan is used in Twitter's datacenter: http://twitter.github.io/pelikan/2016/04/03/caching-in-datac...



One of the team members ported Redis to Rust lang https://github.com/seppo0010/rsedis


I'd settle for a memcached ppa


There's a popular static site generator called Pelican.

https://github.com/getpelican/pelican




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: