This document discusses techniques for improving caching performance at Facebook. It begins by explaining the benefits of caching for large sites and applications. It then describes the various caching layers Facebook uses, including globals caching, APC caching, memcached, and browser caching. It provides examples of how Facebook leverages these caches, such as caching parsed user agent strings, opcode caching with APC, and caching profile data in memcached. It also discusses challenges like cache invalidation between data centers and techniques for addressing them like caching proxies.
5. Complexity
Connecting to all Database is impossible
Large codebase
Scaling affects resources in many ways
‣ Memory consumption
‣ Socket connection limits
Cache retrieval is ~ 10% cpu-user of most pages
9. Globals Cache
Avoids unnecessary APC and Memcached requests
Automatic via abstraction
But still has function call cost overhead
foreach($ids as $id) {
if (isset($GLOBALS['CACHE']["profile:$id")) {
$profile = $GLOBALS['CACHE']["profile:$id"];
} else {
$profile = cache_get($id, 'profile');
}
}
10. APC
Opcode caching
‣ Hundreds of included libraries
‣ Thousands of functions
Variable caching
‣ Hundreds of MB’s of data
11. APC User Cache
Non-user specific data
‣ Network/School information
‣ Database information
‣ Useragent strings
‣ Hot application data
‣ Site variables
‣ Languange Strings
12. Friends
Normal 4050ms
APC 135ms
apc.stat=0 128ms
14. APC+SVN Client Cache Busting
function get_static_suffix($file) {
global $ROOT;
if ($version = cache_get($file, ‘sv’, 1) === null) {
$version = trim(shell_exec(“svn info $ROOT/$file | grep
‘Changed Rev’ | cut -c 19-”));
apc_store(“sv:$file”, $version);
}
return '?'.$version;
}
15. APC + Useragent Strings
Useragent string parsing is inefficient in PHP
Cache parsed useragents in APC for the first 10 minutes
Hit rate of over 50%
Pear implementation available:
‣ PEAR::Net_Useragent_Detect_APC
16. Site Variables
Enable/Disable site features across all servers
Configure memcached cluster IP’s
Configure product features
Version memcached keys for invalidation
21. Cache Multiget
Sort keys into buckets of servers foreach($keys as $key => $kdata) {
$host = get_host($key); // hash
For each server $keys_hosts[$host][$key] = $kdata;
‣ obtain connection }
‣ send requests function get_host($key) {
global $servers;
For each server
‣ read responses $prefix = $key[0].$key[1].$key[2];
$prefix = isset($servers[$prefix) ?
‣ deserialize non-scalar types $prefix : ‘wildcard’;
$hash = crc32($key);
$host = $servers[$hash %
count($servers[$prefix])];
}
22. Cache Multiget
Sort keys into buckets of servers if (isset($cache_sock[$host])) {
return $cache_sock[$host];
For each server }
‣ obtain connection
list($ip, $port) = explode(‘:’, $host);
‣ send requests
while($try < 5 && !$sock) {
For each server $sock = pfsockopen($ip, $port ...);
‣ read responses $try ++;
}
‣ deserialize non-scalar types
stream_set_write_buffer($sock, 0);
$cmd = “get $keysrn”;
fwrite($sock, $cmd);
23. Profile Multigets
Profile info
Profile installed platform applications
Viewer installed applications
Platform application data
List of friends
Privacy data
24. Cache Dispatching
cache_get_multi($ids, <key>, <miss>, $apc,
$pending=false, &$pending_arr);
cache_dispatch();
Combine requests for data from the same memcache server
‣ Up to 10% performance improvement
Execute code while the kernel buffers the memcache response
26. Lets make it even faster
Memcached PHP extension
‣ Reduced PHP function calling overhead
‣ Socket blocking in C instead of userspace PHP
‣ UDP support
27. Friends Again
Memcached extension runs ~ 10% faster realtime than in PHP userspace
Userspace 131ms
Extension 115ms
Extension w/
122ms
UDP
28. Serialization
Facebook internal serialization
‣ Profiles store 38% less memory in memcache
‣ Improves network throughput and realtime I/O
Compression
‣ Investigating LZO compression for even more space savings
29. UDP Memcached
TCP Limitations
‣ Maximum simultaneous connect count of ~ 250k
‣ Impedes scalability of memcached clusters
Requires a very stable network environment
Occasional misses are acceptible
Reduces kernel buffer memory usage on clients and servers
Supported in Facebook Memcache Extension coming soon
30. A Dirty Problem
Wrapper functions
‣ cache_dirty($id, $key);
Actively dirty cache entries as users change data
Dirty entries between multiple hosting facilities via proxy
32. Latency
Proxy deletes only work with low latency between facilities
When facilities are further apart deletes need to be smarter
5"6 /"78"7
92%$&"
!./0+
!"#$%$&"' ()
+%,"-$.
!./0+
1"234$%
!"#$%$&"' (*