Scribd
Upload
785 views49 pages

Caching For Performance

This document discusses using caching techniques to improve website performance. It begins by demonstrating how to use the siege tool to measure performance of PHP pages with and without database queries. It then shows how to use Xdebug to profile pages and identify slow parts of code. The document recommends caching the output of PHP code, such as by wrapping database queries in caching, to avoid executing the same code repeatedly. It also recommends caching entire pages using Zend Cache or similar tools. By caching to memory using memcached rather than disk, performance can be further improved by accessing data from a faster storage layer. In summary, the document provides guidance on using profiling, output caching, and page caching to optimize website performance through caching strategies.

Uploaded by

kaplumb_aga
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
785 views49 pages

Caching For Performance

This document discusses using caching techniques to improve website performance. It begins by demonstrating how to use the siege tool to measure performance of PHP pages with and without database queries. It then shows how to use Xdebug to profile pages and identify slow parts of code. The document recommends caching the output of PHP code, such as by wrapping database queries in caching, to avoid executing the same code repeatedly. It also recommends caching entire pages using Zend Cache or similar tools. By caching to memory using memcached rather than disk, performance can be further improved by accessing data from a faster storage layer. In summary, the document provides guidance on using profiling, output caching, and page caching to optimize website performance through caching strategies.

Uploaded by

kaplumb_aga
Copyright
© Attribution Non-Commercial (BY-NC)
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 49

Caching for

performance
Rob Allen
Rob Allen?

DPC ’09 Rob Allen http://akrabat.com


Caching for
performance?

DPC ’09 Rob Allen http://akrabat.com


Measuring performance

DPC ’09 Rob Allen http://akrabat.com


Siege
http://www.joedog.org/index/siege-home

edit ~/.siegerc
verbose = false
logging = false or logfile=~/siege.log
concurrent = 5
benchmark = true

DPC ’09 Rob Allen http://akrabat.com


Running siege
siege -t 30s http://localhost/info.php

Time based: -t NUMx where x = S,M or H


Request based: -r NUM

Add -c NUM for the number of concurrent users

DPC ’09 Rob Allen http://akrabat.com


Siege output for info.php
$siege -t 30s http://localhost/info.php
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 26241 hits
Availability: 100.00 %
Elapsed time: 29.45 secs
Data transferred: 1491.16 MB
Response time: 0.01 secs
Transaction rate: 891.04 trans/sec
Throughput: 50.63 MB/sec
Concurrency: 4.99
Successful transactions: 26241
Failed transactions: 0
Longest transaction: 0.04
Shortest transaction: 0.00

DPC ’09 Rob Allen http://akrabat.com


Siege output for info.html
$siege -t 30s http://localhost/info.html
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 233746 hits
Availability: 100.00 %
Elapsed time: 29.45 secs
Data transferred: 10228.57 MB
Response time: 0.00 secs
Transaction rate: 7937.05 trans/sec
Throughput: 347.32 MB/sec
Concurrency: 4.91
Successful transactions: 233746
Failed transactions: 0
Longest transaction: 1.08
Shortest transaction: 0.00

DPC ’09 Rob Allen http://akrabat.com


A “real” page
• Zend Framework website
• Some CSS and images!
• Zend_Application
• View uses Zend_Layout
• Zend_Db_Table

DPC ’09 Rob Allen http://akrabat.com


Siege output
for a real-world page
$siege -t 30s http://localhost/places/public/
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 375 hits
Availability: 100.00 %
Elapsed time: 30.13 secs
Data transferred: 1.88 MB
Response time: 0.40 secs
Transaction rate: 12.45 trans/sec
Throughput: 0.06 MB/sec
Concurrency: 4.94
Successful transactions: 375
Failed transactions: 0
Longest transaction: 1.60
Shortest transaction: 0.15

DPC ’09 Rob Allen http://akrabat.com


Profiling

DPC ’09 Rob Allen http://akrabat.com


Xdebug profiler
http://www.xdebug.org

Ouput file format compatible with:


• KCachegrind (Linux)
• WinCacheGrind (Windows)
• MacCallGrind (OS X)
• WebGrind (PHP)

DPC ’09 Rob Allen http://akrabat.com


Xdebug profiler
php.ini:
xdebug.profiler_enable = 0
xdebug.profiler_enable_trigger = 1
xdebug.profiler_output_dir = "/Users/rob/xdebug"

Enable per request:


http://localhost/places/public/?XDEBUG_PROFILE=1

DPC ’09 Rob Allen http://akrabat.com


Simple example
<?php
function onesecond() {sleep(1);}
function twoseconds() {sleep(2);}
function threeseconds() {sleep(3);}
function fourseconds() {sleep(4);}
onesecond();
twoseconds();
threeseconds();
fourseconds();

http://localhost/profiletest.php?XDEBUG_PROFILE=1

DPC ’09 Rob Allen http://akrabat.com


Webgrind display Time to run this
Number of times called Time to run function and every
this function function it calls

DPC ’09 Rob Allen http://akrabat.com


Look for:
• Functions with unexpectedly large call counts
• Functions with large self-times
• Unexpected calls to functions

DPC ’09 Rob Allen http://akrabat.com


Real-world example

DPC ’09 Rob Allen http://akrabat.com


Principles of caching
1. Donʼt execute code unless you need to
2. Get data from the fastest place you can
3. Donʼt get the same data twice
Save the output of
PHP code
AKA Donʼt execute code unless you need to
Code caching

DPC ’09 Rob Allen http://akrabat.com


The current code
public function fetchLatest($count = 50)
{
$rows = $this->fetchAll(null,'date_created DESC', $count);
$rows = $rowset->toArray();
foreach($rows as &$row) {
$row['numberOfReviews'] = $this->numReviews($row['id']);
}
return $rows;
}

DPC ’09 Rob Allen http://akrabat.com


Adding a cache
Many choices: Zend_Cache, PEAR::Cache_Lite,
ezcCacheManger and others

1. Set up the cache


2. Wrap cache loading around database query
3. Thatʼs it!

DPC ’09 Rob Allen http://akrabat.com


Zend_Cache set-up
function _initCache($cacheDir)
{
$frontendOptions = array(
'lifetime' => '7200',
'automatic_serialization'=>true);
$backendOptions = array(
'cache_dir' => $cacheDir);
$cache = Zend_Cache::factory('Core', 'File',
$frontendOptions, $backendOptions);
return $cache;
}

DPC ’09 Rob Allen http://akrabat.com


Zend_Cache in use
public function fetchLatest($count = 50)
{
Unique id
$cacheId = 'latestNews_'.$count;
$rows = $this->_cache->load($cacheId);
if ($rows === false) {
$rows = $this->fetchAll(null,'date_created DESC', $count);
$rows = $rowset->toArray();
foreach($rows as &$row) {
$row['numberOfReviews'] = $this->numReviews($row['id']);
}
$this->_cache->save($rows, $cacheId, array('places'));
}
return $rows; Re-use
}
Tag existing
Store to cache code
DPC ’09 Rob Allen http://akrabat.com
Re-profile

DPC ’09 Rob Allen http://akrabat.com


Siege output
for code cached real page
$siege -t 30s http://localhost/places/public/
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 875 hits
Availability: 100.00 %
Elapsed time: 29.80 secs
Data transferred: 4.51 MB
Response time: 0.17 secs
Transaction rate: 29.36 trans/sec
Throughput: 0.15 MB/sec
Concurrency: 4.97
Successful transactions: 875
Failed transactions: 0
Longest transaction: 3.73
Shortest transaction: 0.06

DPC ’09 Rob Allen http://akrabat.com


Emptying Zend_Cache
public function cleanCacheByTag($tag)
{
return $this->_cache->clean(
Zend_Cache::CLEANING_MODE_MATCHING_TAG,
array($tag));
}

public function cleanAllCache()


{
return $this->_cache->clean(Zend_Cache::CLEANING_MODE_ALL);
}

DPC ’09 Rob Allen http://akrabat.com


Page caching
Why stop at just the database?
Letʼs cache the entire page!

DPC ’09 Rob Allen http://akrabat.com


Setup a page cache
function usePageCache($cacheDir)
{
$frontendOptions = array(
'lifetime' => 3600,
'default_options' => array('cache' => false),
'regexps' => array(
'^/$' => array('cache' => true),
'^/places/' => array('cache' => true),
));
$backendOptions = array('cache_dir' => $cacheDir);
$cache = Zend_Cache::factory('Page', 'File',
$frontendOptions, $backendOptions
);
$cache->start();
return $cache;
}

DPC ’09 Rob Allen http://akrabat.com


Siege output
for a page cache
$siege -t 30s http://localhost/places/public/
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 10738 hits
Availability: 100.00 %
Elapsed time: 29.90 secs
Data transferred: 29.27 MB
Response time: 0.01 secs
Transaction rate: 359.13 trans/sec
Throughput: 0.98 MB/sec
Concurrency: 4.94
Successful transactions: 10738
Failed transactions: 0
Longest transaction: 1.46
Shortest transaction: 0.00

DPC ’09 Rob Allen http://akrabat.com


Profile or a page cache
f

DPC ’09 Rob Allen http://akrabat.com


Choose the right
storage layer
AKA Get data from the fastest place you can
Where is your cache?

DPC ’09 Rob Allen http://akrabat.com


memcached
Cache to memory rather than disk.
memcached server:
./configure && make && make install
memcached -d -l 10.0.148.121 -m 512
PECL memcache extension:
pecl install memcache
php.ini:
extension=memcache.so

DPC ’09 Rob Allen http://akrabat.com


Zend_Cache set-up
function _initCache($cacheDir)
{
$frontendOptions = array(
'lifetime' => '7200',
'automatic_serialization'=>true);
$backendOptions = array(
'servers' => array(array('host' => '10.16.148.121')));
$cache = Zend_Cache::factory('Core', 'Memcached',
$frontendOptions, $backendOptions);
return $cache;
}

DPC ’09 Rob Allen http://akrabat.com


Siege output
for memcached code cached page
$siege -t 30s http://localhost/places/public/
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 1824 hits
Availability: 100.00 %
Elapsed time: 30.29 secs
Data transferred: 4.97 MB
Response time: 0.08 secs
Transaction rate: 60.22 trans/sec
Throughput: 0.16 MB/sec
Concurrency: 4.99
Successful transactions: 1824
Failed transactions: 0
Longest transaction: 2.88
Shortest transaction: 0.00

DPC ’09 Rob Allen http://akrabat.com


Donʼt forget that PHP
is interpreted...
AKA: Donʼt execute code unless you need to
Op-code caching
Cache your php byte code using APC, Zend
Optimizer+, XCache, eAccelerator, etc...

APC:
pecl install apc
php.ini:
extension=apc.so

DPC ’09 Rob Allen http://akrabat.com


Siege output
for real page (no other caching) & APC
$siege -t 30s http://localhost/places/public/
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 574 hits
Availability: 100.00 %
Elapsed time: 29.42 secs
Data transferred: 3.14 MB
Response time: 0.25 secs
Transaction rate: 19.51 trans/sec
Throughput: 0.11 MB/sec
Concurrency: 4.96
Successful transactions: 574
Failed transactions: 0
Longest transaction: 1.05
Shortest transaction: 0.10

DPC ’09 Rob Allen http://akrabat.com


Siege output
for code cached page with APC
$siege -t 30s http://localhost/places/public/
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 8766 hits
Availability: 100.00 %
Elapsed time: 30.25 secs
Data transferred: 23.89 MB
Response time: 0.02 secs
Transaction rate: 289.65 trans/sec
Throughput: 0.79 MB/sec
Concurrency: 4.98
Successful transactions: 8766
Failed transactions: 0
Longest transaction: 0.63
Shortest transaction: 0.00

DPC ’09 Rob Allen http://akrabat.com


Siege output
for a page cache with APC
$siege -t 30s http://localhost/places/public/
** SIEGE 2.68
** Preparing 5 concurrent users for battle.
The server is now under siege...
Lifting the server siege... done.
Transactions: 94834 hits
Availability: 100.00 %
Elapsed time: 29.35 secs
Data transferred: 258.53 MB
Response time: 0.00 secs
Transaction rate: 3231.14 trans/sec
Throughput: 8.81 MB/sec
Concurrency: 4.84
Successful transactions: 94834
Failed transactions: 0
Longest transaction: 0.56
Shortest transaction: 0.00

DPC ’09 Rob Allen http://akrabat.com


The browserʼs cache
AKA Donʼt get the same data twice
HTTP headers
• Expires
• Cache-Control

DPC ’09 Rob Allen http://akrabat.com


Expires
Expires: Sat, 13 June 2019 14:45:00 GMT

• Use for static components (CSS, JS, images)


• Encode version into filename
• Set via Apacheʼs ExpiresByType directive

DPC ’09 Rob Allen http://akrabat.com


ExpiresByType
<IfModule mod_expires.c>
ExpiresActive On

ExpiresByType text/css "now plus 2 years"


ExpiresByType text/javascript "now plus 2 years"
ExpiresByType image/jpeg "now plus 2 years"
ExpiresByType image/gif "now plus 2 years"
ExpiresByType image/png "now plus 2 years"
ExpiresByType application/x-shockwave-flash "now plus 2
years"
</IfModule>

DPC ’09 Rob Allen http://akrabat.com


Cache-Control
Cache-Control: max-age=3600, must-revalidate

• Set relative expiry time


• Configure expiry of proxy caches separately
• Ability to prevent caching completely

DPC ’09 Rob Allen http://akrabat.com


Validation headers
Last-Modified: Sun, 31 May 2009 10:21:09 GMT
ETag: 49705dbc03db2832844362b3950bfd0

• Browser checks before serving cached copy


• ETag must be quoted
• Respond to: HTTP_IF_MODIFIED_SINCE &
HTTP_IF_NONE_MATCH (in $_SERVER)
Send back header('HTTP/1.0 304 Not Modified');

DPC ’09 Rob Allen http://akrabat.com


Robʼs
Recommendations
1. Run an op code cache
2. Cache slow code (usually db calls)
3. Cache CSS/JS/images in the browser
Thank you

Provide feedback on this talk: http://joind.in/579


DPC ’09 Rob Allen http://akrabat.com

You might also like