[OpenAFS] Improving AFS performance for Joomla and other web sites

Edgecombe, Jason jwedgeco@uncc.edu
Wed, 8 Sep 2010 17:32:43 -0400


This is a multi-part message in MIME format.

------_=_NextPart_001_01CB4F9D.5F389679
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi everyone,

=20

We currently server our entire web tree out of AFS. This includes Joomla
and other PHP-based applications. While I was benchmarking our new
server, I noticed that the following rough performance numbers:

=20

Static files served from AFS:
~200 requests per second

Joomla home page served out of AFS:                     ~30 requests per
second

Joomla home page served from local ext3:           1000 requests per
second.

=20

I'm running a 8 cores with hyperthreading (16 threads). I'm running the
Apache threaded worker MPM on RHEL5.5 with mod_fcgid and OpenAFS
1.4.12.1. I have Apache configured for ~1000 threads.

=20

My data (250GB) and stat cache for the AFS client should be big enough
to not have to hit the server.

=20

My afsd has the following options: " -fakestat -dynroot -chunksize 18
-stat 500000 -daemons 32 -volumes 2000 -blocks 212713128"

=20

What is recommended to improve my AFS performance for Joomla?

=20

FYI, my measurements show that the "stat" system call is run more than
any other.

=20

Thanks,

Jason

=20

------------------------------------------------------------------------
---

Jason Edgecombe | Linux and Solaris Administrator

UNC Charlotte | The William States Lee College of Engineering

9201 University City Blvd. | Charlotte, NC 28223-0001

jwedgeco@uncc.edu <mailto:jwedgeco@uncc.edu>  | http://www.coe.uncc.edu
<http://www.coe.uncc.edu/>=20

------------------------------------------------------------------------
---

If you are not the intended recipient of this transmission or a person
responsible for delivering it to the intended recipient, any disclosure,
copying, distribution, or other use of any of the information in this
transmission is strictly prohibited. If you have received this
transmission in error, please notify me immediately by reply e-mail or
by telephone at 704-687-3514.  Thank you.

=20


------_=_NextPart_001_01CB4F9D.5F389679
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:x=3D"urn:schemas-microsoft-com:office:excel" =
xmlns:p=3D"urn:schemas-microsoft-com:office:powerpoint" =
xmlns:a=3D"urn:schemas-microsoft-com:office:access" =
xmlns:dt=3D"uuid:C2F41010-65B3-11d1-A29F-00AA00C14882" =
xmlns:s=3D"uuid:BDC6E3F0-6DA3-11d1-A2A3-00AA00C14882" =
xmlns:rs=3D"urn:schemas-microsoft-com:rowset" xmlns:z=3D"#RowsetSchema" =
xmlns:b=3D"urn:schemas-microsoft-com:office:publisher" =
xmlns:ss=3D"urn:schemas-microsoft-com:office:spreadsheet" =
xmlns:c=3D"urn:schemas-microsoft-com:office:component:spreadsheet" =
xmlns:odc=3D"urn:schemas-microsoft-com:office:odc" =
xmlns:oa=3D"urn:schemas-microsoft-com:office:activation" =
xmlns:html=3D"http://www.w3.org/TR/REC-html40" =
xmlns:q=3D"http://schemas.xmlsoap.org/soap/envelope/" =
xmlns:rtc=3D"http://microsoft.com/officenet/conferencing" =
xmlns:D=3D"DAV:" xmlns:Repl=3D"http://schemas.microsoft.com/repl/" =
xmlns:mt=3D"http://schemas.microsoft.com/sharepoint/soap/meetings/" =
xmlns:x2=3D"http://schemas.microsoft.com/office/excel/2003/xml" =
xmlns:ppda=3D"http://www.passport.com/NameSpace.xsd" =
xmlns:ois=3D"http://schemas.microsoft.com/sharepoint/soap/ois/" =
xmlns:dir=3D"http://schemas.microsoft.com/sharepoint/soap/directory/" =
xmlns:ds=3D"http://www.w3.org/2000/09/xmldsig#" =
xmlns:dsp=3D"http://schemas.microsoft.com/sharepoint/dsp" =
xmlns:udc=3D"http://schemas.microsoft.com/data/udc" =
xmlns:xsd=3D"http://www.w3.org/2001/XMLSchema" =
xmlns:sub=3D"http://schemas.microsoft.com/sharepoint/soap/2002/1/alerts/"=
 xmlns:ec=3D"http://www.w3.org/2001/04/xmlenc#" =
xmlns:sp=3D"http://schemas.microsoft.com/sharepoint/" =
xmlns:sps=3D"http://schemas.microsoft.com/sharepoint/soap/" =
xmlns:xsi=3D"http://www.w3.org/2001/XMLSchema-instance" =
xmlns:udcs=3D"http://schemas.microsoft.com/data/udc/soap" =
xmlns:udcxf=3D"http://schemas.microsoft.com/data/udc/xmlfile" =
xmlns:udcp2p=3D"http://schemas.microsoft.com/data/udc/parttopart" =
xmlns:wf=3D"http://schemas.microsoft.com/sharepoint/soap/workflow/" =
xmlns:dsss=3D"http://schemas.microsoft.com/office/2006/digsig-setup" =
xmlns:dssi=3D"http://schemas.microsoft.com/office/2006/digsig" =
xmlns:mdssi=3D"http://schemas.openxmlformats.org/package/2006/digital-sig=
nature" =
xmlns:mver=3D"http://schemas.openxmlformats.org/markup-compatibility/2006=
" xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns:mrels=3D"http://schemas.openxmlformats.org/package/2006/relationshi=
ps" xmlns:spwp=3D"http://microsoft.com/sharepoint/webpartpages" =
xmlns:ex12t=3D"http://schemas.microsoft.com/exchange/services/2006/types"=
 =
xmlns:ex12m=3D"http://schemas.microsoft.com/exchange/services/2006/messag=
es" =
xmlns:pptsl=3D"http://schemas.microsoft.com/sharepoint/soap/SlideLibrary/=
" =
xmlns:spsl=3D"http://microsoft.com/webservices/SharePointPortalServer/Pub=
lishedLinksService" xmlns:Z=3D"urn:schemas-microsoft-com:" =
xmlns:st=3D"&#1;" xmlns=3D"http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 12 (filtered medium)">
<style>
<!--
 /* Font Definitions */
 @font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:11.0pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"Calibri","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
-->
</style>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DWordSection1>

<p class=3DMsoNormal>Hi everyone,<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>We currently server our entire web tree out of AFS. =
This
includes Joomla and other PHP-based applications. While I was =
benchmarking our
new server, I noticed that the following rough performance =
numbers:<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>Static files served from AFS: =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp; ~200
requests per second<o:p></o:p></p>

<p class=3DMsoNormal>Joomla home page served out of AFS: &nbsp; =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp; &nbsp;&nbsp;~30
requests per second<o:p></o:p></p>

<p class=3DMsoNormal>Joomla home page served from local ext3: =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; &nbsp;1000
requests per second.<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>I&#8217;m running a 8 cores with hyperthreading (16 =
threads).
I&#8217;m running the Apache threaded worker MPM on RHEL5.5 with =
mod_fcgid and
OpenAFS 1.4.12.1. I have Apache configured for ~1000 =
threads.<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>My data (250GB) and stat cache for the AFS client =
should be
big enough to not have to hit the server.<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>My afsd has the following options: &#8220; =
-fakestat
-dynroot -chunksize 18 -stat 500000 -daemons 32 -volumes 2000 -blocks =
212713128&#8221;<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>What is recommended to improve my AFS performance =
for
Joomla?<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>FYI, my measurements show that the =
&#8220;stat&#8221; system
call is run more than any other.<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal>Thanks,<o:p></o:p></p>

<p class=3DMsoNormal>Jason<o:p></o:p></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

<p class=3DMsoNormal><span =
style=3D'font-size:9.0pt;font-family:"Arial","sans-serif"'>--------------=
-------------------------------------------------------------<o:p></o:p><=
/span></p>

<p class=3DMsoNormal style=3D'text-autospace:none'><span =
style=3D'font-size:9.0pt;
font-family:"Arial","sans-serif"'>Jason Edgecombe <b>| </b>Linux and =
Solaris
Administrator<o:p></o:p></span></p>

<p class=3DMsoNormal style=3D'text-autospace:none'><span =
style=3D'font-size:9.0pt;
font-family:"Arial","sans-serif"'>UNC Charlotte <b>| </b>The William =
States Lee
College of Engineering<o:p></o:p></span></p>

<p class=3DMsoNormal style=3D'text-autospace:none'><span =
style=3D'font-size:9.0pt;
font-family:"Arial","sans-serif"'>9201 University City Blvd. <b>| =
</b>Charlotte,
NC 28223-0001<o:p></o:p></span></p>

<p class=3DMsoNormal style=3D'text-autospace:none'><span =
style=3D'font-size:9.0pt;
font-family:"Arial","sans-serif"'><a =
href=3D"mailto:jwedgeco@uncc.edu"><span
style=3D'color:windowtext'>jwedgeco@uncc.edu</span></a> <b>| </b><a
href=3D"http://www.coe.uncc.edu/"><span =
style=3D'color:blue'>http://www.coe.uncc.edu</span></a><o:p></o:p></span>=
</p>

<p class=3DMsoNormal style=3D'text-autospace:none'><span =
style=3D'font-size:9.0pt;
font-family:"Arial","sans-serif"'>---------------------------------------=
------------------------------------<o:p></o:p></span></p>

<p class=3DMsoNormal style=3D'text-autospace:none'><span =
style=3D'font-size:8.0pt;
font-family:"Arial","sans-serif"'>If you are not the intended recipient =
of this
transmission or a person responsible for delivering it to the intended
recipient, any disclosure, copying, distribution, or other use of any of =
the
information in this transmission is strictly prohibited. If you have =
received
this transmission in error, please notify me immediately by reply e-mail =
or by
telephone at 704-687-3514.&nbsp; Thank you.<o:p></o:p></span></p>

<p class=3DMsoNormal><o:p>&nbsp;</o:p></p>

</div>

</body>

</html>

------_=_NextPart_001_01CB4F9D.5F389679--