[OpenAFS] Migration and slow AFS performance
Daniel Mezhiborsky
daniel.mezhiborsky@cooper.edu
Tue, 25 May 2021 14:21:17 +0000
--_000_MN2PR18MB2703B9173265F7FC0ECEEB74EC259MN2PR18MB2703namp_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Hello all,
We currently have a relatively small (~250 users, 2TB) AFS cell that I am p=
lanning on retiring soon. I'd like to get our data out of AFS-space, but th=
is is proving problematic because of performance issues. Our setup is one A=
FS server VM with iSCSI-attached /vicepa. For single large-file transfers w=
ith encryption off, I can get around 30MB/s read/write, but it seems like m=
etadata operations are very slow, so copying our data (mostly home director=
ies) directly from AFS with cp/rsync is taking a prohibitively long time. I=
see similar slowness with vos dump. We do take regular backups with vos ba=
ckupsys and backup dump that take about 36 hours for full backups.
Does anyone have any recommendations on problem areas to try and tune to ge=
t better performance or advice on a better way copy our data out of AFS?
Thank you!
Dan Mezhiborsky
Cooper Union microLab
Daniel Mezhiborsky | BE Electrical Engineering '23
The Cooper Union
--_000_MN2PR18MB2703B9173265F7FC0ECEEB74EC259MN2PR18MB2703namp_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Diso-8859-=
1">
<style type=3D"text/css" style=3D"display:none;"> P {margin-top:0;margin-bo=
ttom:0;} </style>
</head>
<body dir=3D"ltr">
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Hello all,</div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
We currently have a relatively small (~250 users, 2TB) AFS cell that I am p=
lanning on retiring soon. I'd like to get our data out of AFS-space, but th=
is is proving problematic because of performance issues. Our setup is one A=
FS server VM with iSCSI-attached
/vicepa. For single large-file transfers with encryption off, I can get ar=
ound 30MB/s read/write, but it seems like metadata operations are very slow=
, so copying our data (mostly home directories) directly from AFS with cp/r=
sync is taking a prohibitively long
time. <span style=3D"font-family: Calibri, Arial, Helvetica, sans-ser=
if; font-size: 12pt;">I see similar slowness with vos dump. We do take regu=
lar backups with vos backupsys and backup dump that take about 36 hours for=
full backups.</span></div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-siz=
e: 12pt;"><br>
</span></div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-siz=
e: 12pt;">Does anyone have any recommendations on problem areas to try and =
tune to get better performance or advice on a better way copy our data out =
of AFS?</span></div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-siz=
e: 12pt;"><br>
</span></div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Thank you!</div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-siz=
e: 12pt;"><br>
</span></div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<span style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-siz=
e: 12pt;">Dan Mezhiborsky</span><br>
</div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Cooper Union microLab</div>
<div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id=3D"Signature">
<div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0);">
<span style=3D"font-size:10pt">Daniel Mezhiborsky | BE Electrical Engineeri=
ng '23</span></div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0);">
<span style=3D"font-size:10pt">The Cooper Union</span></div>
</div>
</div>
</div>
</body>
</html>
--_000_MN2PR18MB2703B9173265F7FC0ECEEB74EC259MN2PR18MB2703namp_--