[OpenAFS] AFS communication issue (OS X related?)
David R Boldt
dboldt@usgs.gov
Mon, 1 Dec 2008 16:38:48 -0500
This is a multipart message in MIME format.
--=_alternative 0076E35F85257512_=
Content-Type: text/plain; charset="US-ASCII"
OpenAFS-1.4.8-Leopard at 10.5.5
(User also reports that they have a second Mac
at home at 10.4 with similar issues: OS version 10.4.11
running OpenAFS 1.4.7)
All debugging information below was done on primary server.
No VPN in use.
User is unable to copy files larger than about 3MB into AFS.
Smaller files are able to be copied without issue. The problem
persists across a variety of destination directories. Source file
is less than 5MB. They are able to copy this file around locally
without issue.
When the file copy terminates they get an error message
as follows:
$ cp SIR2008-5192.pdf /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/.
cp: /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/./SIR2008-5192.pdf:
Operation not supported by device
Some portion of the copy has succeeded:
$ ls -l /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/SIR2008-5192.pdf
-rwxrwxrwx 1 46079 20 2899904 Nov 28 15:44
/afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/SIR2008-5192.pdf
In the system.log file, nothing very informative:
Dec 1 08:21:06 tracypinto kernel[0]: afs: failed to store file (19)
The cache is certainly large enough
$ cmdebug localhost 7001 -cache
Chunk files: 15625
Stat caches: 2000
Data caches: 800
Volume caches: 70
Chunk size: 524288
Cache size: 500000 kB
Set time: no
Cache type: disk
And they have plenty of local disk space
$ df -k /var/db/openafs/cache
Filesystem 1024-blocks Used Available Capacity Mounted on
/dev/disk0s2 195025072 34524268 160244804 18% /
Wondered if her ISP might be throttling connection, had her wait
a bit and then rsync the same file. No dice.
$ rsync SIR2008-5192.pdf
/afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/.
rsync: close failed on
"/afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/./.SIR2008-5192.pdf.kujrST":
Operation not supported by device (19)
rsync error: error in file IO (code 11) at
/SourceCache/rsync/rsync-35.2/rsync/receiver.c(647) [receiver=2.6.9]
rsync: connection unexpectedly closed (39 bytes received so far)
[generator]
rsync error: error in rsync protocol data stream (code 12) at
/SourceCache/rsync/rsync-35.2/rsync/io.c(452) [generator=2.6.9]
rsync: connection unexpectedly closed (34 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at
/SourceCache/rsync/rsync-35.2/rsync/io.c(452) [sender=2.6.9]
-- David Boldt
<dboldt@usgs.gov>
" Speak the truth, but leave immediately after."
--Slovenian Proverb
--=_alternative 0076E35F85257512_=
Content-Type: text/html; charset="US-ASCII"
<br><tt><font size=2>OpenAFS-1.4.8-Leopard at 10.5.5</font></tt>
<br><tt><font size=2>(User also reports that they have a second Mac</font></tt>
<br><tt><font size=2> at home at 10.4 with similar issues: OS version
10.4.11</font></tt>
<br><tt><font size=2> running OpenAFS 1.4.7)</font></tt>
<br><tt><font size=2>All debugging information below was done on primary
server.</font></tt>
<br><tt><font size=2>No VPN in use.</font></tt>
<br>
<br><tt><font size=2>User is unable to copy files larger than about 3MB
into AFS. </font></tt>
<br><tt><font size=2>Smaller files are able to be copied without issue.
The problem </font></tt>
<br><tt><font size=2>persists across a variety of destination directories.
Source file </font></tt>
<br><tt><font size=2>is less than 5MB. They are able to copy this file
around locally</font></tt>
<br><tt><font size=2>without issue.</font></tt>
<br>
<br><tt><font size=2>When the file copy terminates they get an error message
</font></tt>
<br><tt><font size=2>as follows:</font></tt>
<br>
<br><tt><font size=2>$ cp SIR2008-5192.pdf /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/.</font></tt>
<br><tt><font size=2>cp: /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/./SIR2008-5192.pdf:
Operation not supported by device</font></tt>
<br>
<br><tt><font size=2>Some portion of the copy has succeeded:</font></tt>
<br>
<br><tt><font size=2>$ ls -l /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/SIR2008-5192.pdf</font></tt>
<br><tt><font size=2>-rwxrwxrwx 1 46079 20
2899904 Nov 28 15:44 /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/SIR2008-5192.pdf</font></tt>
<br>
<br><tt><font size=2>In the system.log file, nothing very informative:</font></tt>
<br>
<br><tt><font size=2>Dec 1 08:21:06 tracypinto kernel[0]: afs: failed
to store file (19)</font></tt>
<br>
<br><tt><font size=2>The cache is certainly large enough</font></tt>
<br>
<br><tt><font size=2>$ cmdebug localhost 7001 -cache</font></tt>
<br><tt><font size=2>Chunk files: 15625</font></tt>
<br><tt><font size=2>Stat caches: 2000</font></tt>
<br><tt><font size=2>Data caches: 800</font></tt>
<br><tt><font size=2>Volume caches: 70</font></tt>
<br><tt><font size=2>Chunk size: 524288</font></tt>
<br><tt><font size=2>Cache size: 500000 kB</font></tt>
<br><tt><font size=2>Set time: no</font></tt>
<br><tt><font size=2>Cache type: disk</font></tt>
<br>
<br><tt><font size=2>And they have plenty of local disk space</font></tt>
<br>
<br><tt><font size=2>$ df -k /var/db/openafs/cache</font></tt>
<br><tt><font size=2>Filesystem 1024-blocks Used Available
Capacity Mounted on</font></tt>
<br><tt><font size=2>/dev/disk0s2 195025072 34524268 160244804
18% /</font></tt>
<br>
<br><tt><font size=2>Wondered if her ISP might be throttling connection,
had her wait</font></tt>
<br><tt><font size=2>a bit and then rsync the same file. No dice.</font></tt>
<br>
<br><tt><font size=2>$ rsync SIR2008-5192.pdf /afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/.</font></tt>
<br><tt><font size=2>rsync: close failed on "/afs/.usgs.gov/www/pubs/htdocs/pubs/sir/pintopdf/./.SIR2008-5192.pdf.kujrST":
Operation not supported by device (19)</font></tt>
<br><tt><font size=2>rsync error: error in file IO (code 11) at /SourceCache/rsync/rsync-35.2/rsync/receiver.c(647)
[receiver=2.6.9]</font></tt>
<br><tt><font size=2>rsync: connection unexpectedly closed (39 bytes received
so far) [generator]</font></tt>
<br><tt><font size=2>rsync error: error in rsync protocol data stream (code
12) at /SourceCache/rsync/rsync-35.2/rsync/io.c(452) [generator=2.6.9]</font></tt>
<br><tt><font size=2>rsync: connection unexpectedly closed (34 bytes received
so far) [sender]</font></tt>
<br><tt><font size=2>rsync error: error in rsync protocol data stream (code
12) at /SourceCache/rsync/rsync-35.2/rsync/io.c(452) [sender=2.6.9]</font></tt>
<br>
<br><tt><font size=2> </font></tt>
<br><tt><font size=2><br>
--
David Boldt<br>
<dboldt@usgs.gov><br>
<br>
<br>
" Speak the truth, but leave immediately after."<br>
--Slovenian Proverb<br>
<br>
</font></tt>
--=_alternative 0076E35F85257512_=--