[OpenAFS] getcwd() error for RHEL 7.4 kernel

Matt Vander Werf mvanderw@nd.edu
Fri, 27 Oct 2017 12:13:32 -0400


--f40304387b986ac881055c8994b6
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

I have some more information that we just discovered. It seems to only
happen when in the top level of the affected users' home directory. My
colleague tried running (affected) commands in a subdirectory of his home
directory and didn't have any issues. This makes sense why the users get
that message upon login, as they are going into their top level home
directory.

I was also able to get similar errors when trying to run commands out of
his home directory, while authenticated as myself, on an updated system. I
didn't get any login message when I logged into the system and don't have
the issue in any other AFS directory (home directory or otherwise) while on
the same system. For example, I ran the same pip2 command indicated below
while in his home directory and got the same error message as below (see
output below). I am able to run these same commands just fine in my
colleague's home directory on other systems that are running an older
kernel version (before RHEL 7.4 base kernel). It seems to happen with any
command that is doing a getcwd() call, and we've seen it with the
qsub/qsub.orig, tcsh, tmux, and pip2 commands, to name a few. Mutple people
were able to replicate what I found.

[mvanderw@02 ~]$ uname -r
3.10.0-693.5.2.el7.x86_64
[mvanderw@02 shampton]$ pwd
/afs/crc.nd.edu/user/s/shampton
[mvanderw@02 shampton]$ pip2 search PyYaml
The folder you are executing pip from can no longer be found.
[mvanderw@02 shampton]$ cd support/
[mvanderw@02 support]$ pip2 search PyYaml
aspy.yaml (1.0.0)              - A few extensions to pyyaml.
...
[mvanderw@02 shampton]$ cd ~
[mvanderw@02 ~]$ pip2 search PyYaml
aspy.yaml (1.0.0)              - A few extensions to pyyaml.
...

[mvanderw@01 shampton]$ uname -r
3.10.0-514.26.2.el7.x86_64
[mvanderw@01 shampton]$ pwd
/afs/crc.nd.edu/user/s/shampton
[mvanderw@01 shampton]$ pip2 search PyYaml
aspy.yaml (1.0.0)              - A few extensions to pyyaml.
...

We tried to do a 'fs flushvolume' command on the user volume (containing
his home directory) on the updated system and also tried to do an 'fs
flushall' command on that system, and neither had any impact. We also tried
moving the user volume of my colleague to another file server and that
didn't have any impact either.

Any ideas what might be the issue? Anything else we can try that might help
diagnose this?

Hopefully this additional information can shed some light!

Thanks in advance for any help!

--
Matt Vander Werf
HPC System Administrator
University of Notre Dame
Center for Research Computing - Union Station
506 W. South Street
South Bend, IN 46601
Phone: (574) 631-0692

On Thu, Oct 26, 2017 at 2:17 PM, Matt Vander Werf <mvanderw@nd.edu> wrote:

> Hello all,
>
> One of my colleagues was able to reproduce the issue today and so I have
> some additional information to share. We upgraded one of our main
> interactive systems to the latest RHEL 7 kernel to use as a test system t=
o
> try and reproduce the issue. This was done early morning yesterday,
> Wednesday, 10/25 (Eastern), and we didn't get any reports of any issues
> until my colleague was able to reproduce it this afternoon.
>
> They got the error message at login, as specified below. And also got the
> 'getcwd() failed' message for several applications.
>
> I had them run an strace on a couple of commands where they got the '<app=
lication
> name>: getcwd() failed' error message, as I thought that might be useful
> potentially. I've attached the strace output from two commands, 'qsub' an=
d
> 'qsub.orig'. qsub is simply a wrapper bash script that performs some chec=
ks
> and then ultimately calls the qsub.orig command with certain options. We
> weren't sure if it was the qsub or qsub.orig that was causing the issue t=
o
> be triggered, but he got the error message on both commands. qsub is what
> our users use to submit jobs to our batch system
>
> In addition, he also got a related message when trying to run the 'pip2'
> command, which we haven't seen with this issue before. The error message
> from doing a simple 'pip2 search PyYaml' is:
>
> The folder you are executing pip from can no longer be found.
>
> From the strace (also attached), you can see it is failing on a getcwd()
> call. This is using Python 2.7.11, built with gcc 4.9.2.
>
> If there's anything else that would be useful for my colleague to gather,
> please let us know!
>
> I've also ran a 'cmdebug <server> -long' command on the system in
> question, and can send the output of that as well, if anyone thinks that'=
d
> be useful.
>
> Hope this helps at least somewhat!
>
> Thanks!
>
> --
> Matt Vander Werf
> HPC System Administrator
> University of Notre Dame
> Center for Research Computing - Union Station
> 506 W. South Street
> South Bend, IN 46601
> Phone: (574) 631-0692
>
> On Fri, Oct 20, 2017 at 5:24 PM, Matt Vander Werf <mvanderw@nd.edu> wrote=
:
>
>> Okay, I've attached a config.log.
>>
>> Our afsd options are:
>>
>> AFSD_ARGS=3D"-fakestat -chunksize 20 -daemons 6 -afsdb".
>>
>> Unfortunately, I've been unable to replicate this myself (despite
>> numerous attempts). It only seems to happen on systems that are in heavy
>> use with a lot of users, most likely since it doesn't happen for every u=
ser
>> (takes enough user usage for us to get complaints). Most of the reports
>> about this have been with our job submission software, specifically with
>> the qsub command, but the error has also shown up right after users log =
in
>> (as I indicated before):
>>
>> shell-init: error retrieving current directory: getcwd: cannot access
>> parent directories: No such file or directory
>> tcsh: No such file or directory
>> tcsh: Trying to start from "<user AFS home directory>"
>>
>>
>> We have not tried falling back to 1.6.20.2 or earlier, but we may try to
>> do this yet. Unfortunately, until we are able to replicate it ourselves,
>> it's going to be hard to test this without potentially causing disruptio=
n
>> to our users again.
>>
>> Thanks.
>>
>> --
>> Matt Vander Werf
>> HPC System Administrator
>> University of Notre Dame
>> Center for Research Computing - Union Station
>> 506 W. South Street
>> South Bend, IN 46601
>> Phone: (574) 631-0692
>>
>> On Fri, Oct 20, 2017 at 3:16 PM, Mark Vitale <mvitale@sinenomine.net>
>> wrote:
>>
>>>
>>> > On Oct 20, 2017, at 11:03 AM, Matt Vander Werf <mvanderw@nd.edu>
>>> wrote:
>>> >
>>> > We can still do a manual configure on a system and attach the
>>> config.log as well, if you'd still like that. Just let us know.
>>>
>>> Yes, I believe seeing a config log from your site could still be helpfu=
l
>>> in tracking this down.
>>>
>>> I know the problem has been intermittent for you, but could you provide
>>> any more information about your environment (especially afsd options) o=
r
>>> application(s) that trigger this?  So far I=E2=80=99ve not been able to=
 reproduce
>>> any getcwd issues in my tests with your kernel level and OpenAFS releas=
e,
>>> so any tips on what triggers this for you would be helpful.
>>>
>>> Also, have you tried falling back to OpenAFS 1.6.20.2 or earlier?  If
>>> so, what were your results?  If not, could you try it and let us know?
>>>
>>> Thanks,
>>> =E2=80=94
>>> Mark Vitale
>>> OpenAFS release team
>>>
>>>
>>
>

--f40304387b986ac881055c8994b6
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div><div><div>I have some more information that=
 we just discovered. It seems to only happen when in the top level of the a=
ffected users&#39; home directory. My colleague tried running (affected) co=
mmands in a subdirectory of his home directory and didn&#39;t have any issu=
es. This makes sense why the users get that message upon login, as they are=
 going into their top level home directory.<br><br></div>I was also able to=
 get similar errors when trying to run commands out of his home directory, =
while authenticated as myself, on an updated system. I didn&#39;t get any l=
ogin message when I logged into the system and don&#39;t have the issue in =
any other AFS directory (home directory or otherwise) while on the same sys=
tem. For example, I ran the same pip2 command indicated below while in his =
home directory and got the same error message as below (see output below).<=
span id=3D"m_-2791760394725895181m_5874276200659799872gmail-:gji.co" class=
=3D"m_-2791760394725895181m_5874276200659799872gmail-tL8wMe m_-279176039472=
5895181m_5874276200659799872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:l=
eft"> I am able to run these same commands just fine in my colleague&#39;s =
home directory on other systems that are running an older kernel version (b=
efore RHEL 7.4 base kernel). It seems to happen with any command that is do=
ing a getcwd() call, and we&#39;ve seen it with the qsub/qsub.orig, tcsh, t=
mux, and pip2 commands, to name a few. Mutple people were able to replicate=
 what I found.<br></span></div><div><span id=3D"m_-2791760394725895181m_587=
4276200659799872gmail-:gji.co" class=3D"m_-2791760394725895181m_58742762006=
59799872gmail-tL8wMe m_-2791760394725895181m_5874276200659799872gmail-EMoHu=
b" dir=3D"ltr" style=3D"text-align:left"></span><br><span id=3D"m_-27917603=
94725895181m_5874276200659799872gmail-:gji.co" class=3D"m_-2791760394725895=
181m_5874276200659799872gmail-tL8wMe m_-2791760394725895181m_58742762006597=
99872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:left"><span id=3D"m_-279=
1760394725895181m_5874276200659799872gmail-:gji.co" class=3D"m_-27917603947=
25895181m_5874276200659799872gmail-tL8wMe m_-2791760394725895181m_587427620=
0659799872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:left">[mvanderw@02 =
~]$ uname -r<br>3.10.0-693.5.2.el7.x86_64</span></span></div><div><span id=
=3D"m_-2791760394725895181m_5874276200659799872gmail-:gji.co" class=3D"m_-2=
791760394725895181m_5874276200659799872gmail-tL8wMe m_-2791760394725895181m=
_5874276200659799872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:left">[mv=
anderw@02 shampton]$ pwd<br>/afs/<a href=3D"http://crc.nd.edu/user/s/shampt=
o">crc.nd.edu/user/s/shampto</a><wbr>n<br>[mvanderw@02 shampton]$ pip2 sear=
ch PyYaml<br>The folder you are executing pip from can no longer be found.<=
/span></div><div><span id=3D"m_-2791760394725895181m_5874276200659799872gma=
il-:gji.co" class=3D"m_-2791760394725895181m_5874276200659799872gmail-tL8wM=
e m_-2791760394725895181m_5874276200659799872gmail-EMoHub" dir=3D"ltr" styl=
e=3D"text-align:left">[mvanderw@02 shampton]$ cd support/<br>[mvanderw@02 s=
upport]$ pip2 search PyYaml<br>aspy.yaml (1.0.0)=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 - A few extensions to p=
yyaml.<br></span></div><div><span id=3D"m_-2791760394725895181m_58742762006=
59799872gmail-:gji.co" class=3D"m_-2791760394725895181m_5874276200659799872=
gmail-tL8wMe m_-2791760394725895181m_5874276200659799872gmail-EMoHub" dir=
=3D"ltr" style=3D"text-align:left">...<br></span></div><div><span id=3D"m_-=
2791760394725895181m_5874276200659799872gmail-:gji.co" class=3D"m_-27917603=
94725895181m_5874276200659799872gmail-tL8wMe m_-2791760394725895181m_587427=
6200659799872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:left">[mvanderw@=
02 shampton]$ cd ~<br>[mvanderw@02 ~]$ pip2 search PyYaml<br>aspy.yaml (1.0=
.0)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=
=C2=A0 - A few extensions to pyyaml.</span></div><div><span id=3D"m_-279176=
0394725895181m_5874276200659799872gmail-:gji.co" class=3D"m_-27917603947258=
95181m_5874276200659799872gmail-tL8wMe m_-2791760394725895181m_587427620065=
9799872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:left">...<br></span></=
div><div><br><span id=3D"m_-2791760394725895181m_5874276200659799872gmail-:=
gji.co" class=3D"m_-2791760394725895181m_5874276200659799872gmail-tL8wMe m_=
-2791760394725895181m_5874276200659799872gmail-EMoHub" dir=3D"ltr" style=3D=
"text-align:left"><span id=3D"m_-2791760394725895181m_5874276200659799872gm=
ail-:gji.co" class=3D"m_-2791760394725895181m_5874276200659799872gmail-tL8w=
Me m_-2791760394725895181m_5874276200659799872gmail-EMoHub" dir=3D"ltr" sty=
le=3D"text-align:left">[mvanderw@01 shampton]$ uname -r<br>3.10.0-514.26.2.=
el7.x86_64</span></span></div><div><span id=3D"m_-2791760394725895181m_5874=
276200659799872gmail-:gji.co" class=3D"m_-2791760394725895181m_587427620065=
9799872gmail-tL8wMe m_-2791760394725895181m_5874276200659799872gmail-EMoHub=
" dir=3D"ltr" style=3D"text-align:left">[mvanderw@01 shampton]$ pwd<br>/afs=
/<a href=3D"http://crc.nd.edu/user/s/shampto">crc.nd.edu/user/s/shampto</a>=
<wbr>n<br>[mvanderw@01 shampton]$ pip2 search PyYaml<br>aspy.yaml (1.0.0)=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=
=A0 - A few extensions to pyyaml.<br>...<br></span></div><div><span id=3D"m=
_-2791760394725895181m_5874276200659799872gmail-:gji.co" class=3D"m_-279176=
0394725895181m_5874276200659799872gmail-tL8wMe m_-2791760394725895181m_5874=
276200659799872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:left"><br></sp=
an></div><span id=3D"m_-2791760394725895181m_5874276200659799872gmail-:gji.=
co" class=3D"m_-2791760394725895181m_5874276200659799872gmail-tL8wMe m_-279=
1760394725895181m_5874276200659799872gmail-EMoHub" dir=3D"ltr" style=3D"tex=
t-align:left">We tried to do a &#39;fs flushvolume&#39; command on the user=
 volume (containing his home directory) on the updated system and also trie=
d to do an &#39;fs flushall&#39; command on that system, and neither had an=
y impact. We also tried moving the user volume of my colleague to another f=
ile server and that didn&#39;t have any impact either.<br><br></span></div>=
<span id=3D"m_-2791760394725895181m_5874276200659799872gmail-:gji.co" class=
=3D"m_-2791760394725895181m_5874276200659799872gmail-tL8wMe m_-279176039472=
5895181m_5874276200659799872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:l=
eft">Any ideas what might be the issue? Anything else we can try that might=
 help diagnose this?<br><br></span></div><span id=3D"m_-2791760394725895181=
m_5874276200659799872gmail-:gji.co" class=3D"m_-2791760394725895181m_587427=
6200659799872gmail-tL8wMe m_-2791760394725895181m_5874276200659799872gmail-=
EMoHub" dir=3D"ltr" style=3D"text-align:left">Hopefully this additional inf=
ormation can shed some light!<br><br></span></div><span id=3D"m_-2791760394=
725895181m_5874276200659799872gmail-:gji.co" class=3D"m_-279176039472589518=
1m_5874276200659799872gmail-tL8wMe m_-2791760394725895181m_5874276200659799=
872gmail-EMoHub" dir=3D"ltr" style=3D"text-align:left">Thanks in advance fo=
r any help!<br></span><div><div><div><div><div class=3D"gmail_extra"><br cl=
ear=3D"all"><div><div class=3D"m_-2791760394725895181m_5874276200659799872g=
mail_signature"><div dir=3D"ltr"><div>--<br></div><div>Matt Vander Werf<br>=
HPC System Administrator<br>University of Notre Dame<br>Center for Research=
 Computing - Union Station<br>506 W. South Street<br>South Bend, IN 46601<b=
r></div>Phone: <a href=3D"tel:(574)%20631-0692" value=3D"+15746310692" targ=
et=3D"_blank">(574) 631-0692</a></div></div></div>
<br><div class=3D"gmail_quote">On Thu, Oct 26, 2017 at 2:17 PM, Matt Vander=
 Werf <span dir=3D"ltr">&lt;<a href=3D"mailto:mvanderw@nd.edu" target=3D"_b=
lank">mvanderw@nd.edu</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_q=
uote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,2=
04);padding-left:1ex"><div dir=3D"ltr"><div><div>Hello all,<br><br></div>On=
e of my colleagues was able to reproduce the issue today and so I have some=
 additional information to share. We upgraded one of our main interactive s=
ystems to the latest RHEL 7 kernel to use as a test system to try and repro=
duce the issue. This was done early morning yesterday, Wednesday, 10/25 (Ea=
stern), and we didn&#39;t get any reports of any issues until my colleague =
was able to reproduce it this afternoon.<br><br></div><div><div class=3D"gm=
ail_extra">They got the error message at login, as specified below. And als=
o got the &#39;getcwd() failed&#39; message for several applications.<br></=
div><div class=3D"gmail_extra"><br></div><div class=3D"gmail_extra">I had t=
hem run an strace on a couple of commands where they got the <font face=3D"=
arial, helvetica, sans-serif">&#39;&lt;application name&gt;: getcwd() faile=
d&#39; error message, as I thought that might be useful potentially. I&#39;=
ve attached the strace output from two commands, &#39;qsub&#39; and &#39;qs=
ub.orig&#39;. qsub is simply a wrapper bash script that performs some check=
s and then ultimately calls the qsub.orig command with certain options. We =
weren&#39;t sure if it was the qsub or qsub.orig that was causing the issue=
 to be triggered, but he got the error message on both commands. qsub is wh=
at our users use to submit jobs to our batch system<br></font></div><div cl=
ass=3D"gmail_extra"><font face=3D"arial, helvetica, sans-serif"><br></font>=
</div><div class=3D"gmail_extra"><font face=3D"arial, helvetica, sans-serif=
">In addition, he also got a related message when trying to run the &#39;pi=
p2&#39; command, which we haven&#39;t seen with this issue before. The erro=
r message from doing a simple &#39;pip2 search PyYaml&#39; is:</font></div>=
<div class=3D"gmail_extra"><font face=3D"arial, helvetica, sans-serif"><br>=
</font></div><div class=3D"gmail_extra" style=3D"margin-left:40px"><font fa=
ce=3D"arial, helvetica, sans-serif">The folder you are executing pip from c=
an no longer be found.</font></div><div class=3D"gmail_extra"><font face=3D=
"arial, helvetica, sans-serif"><br></font></div><div class=3D"gmail_extra">=
<font face=3D"arial, helvetica, sans-serif">From the strace (also attached)=
, you can see it is failing on a getcwd() call. This is using Python 2.7.11=
, built with gcc 4.9.2.</font></div><div class=3D"gmail_extra"><font face=
=3D"arial, helvetica, sans-serif"><br></font></div><div class=3D"gmail_extr=
a"><font face=3D"arial, helvetica, sans-serif">If there&#39;s anything else=
 that would be useful for my colleague to gather, please let us know!</font=
></div><div class=3D"gmail_extra"><font face=3D"arial, helvetica, sans-seri=
f"><br></font></div><div class=3D"gmail_extra"><font face=3D"arial, helveti=
ca, sans-serif">I&#39;ve also ran a &#39;cmdebug &lt;server&gt; -long&#39; =
command on the system in question, and can send the output of that as well,=
 if anyone thinks that&#39;d be useful.<br></font></div><div class=3D"gmail=
_extra"><font face=3D"arial, helvetica, sans-serif"><br></font></div><div c=
lass=3D"gmail_extra"><font face=3D"arial, helvetica, sans-serif">Hope this =
helps at least somewhat!</font></div><div class=3D"gmail_extra"><font face=
=3D"arial, helvetica, sans-serif"><br></font></div><div class=3D"gmail_extr=
a"><font face=3D"arial, helvetica, sans-serif">Thanks!<br></font></div><div=
 class=3D"gmail_extra"><br clear=3D"all"></div><div class=3D"gmail_extra"><=
span class=3D"m_-2791760394725895181m_5874276200659799872gmail-"><div><div =
class=3D"m_-2791760394725895181m_5874276200659799872gmail-m_-79019855343352=
22437gmail-m_-543102750509118762gmail_signature"><div dir=3D"ltr"><div>--<b=
r></div><div>Matt Vander Werf<br>HPC System Administrator<br>University of =
Notre Dame<br>Center for Research Computing - Union Station<br>506 W. South=
 Street<br>South Bend, IN 46601<br></div>Phone: <a href=3D"tel:(574)%20631-=
0692" value=3D"+15746310692" target=3D"_blank">(574) 631-0692</a></div></di=
v></div>
<br></span><div><div class=3D"m_-2791760394725895181m_5874276200659799872gm=
ail-h5"><div class=3D"gmail_quote">On Fri, Oct 20, 2017 at 5:24 PM, Matt Va=
nder Werf <span dir=3D"ltr">&lt;<a href=3D"mailto:mvanderw@nd.edu" target=
=3D"_blank">mvanderw@nd.edu</a>&gt;</span> wrote:<br><blockquote class=3D"g=
mail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204=
,204,204);padding-left:1ex"><div dir=3D"ltr"><div><div>Okay, I&#39;ve attac=
hed a config.log.<br><br></div>Our afsd options are:</div><div><br></div><d=
iv><div style=3D"margin-left:40px">AFSD_ARGS=3D&quot;-fakestat -chunksize 2=
0 -daemons 6 -afsdb&quot;.<br></div><br></div>Unfortunately, I&#39;ve been =
unable to replicate this myself (despite numerous attempts). It only seems =
to happen on systems that are in heavy use with a lot of users, most likely=
 since it doesn&#39;t happen for every user (takes enough user usage for us=
 to get complaints). Most of the reports about this have been with our job =
submission software, specifically with the qsub command, but the error has =
also shown up right after users log in (as I indicated before):<span class=
=3D"m_-2791760394725895181m_5874276200659799872gmail-m_-7901985534335222437=
gmail-m_-543102750509118762gmail-"><br><br><blockquote style=3D"margin:0px =
0px 0px 40px;border-width:medium;border-style:none;border-color:currentcolo=
r;padding:0px"><div><div><div><font face=3D"arial, helvetica, sans-serif">s=
hell-init: error retrieving current directory: getcwd: cannot access parent=
 directories: No such file or directory</font></div></div></div><div><div><=
div><font face=3D"arial, helvetica, sans-serif">tcsh: No such file or direc=
tory</font></div></div></div><div><div><div><font face=3D"arial, helvetica,=
 sans-serif">tcsh: Trying to start from &quot;&lt;user AFS home directory&g=
t;&quot;</font></div></div></div></blockquote><div class=3D"gmail_extra"><b=
r></div></span><div class=3D"gmail_extra">We have not tried falling back to=
 1.6.20.2 or earlier, but we may try to do this yet. Unfortunately, until w=
e are able to replicate it ourselves, it&#39;s going to be hard to test thi=
s without potentially causing disruption to our users again.<br></div><div =
class=3D"gmail_extra"><br></div><div class=3D"gmail_extra">Thanks.</div><di=
v class=3D"gmail_extra"><br></div><div class=3D"gmail_extra"><div><div clas=
s=3D"m_-2791760394725895181m_5874276200659799872gmail-m_-790198553433522243=
7gmail-m_-543102750509118762gmail-m_8082137537802939750gmail-m_435317045313=
4064338m_567955491697094584m_-7323507014240503509m_-3846033447153959025m_82=
41078478367793376gmail_signature"><div dir=3D"ltr"><span class=3D"m_-279176=
0394725895181m_5874276200659799872gmail-m_-7901985534335222437gmail-m_-5431=
02750509118762gmail-"><div>--<br></div><div>Matt Vander Werf<br>HPC System =
Administrator<br>University of Notre Dame<br>Center for Research Computing =
- Union Station<br>506 W. South Street<br>South Bend, IN 46601<br></div></s=
pan>Phone: <a href=3D"tel:(574)%20631-0692" value=3D"+15746310692" target=
=3D"_blank">(574) 631-0692</a></div></div></div><div><div class=3D"m_-27917=
60394725895181m_5874276200659799872gmail-m_-7901985534335222437gmail-m_-543=
102750509118762gmail-h5">
<br><div class=3D"gmail_quote">On Fri, Oct 20, 2017 at 3:16 PM, Mark Vitale=
 <span dir=3D"ltr">&lt;<a href=3D"mailto:mvitale@sinenomine.net" target=3D"=
_blank">mvitale@sinenomine.net</a>&gt;</span> wrote:<br><blockquote class=
=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rg=
b(204,204,204);padding-left:1ex"><span><br>
&gt; On Oct 20, 2017, at 11:03 AM, Matt Vander Werf &lt;<a href=3D"mailto:m=
vanderw@nd.edu" target=3D"_blank">mvanderw@nd.edu</a>&gt; wrote:<br>
&gt;<br>
&gt; We can still do a manual configure on a system and attach the config.l=
og as well, if you&#39;d still like that. Just let us know.<br>
<br>
</span>Yes, I believe seeing a config log from your site could still be hel=
pful in tracking this down.<br>
<br>
I know the problem has been intermittent for you, but could you provide any=
 more information about your environment (especially afsd options) or appli=
cation(s) that trigger this?=C2=A0 So far I=E2=80=99ve not been able to rep=
roduce any getcwd issues in my tests with your kernel level and OpenAFS rel=
ease, so any tips on what triggers this for you would be helpful.<br>
<br>
Also, have you tried falling back to OpenAFS 1.6.20.2 or earlier?=C2=A0 If =
so, what were your results?=C2=A0 If not, could you try it and let us know?=
<br>
<br>
Thanks,<br>
=E2=80=94<br>
<span class=3D"m_-2791760394725895181m_5874276200659799872gmail-m_-79019855=
34335222437gmail-m_-543102750509118762gmail-m_8082137537802939750gmail-m_43=
53170453134064338m_567955491697094584m_-7323507014240503509m_-3846033447153=
959025m_8241078478367793376HOEnZb"><font color=3D"#888888">Mark Vitale<br>
OpenAFS release team<br>
<br>
</font></span></blockquote></div><br></div></div></div></div>
</blockquote></div><br></div></div></div></div></div>
</blockquote></div><br></div></div></div></div></div></div>

--f40304387b986ac881055c8994b6--