[OpenAFS] Re: RHEL 7.5 beta / 3.10.0-830.el7.x86_66 kernel lock up

Gary Gatling gsgatlin@ncsu.edu
Thu, 1 Feb 2018 10:58:00 -0500


--001a1140372c0f0cd0056428a910
Content-Type: text/plain; charset="UTF-8"

Ok. This gets weirder. Any directory under /afs says Not a directory. But I
can read files like

/afs/eos.ncsu.edu/software/inventory/software_inventory

just fine.

On Thu, Feb 1, 2018 at 10:55 AM, Gary Gatling <gsgatlin@ncsu.edu> wrote:

> I don't get a kernel panic but instead I get:
>
> [gsgatlin@localhost ~]$ ls /afs/
> ls: reading directory /afs/: Not a directory
> [gsgatlin@localhost ~]$
>
>
> which is pretty weird. I don't see anything in the syslog about problems
> with openafs
>
> Feb  1 10:44:24 localhost systemd: Starting OpenAFS Client Service...
> Feb  1 10:44:24 localhost kernel: libafs: loading out-of-tree module
> taints kernel.
> Feb  1 10:44:24 localhost kernel: libafs: module license '
> http://www.openafs.org/dl/license10.html' taints kernel.
> Feb  1 10:44:24 localhost kernel: Disabling lock debugging due to kernel
> taint
> Feb  1 10:44:24 localhost kernel: libafs: module verification failed:
> signature and/or required key missing - tainting kernel
> Feb  1 10:44:24 localhost kernel: Key type afs_pag registered
> Feb  1 10:44:24 localhost kernel: enabling dynamically allocated vcaches
> Feb  1 10:44:24 localhost kernel: Starting AFS cache scan...Memory cache:
> Allocating 1600 dcache entries...found 0 non-empty cache files (0%).
> Feb  1 10:44:24 localhost afsd: afsd: All AFS daemons started.
> Feb  1 10:44:24 localhost afsd: afsd: All AFS daemons started.
> Feb  1 10:44:24 localhost systemd: Started OpenAFS Client Service.
>
> I am using openafs-1.6.22
>
>
> with
>
> correct-m4-conditionals-in-curses.m4.patch
> linux-test-for-vfswrite-rather-than-vfsread.patch
> linux-use-kernelread-kernelwrite-when-vfs-varian.patch
>
> from the arch linux distro in my rpm packages.
>
> Anyone know what
>
> ls: reading directory /afs/: Not a directory
>
> means and is there some way around it?
>
> Also, is 1.6.22.2 coming out soon?
>
> Thanks so much,
>
> On Wed, Jan 31, 2018 at 9:43 AM, Kodiak Firesmith <kfiresmith@gmail.com>
> wrote:
>
>> https://photos.app.goo.gl/WgPsSUCLK5ojxIuH3
>>
>>
>> On Wed, Jan 31, 2018 at 9:41 AM, Kodiak Firesmith <kfiresmith@gmail.com>
>> wrote:
>>
>>> Folks, re-sending this because the first try never hit the list -
>>> perhaps mail with attachments are silently dropped or held for manual
>>> moderation?  I'd originally attached an image of the stack trace.  I'll
>>> host it and reply to this with a  URL link in case that would also result
>>> in a drop or moderation.
>>>
>>>
>>>
>>> Anyhow:
>>>
>>> In testing the new RHEL 7.5 beta, we've discovered that hosts using AFS
>>> fail to boot after the upgrade, with Openafs 1.6.22.1 installed.
>>>
>>> We are wondering if some of the non-guaranteed kernel ABIs that OpenAFS
>>> uses might have changed with the latest kernel provided in RHEL 7.
>>>
>>> I've attached a picture of the trace.
>>>
>>> Anyone else kicking the tires on the new RHEL yet?
>>>
>>> Thanks!
>>>
>>>
>>
>

--001a1140372c0f0cd0056428a910
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Ok. This gets weirder. Any directory under /afs says=C2=A0=
Not a directory. But I can read files like<div><br></div><div>/afs/<a href=
=3D"http://eos.ncsu.edu/software/inventory/software_inventory">eos.ncsu.edu=
/software/inventory/software_inventory</a><br></div><div><br></div><div>jus=
t fine.=C2=A0</div></div><div class=3D"gmail_extra"><br><div class=3D"gmail=
_quote">On Thu, Feb 1, 2018 at 10:55 AM, Gary Gatling <span dir=3D"ltr">&lt=
;<a href=3D"mailto:gsgatlin@ncsu.edu" target=3D"_blank">gsgatlin@ncsu.edu</=
a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quote" style=3D"margin:0=
 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir=3D"ltr">I d=
on&#39;t get a kernel panic but instead I get:<div><br></div><div><div>[gsg=
atlin@localhost ~]$ ls /afs/</div><div>ls: reading directory /afs/: Not a d=
irectory</div><div>[gsgatlin@localhost ~]$=C2=A0</div></div><div><br></div>=
<div><br></div><div>which is pretty weird. I don&#39;t see anything in the =
syslog about problems with openafs</div><div><br></div><div><div>Feb=C2=A0 =
1 10:44:24 localhost systemd: Starting OpenAFS Client Service...</div><div>=
Feb=C2=A0 1 10:44:24 localhost kernel: libafs: loading out-of-tree module t=
aints kernel.</div><div>Feb=C2=A0 1 10:44:24 localhost kernel: libafs: modu=
le license &#39;<a href=3D"http://www.openafs.org/dl/license10.html" target=
=3D"_blank">http://www.openafs.org/dl/<wbr>license10.html</a>&#39; taints k=
ernel.</div><div>Feb=C2=A0 1 10:44:24 localhost kernel: Disabling lock debu=
gging due to kernel taint</div><div>Feb=C2=A0 1 10:44:24 localhost kernel: =
libafs: module verification failed: signature and/or required key missing -=
 tainting kernel</div><div>Feb=C2=A0 1 10:44:24 localhost kernel: Key type =
afs_pag registered</div><div>Feb=C2=A0 1 10:44:24 localhost kernel: enablin=
g dynamically allocated vcaches</div><div>Feb=C2=A0 1 10:44:24 localhost ke=
rnel: Starting AFS cache scan...Memory cache: Allocating 1600 dcache entrie=
s...found 0 non-empty cache files (0%).</div><div>Feb=C2=A0 1 10:44:24 loca=
lhost afsd: afsd: All AFS daemons started.</div><div>Feb=C2=A0 1 10:44:24 l=
ocalhost afsd: afsd: All AFS daemons started.</div><div>Feb=C2=A0 1 10:44:2=
4 localhost systemd: Started OpenAFS Client Service.</div><div><br></div></=
div><div>I am using=C2=A0openafs-1.6.22</div><div><br></div><div><br></div>=
<div>with</div><div><br></div><div>correct-m4-conditionals-in-<wbr>curses.m=
4.patch<br></div><div>linux-test-for-vfswrite-<wbr>rather-than-vfsread.patc=
h<br></div><div>linux-use-kernelread-<wbr>kernelwrite-when-vfs-varian.<wbr>=
patch<br></div><div><br></div><div>from the arch linux distro in my rpm pac=
kages.</div><div><br></div><div>Anyone know what=C2=A0</div><div><br></div>=
<div>ls: reading directory /afs/: Not a directory<br></div><div><br></div><=
div>means and is there some way around it?</div><div><br></div><div>Also, i=
s 1.6.22.2 coming out soon?</div><div><br></div><div>Thanks so much,</div><=
/div><div class=3D"HOEnZb"><div class=3D"h5"><div class=3D"gmail_extra"><br=
><div class=3D"gmail_quote">On Wed, Jan 31, 2018 at 9:43 AM, Kodiak Firesmi=
th <span dir=3D"ltr">&lt;<a href=3D"mailto:kfiresmith@gmail.com" target=3D"=
_blank">kfiresmith@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"=
gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-=
left:1ex"><div dir=3D"ltr"><a href=3D"https://photos.app.goo.gl/WgPsSUCLK5o=
jxIuH3" target=3D"_blank">https://photos.app.goo.gl/WgPs<wbr>SUCLK5ojxIuH3<=
/a><br><div><br></div></div><div class=3D"m_4185175457039224222HOEnZb"><div=
 class=3D"m_4185175457039224222h5"><div class=3D"gmail_extra"><br><div clas=
s=3D"gmail_quote">On Wed, Jan 31, 2018 at 9:41 AM, Kodiak Firesmith <span d=
ir=3D"ltr">&lt;<a href=3D"mailto:kfiresmith@gmail.com" target=3D"_blank">kf=
iresmith@gmail.com</a>&gt;</span> wrote:<br><blockquote class=3D"gmail_quot=
e" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">=
<div dir=3D"ltr">Folks, re-sending this because the first try never hit the=
 list - perhaps mail with attachments are silently dropped or held for manu=
al moderation?=C2=A0 I&#39;d originally attached an image of the stack trac=
e.=C2=A0 I&#39;ll host it and reply to this with a=C2=A0 URL link in case t=
hat would also result in a drop or moderation.<div><br></div><div><br></div=
><div><br></div><div>Anyhow:=C2=A0=C2=A0</div><div><br></div><div><div styl=
e=3D"color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font=
-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-w=
eight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-trans=
form:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,=
255);text-decoration-style:initial;text-decoration-color:initial">In testin=
g the new RHEL 7.5 beta, we&#39;ve discovered that hosts using AFS fail to =
boot after the upgrade, with Openafs 1.6.22.1 installed.=C2=A0=C2=A0</div><=
div style=3D"color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.=
8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:norma=
l;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;te=
xt-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(=
255,255,255);text-decoration-style:initial;text-decoration-color:initial"><=
br></div><div style=3D"color:rgb(34,34,34);font-family:arial,sans-serif;fon=
t-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-=
caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-ind=
ent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-=
color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:=
initial">We are wondering if some of the non-guaranteed kernel ABIs that Op=
enAFS uses might have changed with the latest kernel provided in RHEL 7.=C2=
=A0=C2=A0</div><div style=3D"color:rgb(34,34,34);font-family:arial,sans-ser=
if;font-size:12.8px;font-style:normal;font-variant-ligatures:normal;font-va=
riant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;te=
xt-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;backg=
round-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-=
color:initial"><br></div><div style=3D"color:rgb(34,34,34);font-family:aria=
l,sans-serif;font-size:12.8px;font-style:normal;font-variant-ligatures:norm=
al;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-alig=
n:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing=
:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-d=
ecoration-color:initial">I&#39;ve attached a picture of the trace.</div><di=
v style=3D"color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8p=
x;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;=
font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text=
-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(25=
5,255,255);text-decoration-style:initial;text-decoration-color:initial"><br=
></div><div style=3D"color:rgb(34,34,34);font-family:arial,sans-serif;font-=
size:12.8px;font-style:normal;font-variant-ligatures:normal;font-variant-ca=
ps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-inden=
t:0px;text-transform:none;white-space:normal;word-spacing:0px;background-co=
lor:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:in=
itial">Anyone else kicking the tires on the new RHEL yet?</div><div style=
=3D"color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12.8px;font-=
style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-we=
ight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transf=
orm:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,2=
55);text-decoration-style:initial;text-decoration-color:initial"><br></div>=
<div style=3D"color:rgb(34,34,34);font-family:arial,sans-serif;font-size:12=
.8px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:norm=
al;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;t=
ext-transform:none;white-space:normal;word-spacing:0px;background-color:rgb=
(255,255,255);text-decoration-style:initial;text-decoration-color:initial">=
Thanks!</div><br></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>

--001a1140372c0f0cd0056428a910--