[OpenAFS] Re: Volume missing

Douglas E. Engert deengert@anl.gov
Fri, 02 Sep 2011 17:31:58 -0500


On 9/2/2011 7:52 AM, vitor lima wrote:
> ===================================================================
> root@server0:~# bos status server0.cell.name <http://server0.cell.name>
> Instance ptserver, currently running normally.
> Instance vlserver, currently running normally.
> Instance fs, currently running normally.
>      Auxiliary status is: file server running.
> root@server0:~# bos status server1.cell.name <http://server1.cell.name>
> Instance ptserver, currently running normally.
> Instance vlserver, currently running normally.
> Instance fs, currently running normally.
>      Auxiliary status is: file server running.
>
> ====================================================================
> root@server0:~# bos listhost server0.cell.name <http://server0.cell.name>
> Cell name is cell.name <http://cell.name>
>      Host 1 is server0
> root@server0:~# bos listhost server1.cell.name <http://server1.cell.name>
> Cell name is cell.name <http://cell.name>
>      Host 1 is server1

It looks like your two database servers each thinking they are the only
server in the cell. So they don't communicate with each other.
You are in fact running two cells both having the same name
and used the same key.

Because of this the file servers can still move volumes between them,
and the updates for the databases goes to one or the other database server.

This is very screwed up configuration.

>
> ====================================================================
> root@server0:~# vos listvol server0.cell.name <http://server0.cell.name>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepa: 4
> root.afs                          536870915 RW          4 K On-line
> root.cell                         536870918 RW         66 K On-line
> user.aborba                       536870945 RW    2890718 K On-line
> user.aborba.backup                536870947 BK    2890717 K On-line
>
> Total volumes onLine 4 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepb: 2
> user.apache                       536871105 RW         13 K On-line
> user.apache.backup                536871107 BK         12 K On-line
>
> Total volumes onLine 2 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepc: 0
>
> Total volumes onLine 0 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepd: 3
> svn.main                          536871108 RW        498 K On-line
> user.roma                         536870963 RW   97696636 K On-line
> user.roma.backup                  536870965 BK   97177181 K On-line
>
> Total volumes onLine 3 ; Total volumes offLine 0 ; Total busy 0
>
> ===============================================================================
> root@server0:~# vos listvol server1.cell.name <http://server1.cell.name>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepa: 38
> root.afs                          536870912 RW          4 K On-line
> root.cell                         536870915 RW         60 K On-line
> user.aborba                       536870945 RW    2890717 K On-line
> user.andreuler                    536870985 RW     264468 K On-line
> user.araujofpinto                 536871065 RW     248432 K On-line
> user.asano                        536871005 RW      56919 K On-line
> user.catalina                     536870936 RW    1015742 K On-line
> user.csokol                       536870976 RW    1531699 K On-line
> user.csokol.backup                536870978 BK    1517563 K On-line
> user.dazeredo                     536870933 RW    1170702 K On-line
> user.diane                        536871014 RW    2453892 K On-line
> user.dtonini                      536871056 RW     240927 K On-line
> user.fcavalcanti                  536870979 RW     315382 K On-line
> user.fnfranco                     536871053 RW     279159 K On-line
> user.guest1                       536871183 RW     183177 K On-line
> user.guest1.backup                536871185 BK     183177 K On-line
> user.guest2                       536871186 RW     189120 K On-line
> user.guest2.backup                536871188 BK     189119 K On-line
> user.guest3                       536871189 RW     189997 K On-line
> user.guest3.backup                536871191 BK     165647 K On-line
> user.jstern                       536870982 RW         10 K On-line
> user.larams                       536871080 RW     142973 K On-line
> user.lfclemes                     536871071 RW     204235 K On-line
> user.marcelg                      536871077 RW     290264 K On-line
> user.montanhe                     536871068 RW    2837710 K On-line
> user.mvpg                         536870930 RW     448975 K On-line
> user.nelsonvn                     536870966 RW    2167418 K On-line
> user.niski                        536870960 RW     254485 K On-line
> user.pedrosp                      536870957 RW    4076934 K On-line
> user.pribeiro                     536870999 RW     260416 K On-line
> user.priscila                     536870954 RW    1524050 K On-line
> user.renatobb                     536870942 RW     283314 K On-line
> user.rteles                       536871062 RW         12 K On-line
> user.sonia                        536871074 RW     461750 K On-line
> user.villar                       536870951 RW     667803 K On-line
> user.vitor                        536871177 RW     494948 K On-line
> user.vitor.backup                 536871179 BK     497186 K On-line
> user.viviane                      536871002 RW         13 K On-line
>
> Total volumes onLine 38 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepb: 26
> user.aef                          536871129 RW     259844 K On-line
> user.alessandro                   536871171 RW         12 K On-line
> user.alvarohenry                  536870996 RW     211553 K On-line
> user.antonioc                     536871099 RW     176038 K On-line
> user.arlane                       536871180 RW     256405 K On-line
> user.barone                       536871135 RW     229675 K On-line
> user.claudiag                     536871102 RW    1801132 K On-line
> user.digao                        536871162 RW     171020 K On-line
> user.foo                          536871141 RW         12 K On-line
> user.forger                       536871153 RW     155389 K On-line
> user.integrade                    536871132 RW     313033 K On-line
> user.jecs                         536871156 RW     267578 K On-line
> user.jlp                          536871159 RW         12 K On-line
> user.lsantos                      536871168 RW         12 K On-line
> user.luciane                      536871087 RW     191773 K On-line
> user.luizyamamoto                 536871026 RW     184215 K On-line
> user.matlab                       536871138 RW         12 K On-line
> user.mcaetano                     536870927 RW     643253 K On-line
> user.oda                          536870921 RW    1289974 K On-line
> user.pablo                        536870993 RW     166585 K On-line
> user.pricila                      536871093 RW     209390 K On-line
> user.ricardo                      536870939 RW    1100968 K On-line
> user.rudi                         536871123 RW     274710 K On-line
> user.saito                        536871174 RW       1945 K On-line
> user.tony                         536871165 RW     166376 K On-line
> user.vmaciel                      536871090 RW       9183 K On-line
>
> Total volumes onLine 26 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepc: 0
>
> Total volumes onLine 0 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepd: 0
>
> Total volumes onLine 0 ; Total volumes offLine 0 ; Total busy 0
>
> ===============================================================================
> root@server0:~# vos listvol server0.cell.name <http://server0.cell.name>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepa: 4
> root.afs                          536870915 RW          4 K On-line
> root.cell                         536870918 RW         66 K On-line
> user.aborba                       536870945 RW    2890718 K On-line
> user.aborba.backup                536870947 BK    2890717 K On-line
>
> Total volumes onLine 4 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepb: 2
> user.apache                       536871105 RW         13 K On-line
> user.apache.backup                536871107 BK         12 K On-line
>
> Total volumes onLine 2 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepc: 0
>
> Total volumes onLine 0 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server0.cell.name <http://server0.cell.name> partition /vicepd: 3
> svn.main                          536871108 RW        498 K On-line
> user.roma                         536870963 RW   97696636 K On-line
> user.roma.backup                  536870965 BK   97177181 K On-line
>
> Total volumes onLine 3 ; Total volumes offLine 0 ; Total busy 0
>
> root@server1:~# vos listvol server1.cell.name <http://server1.cell.name>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepa: 38
> root.afs                          536870912 RW          4 K On-line
> root.cell                         536870915 RW         60 K On-line
> user.aborba                       536870945 RW    2890717 K On-line
> user.andreuler                    536870985 RW     264468 K On-line
> user.araujofpinto                 536871065 RW     248432 K On-line
> user.asano                        536871005 RW      56919 K On-line
> user.catalina                     536870936 RW    1015742 K On-line
> user.csokol                       536870976 RW    1531699 K On-line
> user.csokol.backup                536870978 BK    1517563 K On-line
> user.dazeredo                     536870933 RW    1170702 K On-line
> user.diane                        536871014 RW    2453892 K On-line
> user.dtonini                      536871056 RW     240927 K On-line
> user.fcavalcanti                  536870979 RW     315382 K On-line
> user.fnfranco                     536871053 RW     279159 K On-line
> user.guest1                       536871183 RW     183177 K On-line
> user.guest1.backup                536871185 BK     183177 K On-line
> user.guest2                       536871186 RW     189120 K On-line
> user.guest2.backup                536871188 BK     189119 K On-line
> user.guest3                       536871189 RW     189997 K On-line
> user.guest3.backup                536871191 BK     165647 K On-line
> user.jstern                       536870982 RW         10 K On-line
> user.larams                       536871080 RW     142973 K On-line
> user.lfclemes                     536871071 RW     204235 K On-line
> user.marcelg                      536871077 RW     290264 K On-line
> user.montanhe                     536871068 RW    2837710 K On-line
> user.mvpg                         536870930 RW     448975 K On-line
> user.nelsonvn                     536870966 RW    2167418 K On-line
> user.niski                        536870960 RW     254485 K On-line
> user.pedrosp                      536870957 RW    4076934 K On-line
> user.pribeiro                     536870999 RW     260416 K On-line
> user.priscila                     536870954 RW    1524073 K On-line
> user.renatobb                     536870942 RW     283314 K On-line
> user.rteles                       536871062 RW         12 K On-line
> user.sonia                        536871074 RW     461750 K On-line
> user.villar                       536870951 RW     667803 K On-line
> user.vitor                        536871177 RW     495260 K On-line
> user.vitor.backup                 536871179 BK     497186 K On-line
> user.viviane                      536871002 RW         13 K On-line
>
> Total volumes onLine 38 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepb: 26
> user.aef                          536871129 RW     259844 K On-line
> user.alessandro                   536871171 RW         12 K On-line
> user.alvarohenry                  536870996 RW     211553 K On-line
> user.antonioc                     536871099 RW     176038 K On-line
> user.arlane                       536871180 RW     256405 K On-line
> user.barone                       536871135 RW     229675 K On-line
> user.claudiag                     536871102 RW    1801132 K On-line
> user.digao                        536871162 RW     171020 K On-line
> user.foo                          536871141 RW         12 K On-line
> user.forger                       536871153 RW     155389 K On-line
> user.integrade                    536871132 RW     313033 K On-line
> user.jecs                         536871156 RW     267578 K On-line
> user.jlp                          536871159 RW         12 K On-line
> user.lsantos                      536871168 RW         12 K On-line
> user.luciane                      536871087 RW     191773 K On-line
> user.luizyamamoto                 536871026 RW     184215 K On-line
> user.matlab                       536871138 RW         12 K On-line
> user.mcaetano                     536870927 RW     643253 K On-line
> user.oda                          536870921 RW    1289974 K On-line
> user.pablo                        536870993 RW     166585 K On-line
> user.pricila                      536871093 RW     209390 K On-line
> user.ricardo                      536870939 RW    1100968 K On-line
> user.rudi                         536871123 RW     274710 K On-line
> user.saito                        536871174 RW       1945 K On-line
> user.tony                         536871165 RW     166376 K On-line
> user.vmaciel                      536871090 RW       9183 K On-line
>
> Total volumes onLine 26 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepc: 0
>
> Total volumes onLine 0 ; Total volumes offLine 0 ; Total busy 0
>
> Total number of volumes on server server1.cell.name <http://server1.cell.name> partition /vicepd: 0
>
> Total volumes onLine 0 ; Total volumes offLine 0 ; Total busy 0
>

-- 

  Douglas E. Engert  <DEEngert@anl.gov>
  Argonne National Laboratory
  9700 South Cass Avenue
  Argonne, Illinois  60439
  (630) 252-5444