[OpenAFS] OpenAFS Newsletter, Issue 8, December 2009

Jason Edgecombe jason@rampaginggeek.com
Mon, 14 Dec 2009 20:44:38 -0500


Here is the December 2009 issue of the OpenAFS Newsletter. An HTML 
version is available at
http://www.openafs.org/newsletter/newsletter-2009-12-volume001-issue08.html

OpenAFS Newsletter, Issue 8, December 2009
    Welcome to the eighth issue of the OpenAFS newsletter. This newsletter
    summarizes what is happening in the OpenAFS community.

    As always, volunteers, patches, bug reports, or any other type of help
    is greatly appreciated.

    Feedback on this newsletter is welcome. The goal is to summarize the
    various development efforts and news of OpenAFS for the community.
    Please let Jason Edgecombe <jason@rampaginggeek.com> know what you would
    like to see out of this newsletter. Any news about AFS-related projects
    is welcome and may be submitted to Jason for inclusion in the next
    newsletter.

    The current and past issues of this newsletter are available at
    <http://www.openafs.org/newsletter/>

    I hope everyone enjoys the holidays.

  General OpenAFS Progress
    OpenAFS 1.5.68 was released on December 8. Key highlights include
    dynamic server ranking based on network conditions and support for more
    than 128 fileserver threads.

    Disk cache performance on Fedora 12 may be poor because of IMA support
    in the kernel. Using a memory cache or recompiling the kernel to disable
    IMA support are workarounds. Fixing this in the long-term may require
    reworking how the disk cache accesses files.

    Mike Meffie pointed out that a fileserver lockup was fixed recently. Bug
    124097 was fixed commit 416e2f11c35f5d55f91090b30b4db1a9bf6d6e0 which
    was pulled into the 1.4.x branch and should make it into the next 1.4.x
    release.

  Events
   Annual Best Practices Workshop
    Plans are already underway for the seventh Workshop, to be held May
    24-28, 2010, at the University of Illinois at Urbana-Champaign. We hope
    to see you there.

   European AFS Conference
    The date for the 3rd European AFS & Kerberos Conference has been set.
    The conference will take place in Pilsen, Czech Republic, from September
    13 to September 15, 2010. More details are forthcoming and will be
    posted at <http://afs2010.civ.zcu.cz>.

  AFS Protocol Standardization
    Informal drafts that haven't been uploaded to the IETF web site:

    Rx Spec:

    <http://openafs.sinenomine.net/~mmeffie/rfc/draft-zeldovich-rx-spec-00.h
    tml>

    Discussion on these proposals is welcome and should be done on the
    AFS3-standardization list at
    <http://michigan-openafs-lists.central.org/mailman/listinfo/afs3-standar
    dization>

   PTS Alternate Authentication
    <http://tools.ietf.org/html/draft-brashear-afs3-pts-extended-names-00>

    Status: Active - Second call for review

    As before, I've written up a draft based on the 2004 Stockholm AFSig
    hackathon discussion of the PTS alternate authentication names proposal,
    as modified based on further feedback and the 2009 Edinburgh Hackathon.
    Comments welcome and encouraged.

    --Derrick Brashear

   AFS Callback Extensions
    <http://www.ietf.org/id/draft-benjamin-extendedcallbackinfo-00.txt>

    Status: Active - Needs more discussion

    We need to decide whether we're going to wait for the RPC refresh
    changes before publishing extended callbacks. My belief is that that's
    the only factor currently delaying this document. The question here,
    essentially, is whether anyone would deploy extended callbacks before
    deploying updated RPCs. To date, nobody has said they would do so.

    --Simon Wilkinson

   DNS SRV Resource Records for AFS
    <http://tools.ietf.org/html/draft-allbery-afs-srv-records-01>

    Status: Last Call before IETF submission

        This is a last call for any further feedback, corrections, or
        comments on draft-allbery-afs-srv-records-01 before I ask about
        advancing it as an RFC independent submission. The current text is
        available at:

        <http://tools.ietf.org/id/draft-allbery-afs-srv-records>

        Please send any further comments before December 14th. If I have not
        heard anything by that point that seems to question consensus on
        this document, I will approach the Application Area ADs and ask
        their opinion about whether to proceed as an independent submission
        as an informational RFC or whether they feel this should be
        standards track for any reason. (I suspect that informational is
        correct since AFS is not an IETF protocol, but I want to ask just in
        case.)

        --Russ Allbery

  Projects
   Demand-Attach FileServer (DAFS)
    Project Contacts:

    *   Andrew Deason <adeason@sinenomine.net>

    *   Tom Keiser <tkeiser@sinenomine.net>

    *   Mike Meffie <mmeffie@sinenomine.net>

    The fix for 124484 (volserver salvages) in gerrit 786/787 has been a
    little delayed from trying to agree on new volume package APIs, but
    progress is being made. Another notable DAFS change undergoing review is
    in gerrit 880, which can dramatically speed up salvages. DAFS developer
    documentation is being actively worked on, and should be available
    sometime soon.

    --Andrew

   Better Documentation
    Project Contacts:

    *   Russ Allbery <rra@stanford.edu>

    *   Jason Edgecombe <jason@rampaginggeek.com>

    Simon Wilkinson made a small correction in the pt_util man page.

   Userspace cache manager
    Project Contact:

    *   Andrew Deason <adeason@sinenomine.net>

    Pioctl emulation is working for ACL and mountpoint manipulation. I'm
    working on cleaning up my patchsets to be suitable for gerrit
    submission.

    --Andrew

   SetAG
    Project Contact:

    *   Alberto Mancini <ab.mancini@gmail.com>

    Project Description:

    During the developement of a web-interface for AFS (still in progress,
    see "AFS access through the web", "European AFS meeting 2009"), we found
    that the use of PAGs (shared between threads) to keep credentials forces
    inefficient choices in the development of some applications (e.g.
    authenticated web services), so we switched to a more fine grained
    "credential pointer", named AG, that can be associated to just a thread.

    Current Status: We have a sample implementation for Linux based on
    openafs 1.4, stable enough for our in house development; we are planning
    the porting to openafs 1.5.

    There is a tiny Java wrapper (jni) that provides access to the 'AG'
    functionality so that tokens are associated to single threads, of course
    we also wrapped ktc_SetToken to authenticate in java.

    --Alberto

   OpenAFS Server Preference Based on Network Conditions
    Project Contact:

    *   Jake Thebault-Spieker <summatusmentis@gmail.com>

    These changes have been merged into the master and 1.5.x branches. They
    are included in v1.5.58. This section will be part of the general
    OpenAFS news in future newsletters.

   Projects with no progress or no update
    Each project without progress this month is listed along with the month
    of the last update.

    *   Disconnected AFS support - June 2009

    *   Rx OSD integration & Raw Vicep Access in Clients - August 2009

    *   Extended Callback Information - October 2009

    *   *BSD Support - October 2009

    *   Mac OS X OpenAFS Preference Pane - November 2009

    *   Kerberos v5 and multiple encryption types - November 2009

    *   S3 Front-end for AFS - November 2009

    *   Active Directory Backend for Ptserver - November 2009

    *   Virtual Machine Images - November 2009

  Gerrit Activity
    To review a change, go to http://gerrit.openafs.org/#change,NUM where
    NUM is the Change# shown in the lists below.

   Statistics
     Number of patches waiting for review: 27 (last month: 36)

     Patches merged into the master branch:
     Month   Number of Commits
     2009-12   24  (Partial month)
     2009-11   86
     2009-10  154
     2009-09  142
     2009-08   78
     2009-07  181

     Patches merged into the stable branch:
     Month   Number of Commits
     2009-12   2 (Partial month)
     2009-11  21
     2009-10   7
     2009-09   8
     2009-08  17
     2009-07   5

   Patches waiting for review
     Date       Author         Change# Description
     2009-12-11 Claudio Bisegni  (906) OpenAFS Preference Pane Now the 
preference pane is fat compiled.
     2009-12-11 Andrew Deason    (787) DAFS: Allow non-fileserver to 
schedule salvages
     2009-12-10 Michael Meffie   (905) Prefix global defines
     2009-12-10 Michael Meffie   (855) Consolidate duplicate definitions
     2009-12-08 Jeffrey Altman   (900) Windows: return ENOMEM from 
cm_BPlus functions on malloc failure
     2009-12-03 Andrew Deason    (880) DAFS: Maintain viced volume group 
hierarchy cache
     2009-12-02 Simon Wilkinson  (794) Add printf format checks to 
afs_com_err()
     2009-12-02 Simon Wilkinson  (793) Add printf format checks to 
util's log functions
     2009-12-01 Andrew Deason    (870) Add the 'vos endtrans' command
     2009-11-29 Andrew Deason    (875) Make ubik use unsigned addresses
     2009-11-21 Simon Wilkinson  (837) Move GLOCK initialisation to 
platform directories
     2009-11-20 Simon Wilkinson  (838) Kernel is always defined
     2009-11-19 Marc Dionne      (847) src/pam warning fixes
     2009-11-18 Andrew Deason    (709) Break origin's callback for 
RXAFS_Rename target
     2009-11-18 Simon Wilkinson  (796) Add printf format checks to the 
rest of tree
     2009-11-12 Simon Wilkinson  (792) Add printf format checks to the 
cache manager
     2009-11-12 Derrick Brashear (783) conservative dynamic vcache fix 
for 14x
     2009-11-12 Simon Wilkinson  (795) Add printf format checks to rx
     2009-11-04 Derrick Brashear (451) macos knote fsevents hinting
     2009-11-04 Andrew Deason    (436) Avoid unnecessarily updating .. 
in SAFSS_Rename
     2009-11-04 Evan Broder      (778) Increase the maximum number of 
sysnames
     2009-11-04 Michael Meffie   (215) Print throttled packet counts 
with rxdebug
     2009-10-26 Jacob Thebault-Spieker (433) Add throughput framework to 
cm_RankServer()
     2009-09-09 Matt Benjamin    (435) clear stat flag on renamed 
directories
     2009-08-29 Matt Benjamin    (376) K5SSL by Marcus Watts
     2009-07-29 Michael Meffie   (147) Fix bosserver directory creation
     2009-07-24 Hartmut Reuter    (70) preparing rxosd integration: 
change in AFSFetchStatus

   Patches merged into the master branch
     Date       Author         Change# Description
     2009-12-10 Andrew Deason    (786) Expand ProgramType enumeration
     2009-12-10 Simon Wilkinson  (903) Linux: Use splice to speed up 
cache storeback
     2009-12-10 Simon Wilkinson  (902) Rework cache store back
     2009-12-10 Marc Dionne      (904) Linux: deal with ctl_name removal
     2009-12-08 Simon Wilkinson  (901) pt_util runs on database servers
     2009-12-08 Jeffrey Altman   (892) Windows: cm_BPlusEnumAlloc should 
not fail for zero entries
     2009-12-08 Jeffrey Altman   (893) Windows: cm_BPlusDirBuildTree can 
fail
     2009-12-08 Derrick Brashear (896) macos avoid dotunderbar lookups 
in fakestat mode
     2009-12-07 Derrick Brashear (898) add newline to lockprocs_prototypes.h
     2009-12-07 Andrew Deason    (869) Dump all hostFlags in hosts.dump
     2009-12-07 Andrew Deason    (895) Make HandleClientContext take an 
afs_ucred_t
     2009-12-07 Simon Wilkinson  (894) Remove AFS_USEBUFFERS
     2009-12-05 Derrick Brashear (891) Windows: Version update for 1.5.68
     2009-12-05 Derrick Brashear (889) rx packet dumper not in kernel
     2009-12-05 Derrick Brashear (888) unix 1.5.68
     2009-12-04 Jeffrey Altman   (887) Fix midnight volume calculation 
to build on Windows
     2009-12-04 Rainer Toebbicke (849) Calculate midnight (for volume 
stats) based on standard functions
     2009-12-04 Jeffrey Altman   (886) Windows: Version update for 1.5.67
     2009-12-04 Derrick Brashear (885) unix 1.5.67
     2009-12-04 Derrick Brashear (883) add rx packet trace debug dumping 
for unix
     2009-12-03 Jeffrey Altman   (884) Windows: change notes for 1.5.67 
release
     2009-12-03 Derrick Brashear (881) add unlock support to afscp
     2009-12-03 Jeffrey Altman   (319) Use xdr_alloc and xdr_free within 
ptuser
     2009-12-01 Michael Meffie   (879) shutdown_icl return type void
     2009-11-30 Andrew Deason    (736) Correct duplicate special inodes 
while salvaging
     2009-11-29 Marc Dionne      (860) Warning fixes - key handling
     2009-11-29 Andrew Deason    (876) Add server prefix to utst_int.xg
     2009-11-28 Andrew Deason    (863) Add safety checks on all hostList 
traversals
     2009-11-28 Andrew Deason    (873) Add a watchdog timer for 
ShutDownAndCore(PANIC)
     2009-11-28 Andrew Deason    (871) Correct include paths in 
fs_conv_sol26.c
     2009-11-28 Andrew Deason    (872) 'Flexible client buffer growth' 
fallout
     2009-11-26 Jeffrey Altman   (868) Windows: Fix test for setting 
FILE_ATTR_READONLY
     2009-11-25 Rainer Toebbicke (799) Flexible client buffer growth
     2009-11-24 Jeffrey Altman   (859) Windows: disable readonly volume 
versioning due to file server bug
     2009-11-24 Jeffrey Altman   (858) Windows: cm_TryBulkStatus 
processing changes
     2009-11-24 Jeffrey Altman   (852) Windows: provide enhanced error 
output to aklog
     2009-11-24 Jeffrey Altman   (857) Windows: when assigning a new 
clientModTime, hold a lock
     2009-11-24 Jeffrey Altman   (854) Windows: modify 
src/rxkad/NTMakefile to avoid file copies
     2009-11-24 Jeffrey Altman   (856) viced: set volume sync data in 
bulk status rpcs
     2009-11-23 Marc Dionne      (730) Linux: Keyrings PAG handling changes
     2009-11-23 Marc Dionne      (867) Remove "unused" warnings from lex 
generated files
     2009-11-23 Marc Dionne      (864) Linux: hinting removal fallout
     2009-11-21 Marc Dionne      (865) Revert "osi_UFSOpen returns 
struct osi_file *"
     2009-11-20 Simon Wilkinson  (851) osi_UFSOpen returns struct osi_file *
     2009-11-20 Simon Wilkinson  (850) Remove inode hinting for dcaches
     2009-11-20 Andrew Deason    (845) Define afs_maxvcount everywhere
     2009-11-20 Simon Wilkinson  (820) Fix prepare and commit_write to 
do the right thing
     2009-11-20 Simon Wilkinson  (726) Linux: Use atomics for credential 
reference counts
     2009-11-19 Andrew Deason    (846) Define WCOREDUMP in salvsync-server.c
     2009-11-19 Simon Wilkinson  (834) Rationalise our include paths
     2009-11-19 Mickey Lane      (840) Fix 2 errors in Windows release Notes
     2009-11-19 Jeffrey Altman   (824) Windows: cm_BkgDaemon requeuing 
only applies to BkgStore
     2009-11-19 Jeffrey Altman   (827) Windows: Improvements to 
background fetch processing
     2009-11-19 Jeffrey Altman   (828) Windows: buf_DirtyBuffersExist 
uses fileHashp not allp list pointer
     2009-11-19 Jeffrey Altman   (829) Windows: Permit custom version 
numbers and default cellname
     2009-11-18 Andrew Deason    (842) Define T_SRV when not defined for us
     2009-11-18 Andrew Deason    (843) src/afs/afs_user.c typo
     2009-11-18 Andrew Deason    (844) AIX: Missing brace in 
afs_vnop_flock.c
     2009-11-18 Matt Benjamin    (584) viced ihandle boost
     2009-11-18 Simon Wilkinson  (839) Name chunkOps structure elements
     2009-11-18 Michael Meffie   (841) fix for volser transaction object 
race conditions
     2009-11-18 Simon Wilkinson  (835) Linux: Fix lock ordering
     2009-11-18 Marc Dionne      (836) aklog build fix: com_err.h header
     2009-11-17 Derrick Brashear (832) ktc remove unused variable
     2009-11-17 Simon Wilkinson  (822) Translate messages from ktc_SetToken
     2009-11-17 Simon Wilkinson  (821) Better errors from aklog
     2009-11-17 Derrick Brashear (818) asm unexecutable stack
     2009-11-16 Jeffrey Altman   (825) Windows: Code signing with 
cross-signed certificates
     2009-11-16 Jeffrey Altman   (831) Windows: Use STATUS_IO_TIMEOUT 
where STATUS_TIMEOUT was returned
     2009-11-16 Jeffrey Altman   (826) Windows: Error mapping for VBUSY 
and VRESTARTING
     2009-11-15 Jeffrey Altman   (830) Windows: Fix port assignment to 
use network byte order
     2009-11-15 Jeffrey Altman   (791) Windows: ports in the cache 
manager are stored in network byte order
     2009-11-13 Andrew Deason    (815) Make ktc_curpag also detect 
ONEGROUP PAG gids
     2009-11-13 Simon Wilkinson  (819) Use set_page_writeback and 
end_page_writeback
     2009-11-11 Marc Dionne      (797) Linux: Use the kernel's 
credentials structure
     2009-11-11 Andrew Deason    (814) Do not check *aoutSize in PGetPAG
     2009-11-11 Simon Wilkinson  (813) Update warning inhibition
     2009-11-11 Simon Wilkinson  (812) Prototype kalog_Init
     2009-11-11 Simon Wilkinson  (811) const char paths for ubik_ServerInit
     2009-11-11 Simon Wilkinson  (810) Fix des key type issue in bosoprocs
     2009-11-11 Simon Wilkinson  (809) Prototype UV_Bind
     2009-11-11 Simon Wilkinson  (807) Remove 'M' variants of lock macros
     2009-11-11 Simon Wilkinson  (808) Fix warnings from 
afsconf_SetExtendedCellInfo
     2009-11-11 Simon Wilkinson  (806) Include signal.h for sigfillset
     2009-11-11 Marc Dionne      (804) krb_udp.c warning fix
     2009-11-11 Michael Meffie   (800) cm: address race condition in 
afs_QueueVCB
     2009-11-11 Simon Wilkinson  (805) cr_gid is already used by Darwin
     2009-11-11 Marc Dionne      (803) src/pam/afs_auth.c warning fix
     2009-11-10 Derrick Brashear (801) unix srv record network byte 
order fix
     2009-11-10 Russ Allbery     (798) Update afsd cache and firewall 
details
     2009-11-10 Simon Wilkinson  (802) Fix locking in FlushVCBs when 
called from discon
     2009-11-09 Marc Dionne      (768) Unix client: wrappers for 
credentials structure access
     2009-11-09 Michael Meffie   (764) viced: avoid useless core if 
shutdown during initialization
     2009-11-08 Simon Wilkinson  (789) Add printf-style format checking
     2009-11-08 Simon Wilkinson  (785) Complete removal of DUX client code
     2009-11-08 Marc Dionne      (790) Linux: always use 
afs_maybe_unlock_kernel
     2009-11-08 Simon Wilkinson  (784) Move vnode macros to their own 
directories
     2009-11-07 Simon Wilkinson  (788) Add error_table.c to gitignore in 
comerr
     2009-11-05 Andrew Deason    (782) Cleanup VOffline log message
     2009-11-05 Simon Wilkinson  (781) Prevent VLRUQ race in 
ShakeLooseVCaches
     2009-11-04 Rainer Toebbicke (756) Correct diskused and files when 
cloning a volume
     2009-11-04 Derrick Brashear (772) macos fstrace msgcat search path
     2009-11-04 Derrick Brashear (771) macos 10.6 64bit trace fixes
     2009-11-04 Marc Dionne      (752) Linux - Fix disk cache access for 
selinux/AppArmor constrained processes
     2009-11-03 Andrew Deason    (716) Check for (hostFlags & 
HOSTDELETED) after h_Lock_r
     2009-11-03 Andrew Deason    (765) DAFS: Avoid SALVSYNC 
communication during shutdown
     2009-11-03 Andrew Deason    (769) DAFS: Wait for exclusive ops in 
FSYNC_VOL_OFF
     2009-11-02 Dan Hyde         (757) Add array bounds checking in 
h_Enumerate
     2009-11-02 Marc Dionne      (759) Linux: Fix write_begin configure 
test for recent RHEL kernels
     2009-11-02 Marc Dionne      (758) Fix memory allocation warnings at 
shutdown

   Patches merged into the stable branch
     Date       Author         Change# Description
     2009-12-01 Andrew Deason    (882) Correct duplicate special inodes 
while salvaging
     2009-12-01 Michael Meffie   (877) shutdown_icl returns void
     2009-11-30 Andrew Deason    (878) Modify Solaris Rx NetIfPoller to 
avoid Panic
     2009-11-28 Rainer Toebbicke (874) Avoid IHandle leak when failing 
to attach volume
     2009-11-23 Andrew Deason    (776) Check for (hostFlags & 
HOSTDELETED) after h_Lock_r
     2009-11-20 Andrew Deason    (862) Add array bounds checking in 
h_Enumerate
     2009-11-19 Michael Meffie   (619) volser transaction object race 
conditions
     2009-11-19 Andrew Deason    (853) Make ktc_curpag also detect 
ONEGROUP PAG gids
     2009-11-16 Anders Kaseorg   (823) Clean up console message
     2009-11-11 Michael Meffie   (817) cm: address race condition in 
afs_QueueVCB
     2009-11-11 Andrew Deason    (816) Do not check *aoutSize in PGetPAG
     2009-11-05 Marc Dionne      (767) Fix memory allocation warnings at 
shutdown
     2009-11-05 Marc Dionne      (766) Linux: Fix write_begin configure 
test for recent RHEL kernels
     2009-11-04 Derrick Brashear (780) macos 10.6 64bit trace fixes
     2009-11-04 Russ Allbery     (779) .gitignore for src/pinstall
     2009-11-04 Russ Allbery     (777) Always use kbuild for all Linux 
kernel configure probes
     2009-11-04 Marc Dionne      (774) Linux - Fix disk cache access for 
selinux/AppArmor constrained processes
     2009-11-04 Russ Allbery     (775) Build shadow header files when 
necessary on Linux
     2009-11-04 Russ Allbery     (773) Make afsd.pod reflect reality
     2009-11-02 Andrew Deason    (762) Avoid using released hosts
     2009-11-02 Andrew Deason    (763) Protect rx_call iovq from 
simultaneous attempts to empty it
     2009-11-02 Andrew Deason    (761) Dec old special inodes in inode 
convertROtoRW
     2009-11-02 Marc Dionne      (760) Linux: Avoid deadlock in readdir 
- release GLOCK for filldir
     2009-10-30 Marc Dionne      (755) Linux: 2.6.32 - Adapt to 
writeback changes
     2009-10-28 Andrew Deason    (749) Avoid prematurely destroying 
callback_rxcon
     2009-10-21 Andrew Deason    (702) HPUX: Do not sigwait on critical 
signals

  Resolved Tickets
    Here is a list of tickets that have been resolved since November 1,
    2009:

      ticket # state     created       title
        92944: resolved  Apr 03, 2008  [OpenAFS-devel] SELinux biting 
OpenAFS [Cache manager using the wrong SELinux context]
       125475: resolved  Oct 08, 2009  OpenAFS on kernel 2.6.32 triggers 
WARNING at fs/fs-writeback.c:1112
       125486: resolved  Oct 10, 2009  Uninstall.command Open AFS v1.565
       125544: resolved  Oct 27, 2009  BUG at osi_file.c:87 with AppArmor
       125555: resolved  Oct 30, 2009  OpenAFS 1.4.11 crash on RHEL 5 
update 4 systems