Searching for Testers was Re: [OpenAFS] OpenAFS site not geared for beginners...

[Christopher D. Clausen]

This is a multi-part message in MIME format.

------=_NextPart_000_0ED1_01C6CEA3.4A0FD320
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: 7bit

Jeffrey Altman <jaltman@secure-endpoints.com> wrote:
> Christopher D. Clausen wrote:
>
>> I file bug reports (although I haven't had any service crashes
>> recently.)  Everything I filed against the Windows client (and
>> possibly the Solaris server, but still testing) seems to be fixed in
>> the latest fc.
>
> Chris, you are one of the rare few who do test the Windows releases
> and file bug reports.  It is good to know that the issues you have
> come across have been fixed.  The problem that I am trying to address
> is how do I know that (a) previous issues have been fixed; (b) that
> new ones were not created; and (c) that existing ones simply have not
> been reported.
>
> If I fail to receive a bug report from you, does that mean that:
>
>  (a) you have tested the build and that all is good
>
>  (b) you have not tested the build at all
>
>  (c) you have not tested the build on a platform that would
>      experience a problem

Oh, so I should email the list with something like:
"testing 1.5.0702 on Windows 2003 SP2.  No problems encountered so far." 
?

> I am imagining something a bit more formal.  In fact, speaking of web
> design work, perhaps what we need is a web form checklist that can be
> easily filled out as a report.
>
> * OpenAFS release
>
> * OS platform
>
> * Hardware architecture
>
> * A list of tests to perform with success and failure options.
>   If a test fails, then a text field for inputing a description
>   of the failure.
>
> If there was another page that could be dynamically updated so people
> could see what combinations of <OpenAFS release, OS, architecture>
> had been tested, then people could jump in to fill in the gaps.

Yeah, some sort of list of things to check would be useful.

>> I can (and have been trying to as often as possible) test clients on
>> Windows 2003 Server (SP1 and SP2 beta x86) as they are released.  I
>> do not currently have any 64-bit OSes running nor do I have any
>> machines running Windows XP or Windows 2000.  If no one else has the
>> time, I can setup test systems in a VM and make sure a basic install
>> works, but I would not be actively using software in these VMs.  I
>> would assume that testing in actual environments would be preferable.
>
> Testing in actual environments would be preferable in some cases.
> However, VMs are certainly nice for the ability to perform snapshots.
> Especially when you want to be able to test the behavior of a clean
> install.

Would it be possible to get access to the automated testing framework? 
I'm almost sure such tests could be run in VMs as well.  Or is this not 
needed b/c others are already running such tests?

>> Also, I typically use the Windows cmd prompt myself and don't notice
>> GUI issues (which is why I didn't notice that the explorer extention
>> was broken until a week ago.  Its been broken on my installs for
>> several months.)
>
> If there was an item on a checklist that asked "Does the AFS Shell
> Extension menu appear for XXX?" would you test it for each release?

Yes.

It would probably be best if someone else wrote up the checklist though.

<<CDC
-- 
Christopher D. Clausen
ACM@UIUC SysAdmin 

------=_NextPart_000_0ED1_01C6CEA3.4A0FD320
Content-Type: application/x-pkcs7-signature;
	name="smime.p7s"
Content-Transfer-Encoding: base64
Content-Disposition: attachment;
	filename="smime.p7s"

MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIIzjCCAlYw
ggG/oAMCAQICEClwvAxG9I4C7pX0+QussjMwDQYJKoZIhvcNAQEEBQAwYjELMAkGA1UEBhMCWkEx
JTAjBgNVBAoTHFRoYXd0ZSBDb25zdWx0aW5nIChQdHkpIEx0ZC4xLDAqBgNVBAMTI1RoYXd0ZSBQ
ZXJzb25hbCBGcmVlbWFpbCBJc3N1aW5nIENBMB4XDTA2MDUxMDEzMzkzNVoXDTA3MDUxMDEzMzkz
NVowQjEfMB0GA1UEAxMWVGhhd3RlIEZyZWVtYWlsIE1lbWJlcjEfMB0GCSqGSIb3DQEJARYQY2Ns
YXVzZW5AYWNtLm9yZzCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEA0E0zkl4ABO1TmeOiYZks
Fg8Sp3ijh0xM7V4xDWZnXURpM5q1ffAXKxEvkaW2vObKVRF/FfHPgqYjLAcAEBaBKWGvDJexuMI6
ZCWdetZ7U5k6npOIfZm597vRLvUDuYXp8oslfLAR0NKoyFhD7SNQ6ogvjQl8Xjh6CKZMcZaFl9cC
AwEAAaMtMCswGwYDVR0RBBQwEoEQY2NsYXVzZW5AYWNtLm9yZzAMBgNVHRMBAf8EAjAAMA0GCSqG
SIb3DQEBBAUAA4GBAFhtQABaWajUMorrMVRLa4d4FeasShlfMfWQVGZslkBZUsqHAbHsLoIFAKFY
JuzSyEn/zxwUL3SOIVVNxD1NMEaXoyfT0lUK6w/ux1nrnmF9/yVbn95Vus040MiASZG9KABWPW4U
4AG1vkkqIFIry7LXVhvNmXqDm5DSm4mCTM67MIIDLTCCApagAwIBAgIBADANBgkqhkiG9w0BAQQF
ADCB0TELMAkGA1UEBhMCWkExFTATBgNVBAgTDFdlc3Rlcm4gQ2FwZTESMBAGA1UEBxMJQ2FwZSBU
b3duMRowGAYDVQQKExFUaGF3dGUgQ29uc3VsdGluZzEoMCYGA1UECxMfQ2VydGlmaWNhdGlvbiBT
ZXJ2aWNlcyBEaXZpc2lvbjEkMCIGA1UEAxMbVGhhd3RlIFBlcnNvbmFsIEZyZWVtYWlsIENBMSsw
KQYJKoZIhvcNAQkBFhxwZXJzb25hbC1mcmVlbWFpbEB0aGF3dGUuY29tMB4XDTk2MDEwMTAwMDAw
MFoXDTIwMTIzMTIzNTk1OVowgdExCzAJBgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0ZXJuIENhcGUx
EjAQBgNVBAcTCUNhcGUgVG93bjEaMBgGA1UEChMRVGhhd3RlIENvbnN1bHRpbmcxKDAmBgNVBAsT
H0NlcnRpZmljYXRpb24gU2VydmljZXMgRGl2aXNpb24xJDAiBgNVBAMTG1RoYXd0ZSBQZXJzb25h
bCBGcmVlbWFpbCBDQTErMCkGCSqGSIb3DQEJARYccGVyc29uYWwtZnJlZW1haWxAdGhhd3RlLmNv
bTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEA1GnX1LCUZFtx6UfYDFG26nKRsIRefS0Nj3sS
34UldSh0OkIsYyeflXtL734Zhx2G6qPduc6WZBrCFG5ErHzmj+hND3EfQDimAKOHePb5lIZererA
Xnbr2RSjXW56fAylS1V/Bhkpf56aJtVquzgkCGqYx7Hao5iR/Xnb5VrEHLkCAwEAAaMTMBEwDwYD
VR0TAQH/BAUwAwEB/zANBgkqhkiG9w0BAQQFAAOBgQDH7JJ+Tvj1lqVnYiqk8E0RYNBvjWBYYawm
u1I1XAjPMPuoSpaKH2JCI4wXD/S6ZJwXrEcp352YXtJsYHFcoqzceePnbgBHH7UNKOgCneSa/RP0
ptl8sfjcXyMmCZGAc9AUG95DqYMl8uacLxXK/qarigd1iwzdUYRr5PjRzneigTCCAz8wggKooAMC
AQICAQ0wDQYJKoZIhvcNAQEFBQAwgdExCzAJBgNVBAYTAlpBMRUwEwYDVQQIEwxXZXN0ZXJuIENh
cGUxEjAQBgNVBAcTCUNhcGUgVG93bjEaMBgGA1UEChMRVGhhd3RlIENvbnN1bHRpbmcxKDAmBgNV
BAsTH0NlcnRpZmljYXRpb24gU2VydmljZXMgRGl2aXNpb24xJDAiBgNVBAMTG1RoYXd0ZSBQZXJz
b25hbCBGcmVlbWFpbCBDQTErMCkGCSqGSIb3DQEJARYccGVyc29uYWwtZnJlZW1haWxAdGhhd3Rl
LmNvbTAeFw0wMzA3MTcwMDAwMDBaFw0xMzA3MTYyMzU5NTlaMGIxCzAJBgNVBAYTAlpBMSUwIwYD
VQQKExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVyc29u
YWwgRnJlZW1haWwgSXNzdWluZyBDQTCBnzANBgkqhkiG9w0BAQEFAAOBjQAwgYkCgYEAxKY8VXNV
+065yplaHmjAdQRwnd/p/6Me7L3N9VvyGna9fww6YfK/Uc4B1OVQCjDXAmNaLIkVcI7dyfArhVqq
P3FWy688Cwfn8R+RNiQqE88r1fOCdz0Dviv+uxg+B79AgAJk16emu59l0cUqVIUPSAR/p7bRPGEE
QB5kGXJgt/sCAwEAAaOBlDCBkTASBgNVHRMBAf8ECDAGAQH/AgEAMEMGA1UdHwQ8MDowOKA2oDSG
Mmh0dHA6Ly9jcmwudGhhd3RlLmNvbS9UaGF3dGVQZXJzb25hbEZyZWVtYWlsQ0EuY3JsMAsGA1Ud
DwQEAwIBBjApBgNVHREEIjAgpB4wHDEaMBgGA1UEAxMRUHJpdmF0ZUxhYmVsMi0xMzgwDQYJKoZI
hvcNAQEFBQADgYEASIzRUIPqCy7MDaNmrGcPf6+svsIXoUOWlJ1/TCG4+DYfqi2fNi/A9BxQIJNw
PP2t4WFiw9k6GX6EsZkbAMUaC4J0niVQlGLH2ydxVyWN3amcOY6MIE9lX5Xa9/eH1sYITq726jTl
EBpbNU1341YheILcIRk13iSx0x1G/11fZU8xggHZMIIB1QIBATB2MGIxCzAJBgNVBAYTAlpBMSUw
IwYDVQQKExxUaGF3dGUgQ29uc3VsdGluZyAoUHR5KSBMdGQuMSwwKgYDVQQDEyNUaGF3dGUgUGVy
c29uYWwgRnJlZW1haWwgSXNzdWluZyBDQQIQKXC8DEb0jgLulfT5C6yyMzAJBgUrDgMCGgUAoIG6
MBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTA2MDkwMjIwMjAxNFow
IwYJKoZIhvcNAQkEMRYEFPYDry81wjJDu60H7W/zsM5F+QR2MFsGCSqGSIb3DQEJDzFOMEwwCgYI
KoZIhvcNAwcwDgYIKoZIhvcNAwICAgCAMA0GCCqGSIb3DQMCAgFAMAcGBSsOAwIHMA0GCCqGSIb3
DQMCAgEoMAcGBSsOAwIdMA0GCSqGSIb3DQEBAQUABIGAQDPzcouMVmg3hseV3nwR51DmvraSPSW5
eLULkanqzZVhmlSvMP7FaoeB04L6+fmf/mR7vII68jOphnjIGyAcbt6QUqK2YqgaXKp1ysyOQiUL
Oqzf07JeX8Z51+9KqMmQTuS1THS2mGZwJsMW5K4Yyn0Jg2yHr1sPGPwOxp2YBfkAAAAAAAA=

------=_NextPart_000_0ED1_01C6CEA3.4A0FD320--