checklist_for_wishlist_orm_final [Systers Wiki]

Checklist for Wishlist ORM Final

Bugs for this integration include:

Bug 426849 “The oldlist bug” - Completed (specific test instructions - None)
Bug 417134 “Debug mode does not work for new lists” - Completed (specific test instructions - None)
Bug 417440 ”+new does not appears in the welcome mail send to subscriber” - Completed (specific test instructions - None)

Lists used for testing:

Kathy_426849@abiwt.org
Kathy_426849b@abiwt.org

Administrative Interface

Navigation - Main Page

What to Test	Expected Behavior	P or F	Comments (Tester, Date, etc.)
Click on Pending Moderator Requests link	- No error	P	KathyG, 11/13/09
Click on Listinfo Page link	- No error	P	KathyG, 11/13/09
Click on List Archives link	- No error	P	KathyG, 11/13/09

Membership Management Page

What to Test	Expected Behavior	P or F	Comments (Tester, Date, etc.)
Subscribe using Mass Subscription	- Email notification with welcome message to new member - All links are working in welcome email - ”+new” appears for conversation feature - all relevant questions for essay appears	P P P P	KathyG, 11/13/09
Unsubscribe using Mass Removal	- Confirmation that members are successfully removed - No email sent unless option is selected	P P	KathyG, 11/13/09
Unsubscribe using “Unsub” checkbox	- Email notice to member	P	KathyG, 11/13/09
Turn on Digest mode: - Send test post - Force next digest through (see Digest Options)	- Member receives post in digest	P	KathyG, 11/13/09
Turn off Digest mode: - Send test post	- Member receives post as non-digest	P	KathyG, 11/13/09
Turn on Mod bit (for a member): - Send test post - Approve post	- Post is waiting for moderator's approval - Upon approval, post should be processed and sent	P	KathyG, 11/13/09
Turn off Mod bit (for a member): - Send test post	- Post should be processed and sent	P	KathyG, 11/13/09
Turn on Mod bit (for everyone): - Send test post - Approve post	- Post is waiting for moderator's approval - Upon approval, post should be processed and sent	P	KathyG, 11/13/09
Turn off Mod bit (for everyone): - Send test post	- Post should be processed and sent	P	KathyG, 11/13/09

User Interface

Options Login Page (http://abiwt.org/mailman/options/[listname]/)

What to Test	Expected Behavior	P or F	Comments (Tester, Date, etc.)
Password Reminder	- Email with password to member	P	KathyG, 11/13/09
Unsubscribe	- Email notification to member	P	KathyG, 11/13/09

Options Member Configuration Page (after logging in above)

What to Test	Expected Behavior	P or F	Comments (Tester, Date, etc.)
Change primary email address with “Other incoming email addresses”	- Confirmation that it is successfully changed - “delete” bit remains “f”alse (use psql to confirm) - Member is still listed in Membership List - “Other incoming email addresses” are retained	P P P P	KathyG, 11/13/09
Globally change primary email address and name with “Other incoming email addresses”: (Before doing this, make sure test member is subscribed with same email address on other test lists)	- Confirmation that all test lists in question have successfully changed - “delete” bit remains “f”alse (use psql to confirm) - Member is still listed in Membership list - “Other incoming email addresses” are retained	P P P P	KathyG, 11/13/09
Unsubscribe	- Email notification to member	P	KathyG, 11/13/09
List other subscriptions	- Displays all lists that member have subscribed to	P	KathyG, 11/13/09
Email password	- Email with password to member	P	KathyG, 11/13/09
Change password	- Confirmation that password has successfully changed	P	KathyG, 11/13/09
Change password globally	- Confirmation that password has successfully changed	Abiwt-test - F Kathy-dlist - F Kathy_426849 - P Kathy_426849b - P Kgtest - P Robin-junk - F Test-cli - F	KathyG, 11/13/09 The ones that failed (returned a “Hit a bug” error), in my observation, is due to the fact that the email address in question does not exist in the PSQL database. This is because a test was performed in the past within that list to have the email address changed and there was a syncing problem.
Change values for all options	- Confirmation that changes are successful	P	KathyG, 11/13/09

Listinfo Page (http://abiwt.org/mailman/listinfo/[listname]/)

What to Test	Expected Behavior	P or F	Comments (Tester, Date, etc.)
Confirm all links in page are working	- No error	P	KathyG, 11/13/09
Confirm ”+new” appears for conversation feature	n/a	P	KathyG, 11/13/09
Confirm that the 3 questions are listed for the essay	n/a	P	KathyG, 11/13/09
Subscribe without entering email address	- Additional info message should appear asking user to complete	P	KathyG, 11/13/09
Subscribe without full name	- Additional info message should appear asking user to complete	P	KathyG, 11/13/09
Subscribe without completing essay	- Additional info message should appear asking user to complete	P	KathyG, 11/13/09
Subscribe without entering password	- Request will be waiting for moderator's approval - Upon approval, email notification to new member with system generated password	P	KathyG, 11/13/09 Failed not because of password. But because the subscription went through without needing approval from moderator after I confirmed! KathyG, 11/16/09 Privacy setting was at default to confirm only.
Subscribe by picking own password	- Request will be waiting for moderator's approval - Upon approval, email notification to new member with password picked	P	KathyG, 11/13/09 Failed not because of password. But because the subscription went through without needing approval from moderator after I confirmed! KathyG, 11/16/09 Privacy setting was at default to confirm only.
Subscribe with digest	- Request will be waiting for moderator's approval - New member will have digest mode turned “on”	P	KathyG, 11/13/09 Failed not because of digest. But because the subscription went through without needing approval from moderator after I confirmed! KathyG, 11/16/09 Privacy setting was at default to confirm only.
Subscribe without digest	- Request will be waiting for moderator's approval - New member will have digest mode turned “off”	P	KathyG, 11/13/09 Failed not because of digest. But because the subscription went through without needing approval from moderator after I confirmed! KathyG, 11/16/09 Privacy setting was at default to confirm only.

Posting Messages

What to Test	P or F	Comments (Tester, Date, etc.)
Send a message to listname+new@abiwt.org	P	KathyG, 11/13/09 Robin 11/23/09
Send a message to listname+new+subject@abiwt.org	P	KathyG, 11/13/09 Robin 11/23/09
Send a message to listname+new+existing_subject@abiwt.org	P	KathyG, 11/13/09 System automatically created a new conversation by adding a “2” Robin 11/28/09 Works as above
Reply to a message	P	KathyG, 11/13/09 Posted message to just the author Robin 11/28/09
Reply to all	P	KathyG, 11/13/09 Posted message to the author and list Robin 11/28/09
Send to listname+existing_subject@abiwt.org	P	KathyG, 11/13/09 Posted message to list Robin 11/28/09
Send to listname+new_subject@abiwt.org	P	KathyG, 11/23/09
Send to listname@abiwt.org	P	KathyG, 11/13/09 Robin 11/23/09 System notified author with a rejection email due to invalid email address
As a non-subscriber, send to listname+new@abiwt.org	P	KathyG, 11/13/09 Used to be a reject email when a non-subscriber tries to post. Now, it emails to author that it is waiting for moderator's approval because author is not a member. Gives author option to cancel. KathyG, 11/16/09 Action to take for postings from non-members was set to hold instead of reject. Robin 11/23/09
As a non-subscriber, reply to listname+existing_subject@abiwt.org	P	KathyG, 11/13/09 Used to be a reject email when a non-subscriber tries to post. Now, it emails to author that it is waiting for moderator's approval because author is not a member. Gives author option to cancel. KathyG, 11/16/09 Action to take for postings from non-members was set to hold instead of reject. Robin 11/25/09
As a non-subscriber, send to listname@abiwt.org	P	KathyG, 11/13/09 Used to be a reject email when a non-subscriber tries to post. Now, it emails to author that it is waiting for moderator's approval because author is not a member. Gives author option to cancel. KathyG, 11/16/09 Action to take for postings from non-members was set to hold instead of reject. Robin 11/23/09

Bug #426849 (Oldlist)

What to Test	P or F	Comments (Tester, Date, etc.)
Some old lists were working fine and others I encounted bug error. I suspect this is the same problem with the test I did when changing passwords globally.	P	KathyG, 11/13/09 According to Kanika, we need no longer worry about database inconsistency anymore.

Bug #417440 (+new does not appear in Welcome mail))

What to Test	P or F	Comments (Tester, Date, etc.)
Subcribed a new member and then new member sent a post. Check to see if Welcome mail contains ”+new” and check to see if post went through without moderator approval required	P	KathyG, 11/16/09 Welcome mail does contain ”+new” and post was successful without moderator approval as expected.

Bug #417134 (Debug mode does not work for new lists)

What to Test	P or F	Comments (Tester, Date, etc.)
Set “Debug Mode” in mm_cfy.py to “True” and see if an old list (i.e. Change_Email_Test) and a new list (i.e. kathy_426849b) records in /logs/info. Then change “Debug Mode” to “False” and see if it stops recording.	P	KathyG, 11/17/09 When set to “True”, info records as expected. When set to “False, info does not record. This is true both both old and new lists.