| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| AMM1 | Subscribe using Mass Subscription | - Email notification with welcome message to new member - All links are working in welcome email - ”+new” appears for conversation feature | vid@@svaksha.com | - 20100625, 0225 UTC - 20100701, 1835 UTC | - P - P | - 20100625: manual testing - 20100701: automated testing using selenium, was able to subscribe multiple email id's by storing emails in a file |
| AMM2 | Unsubscribe using Mass Removal | - Confirmation that members are successfully removed - No email sent unless option is selected | vid@@svaksha.com | - 20100628, 0225 UTC - 20100701, 1835 UTC | - P - P | - 20100628: manual testing - 20100701: automated testing using selenium, was able to un-subscribe multiple email id's by storing emails in a file |
| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| UOL2 | Unsubscribe | - Email notification to member | vid@@svaksha.com | - 20100630, 0135 UTC - 20100701, 1835 UTC | - P(dlist) - P(non-dlist) | - 20100630: manual testing of dlist and non-dlist - 20100701: automated selenium for testing both dlist and non-dlist |
| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| UOM1 | As a member who has an address listed in “Other incoming email addresses”, change your primary email address by entering a “New Address” and name (optional) | - Confirmation that it is successfully changed - “delete” bit remains “f”alse (use psql to confirm) - Member is still listed in Membership List - “Other incoming email addresses” are retained | vid@@svaksha.com | -2010.06.30, 1010 UTC - 20100702, 1835 UTC | - P - P | - 20100630: manual testing - 20100702: automated selenium for testing |
| UOM2 | As a member who has an address listed in “Other incoming email addresses”, globally change your primary email address by entering a “New Address” and name (optional) (Before doing this, make sure test member is subscribed with same email address on other test lists) | - Confirmation that all test lists in question have successfully changed - “delete” bit remains “f”alse (use psql to confirm) - Member is still listed in Membership list - “Other incoming email addresses” are retained | vid@@svaksha.com | -2010.07.01, 1710 UTC - 20100702, 1835 UTC | - P - P | - 2010.07.01: manual testing - 20100702: automated selenium for testing |
| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| UOM3 | Change primary email address and name (optional) NOTES: To check item 2 (make sure delete bit remains false), first read read_the_postgresql_database for instructions on launching psql on the database. Then use the following command: select * from subscriber where mailman_key='email-address'; where email-address is replaced by the address you deleted. Check the output to ensure the deleted field is still 'f'. | - Confirmation that it is successfully changed - “delete” bit remains “f”alse (use psql to confirm) - Member is still listed in Membership List | vid@@svaksha.com liene.v@gmail.com | - 2010.06.30, 1010 UTC - 2010.07.04, 1810 UTC - 2011.11.12, 1050 PST | -P -F -P | - 2010.06.30: Passed Manual testing - 20100704: Failed the automated selenium testing. Was unable to log into options page. ERROR MESSAGE: Bug in Mailman version 2.1.10. We're sorry, we hit a bug! Please inform the webmaster for this site of this problem. Printing of traceback and other system information has been explicitly inhibited, but the webmaster can find this information in the Mailman error logs. - 2011.11.12: Passed manual testing |
| UOM4 | Globally change primary email address and name (optional): (Before doing this, make sure test member is subscribed with same email address on other test lists) | - Confirmation that all test lists in question have successfully changed - “delete” bit remains “f”alse (use psql to confirm) - Member is still listed in Membership list | vid@@svaksha.com rosario.robinson@gmail.com | - 2010.06.30, 1010 UTC - 2010.07.04, 1820 UTC - 2011.11.12, 1150 PST | - P - F - P | - 2010.06.30: Passed Manual testing - 20100704: Failed automated selenium testing, was unable to log into options page. ERROR MESSAGE: Bug in Mailman version 2.1.10. We're sorry, we hit a bug! Please inform the webmaster for this site of this problem. Printing of traceback and other system information has been explicitly inhibited, but the webmaster can find this information in the Mailman error logs. - 2011.11.12: Passed manual testing |
| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| UOM5 | Unsubscribe | - Email notification to member | vid@@svaksha.com | 2010.06.30, 1030 UTC 2010.07.04, 1830 UTC | - P - P | - 2010.06.30: Passed Manual testing - 20100704: Passed automated selenium test |
| UOM5 | Unsubscribe | - Email notification to member | vid@@svaksha.com | 2010.06.30, 1030 UTC 2010.07.04, 1830 UTC | - P - P | - 2010.06.30: Passed Manual testing - 20100704: Passed automated selenium test |
| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| UPM1 | As a subscriber, send a message to listname+new@abiwt.org | - No error. Message should succesfully go through. | vid@@svaksha.com | - 2010.06.03, 1130 UTC - 2010.07.04, 1830 UTC | - P - P | - 2010.06.03: Passed Manual testing - 2010.07.04: Passed automated selenium test |
| UPM2 | As a subscriber, send a message to listname+new+subject@abiwt.org | - No error. Message should succesfully go through. | vid@@svaksha.com | 2010.06.03, 1130 UTC - 2010.07.05, 0800 UTC | - P - P | - 2010.06.03: Passed Manual testing - 2010.07.05: Passed automated selenium test |
| UPM3 | As a subscriber, send a message to listname+new+existing_subject@abiwt.org | - No error. System will simply add “2” or “3” consecutively to the existing subject (i.e. if listname+wiki already exists, then system creates listname+wiki2) | vid@@svaksha.com | - 2010.06.30, 1130 UTC - 2010.07.05, 0800 UTC | - P - P | - 2010.06.30: Passed Manual testing - 2010.07.05: Passed automated selenium test |
| UPM4 | Reply to a message | - No error. Message should only go to the author | vid@@svaksha.com | 2010.06.30, 1230 UTC - 2010.07.05, 0845 UTC | - P - P | - 20100630: Passed Manual testing - 20100705: Passed automated selenium test |
| UPM5 | Reply to all | - No error. Message should go to author and list | vid@@svaksha.com | - 2010.06.30, 1230 UTC - 2010.07.05, 0845 UTC | - P - P | - 20100630: Passed Manual testing - 20100705: Passed automated selenium test |
| UPM6 | As a subscriber, send to listname+existing_subject@abiwt.org | - No error. Message should succesfully go through. | vid@@svaksha.com | - 2010.06.30, 1230 UTC - 2010.07.05, 0911 UTC | - P - P | - 20100630: Passed Manual testing - 20100705: Passed automated selenium test |
| UPM7 | As a subscriber, send to listname+new_subject@abiwt.org | Should receive similar non-existent conversation message like this one “Your message could not be sent because you addressed it to a nonexistent conversation (vacation). Perhaps you meant to start a new conversation named vacation, which you can do by addressing your message to <listname>+new+vacation@abiwt.org” | vid@@svaksha.com | - 2010.06.30, 1230 UTC - 2010.07.05, 0911 UTC | - P - P | - 20100630: Passed Manual testing - 20100705: Passed automated selenium test |
| UPM8 | As a subscriber, send to listname@abiwt.org | Should receive similar reject message as this one “Your message was rejected because it was sent to an invalid address. If you want to add a message to an existing conversation,send it to <listname>+conversation@abiwt.org, replacing 'conversation' with the name of the existing conversation. If you want to start a new conversation on a list, send your message to <listname>+new@abiwt.org” | vid@@svaksha.com | - 2010.06.30, 1400 UTC - 2010.07.05, 0911 UTC | - P - P | - 20100630: Passed Manual testing - 20100705: Passed automated selenium test |
| UPM9 | As a non-subscriber, send to listname+new@abiwt.org | Should receive similar “not allowed” message as this one “You are not allowed to post to this mailing list, and your message has been automatically rejected. If you think that your messages are being rejected in error, contact the mailing list owner at <listname>-owner@abiwt.org.” | vid@@svaksha.com rosario.robinson@gmail.com | - 2010.06.30, 1400 UTC - 2010.07.05, 1011 UTC - 2011.11.12, 1130 PST | -F -P -P | - 2010.06.30: FAIL. - 2010.07.05 PASSED automated selenium testing - 2011.11.12: PASSED manual testing |
| UPM10 | As a non-subscriber, reply to listname+existing_subject@abiwt.org | Should receive similar “not allowed” message as this one “You are not allowed to post to this mailing list, and your message has been automatically rejected. If you think that your messages are being rejected in error, contact the mailing list owner at <listname>-owner@abiwt.org.” | vid@@svaksha.com rosario.robinson@gmail.com | - 2010.06.30, 1400 UTC - 2010.07.05, 1011 UTC - 2011.11.12, 1130 PST | -F -P -P | - 2010.06.30: FAIL. - 2010.07.05 PASSED automated selenium testing - 2011.11.12: PASSED manual testing |
| UPM11 | As a non-subscriber, send to listname@abiwt.org | Should receive similar “not allowed” message as this one “You are not allowed to post to this mailing list, and your message has been automatically rejected. If you think that your messages are being rejected in error, contact the mailing list owner at <listname>-owner@abiwt.org.” | vid@@svaksha.com liene.v@gmail.com | 2010.06.30, 1400 UTC - 2010.07.05, 1011 UTC -2011.11.12, 1130 PST | -F -P -P | - 2010.06.30: FAIL. - 2010.07.05 PASSED automated selenium testing - 2011.11.12: PASSED manual testing |
* http://abiwt.org/mailman/admin/dlist-583379 - list admin password is “583379”. * Dlist LISTINFO page
1. In a Web browser, visit abiwt.org/mailman/listinfo/[listname], where [listname] is replaced by the list you are working on.
2. Midway down the page, enter a email address and name to use for the new subscriber. (This should be a real email address because you will need to receive real emails to complete the tests.) Further down, choose and confirm a password. Also enter a comment in the text box. Finally, click Subscribe.
3. Wait to receive an email from the list asking you to confirm the subscription. When the email comes, click on the link within the email to confirm the subscription.
4. Visit abiwt.org/mailman/listinfo/[listname] again. Scroll to the very bottom and enter your email address in the box left of “Unsubscribe or edit options,” and then click on “Unsubscribe or edit options”.
5. You should arrive at a page where you can set options for the new subscriber – about half way down the page in a blue table. (In steps UPC1 through UPC3 below, you will set the options labelled “Subscribed to new conversations” and “Set digest mode” on this page. Be careful to set them for each new subscriber as described in those steps.)
6. Click “Submit My Changes.”
| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| UPC1 | - Subscribe two people/emails to the list, with Subscribed to New Conversations set to Yes - Enter the email addresses under Tester Email - Call them subscribers 1 and 2 | - No Error | vid@@svaksha.com | - 20100707, 1530 UTC - | - P - | - manual testing |
| UPC2 | - Subscribe two people/emails to the list, with Subscribed to New Conversations set to No - Enter the email addresses under Tester Email - Call them subscribers 3 and 4 | - No Error | ||||
| UPC3 | - Subscribe one more person/email to the list, with Set Digest Mode set to On - Enter the email address under Tester Email - Call this subscriber 5 | - No Error | vid@@svaksha.com | - 2010.06.03, 1230 UTC - | - P - | - manual testing - |
| UPC4 | - Subscriber 5 starts a new conversation with an uncommon subject line (e.g., fiddlesticks). - send to [listname]+new@abiwt.org | - Subscribers 1-4 see post - subscriber 5 sees it in digest next day - New post shows up in Archives | vid@@svaksha.com | 2010.06.03, 1230 UTC | - P - | - manual testing - |
| UPC5 | - Subscriber 5 sends a reply to this conversation - send to [listname]+[fiddlesticks]@abiwt.org | - Subscribers 1&2 see post - subscriber 5 sees it in digest next day - New post shows up in Archives | vid@@svaksha.com | 2010.06.30, 1444 UTC | - P - | - manual testing - |
| UPC6 | - Subscriber 1 unsubscribes to this conversation, using the web link (not email link) in the email sent | - No errors | ||||
| UPC7 | - Subscriber 5 sends a reply to this conversation - send to [listname]+[fiddlesticks]@abiwt.org | - Subscriber 2 sees post - subscriber 5 sees it in digest next day - New post shows up in Archives | ||||
| UPC8 | - Subscriber 3 subscribes to this conversation, using the web link (not email link) in the first email sent | - No errors | ||||
| UPC9 | - Subscriber 5 sends a reply to this conversation - send to [listname]+[fiddlesticks]@abiwt.org | - Subscribers 2 and 3 see post - subscriber 5 sees it in digest next day - New post shows up in Archives | ||||
| UPC10 | - This step is really 3 closely related tests: a. Subscriber 2 unsubscribes from this conversation (with a twist). To do this, scroll to the bottom of an email that subscriber 2 received as part of this conversation. Find the link that can be clicked on to unsubscribe – but don't click on it! Instead, cut and paste it into a browser, but delete the last character off the URL. Then surf to the broken URL. b. Subscriber 2 unsubscribes a second time as described above, except this time delete the last two characters off the URL. c. Repeat, with the last 3 characters deleted. | - Each time, get message that you are unsubscribed to this conversation - it's possible that a login will be required the first time | ||||
| UPC11 | - Subscriber 5 sends a reply to this conversation - send to [listname]+[fiddlesticks]@abiwt.org | -subscriber 3 gets the message - subscriber 5 sees it in digest next day - New post shows up in Archives |
| Line Ref | What to Test | Expected Behavior | Tester Email | Time (UTC) | P or F | Comments |
|---|---|---|---|---|---|---|
| SBT1 | - User with mixed case name: log in to the options page | See options page If no options page, have someone check the server for an error log | JasonWilburCox@gmail.com | 6/9/10 - 16:30 | P | The options page was displayed |
| SBT2 | - Admin: Go to the admin page and search for the mixed case name - click on link to user email | See options page | JasonWilburCox@gmail.com | 6/9/10 - 16:34 | P | The page listed the mixed case email address, though it was in all lower case |