Skip to content

QA Testing

Jump to bottom Edit New page
Eduardo Rosendo edited this page Jul 18, 2024 · 27 revisions

Background

This document lists a variety of manual tests that should be performed to ensure that we do not encounter regressions when releasing new versions of the RECAP Extensions. In general, these tests should be run on both the Firefox and Chrome browsers. We are seeking a contributor that can automate these tests using selenium.

Tests

Icon and notifications

  1. Is the icon gray when at a non-pacer site like Google.com? Yes.

  2. Is the icon blue when on a PACER site? Yes.

  3. If you switch from the PACER website, where you have a blue icon, to another website, does it go back and forth from blue to gray and back? Yes.

  4. Is there a warning when you're on an appellate PACER website in both the icon and in the icon mouseover? No.

  5. If you disable receipts in your PACER options, do you get a warning icon and message? Yes, after log out and log into district site (this resets the cookie for this preference, ugh).

  6. If you use the options to temporarily disable RECAP, do you get the X'ed out icon immediately? Yes.

  7. If you click the extension's icon, are there two buttons with icons at the bottom right of the popup? Yes.

Banner on login pages

  1. Access this login page while logged out, do you see a banner with a "Learn more" button? Yes.

  2. Go Here while logged out, do you see a banner with a "Learn More" button? Yes.

  3. Access the "Manage My Account" page and log in using your credentials, locate the section labeled "Usage" within your account dashboard, find the option for "View Detailed Transactions" and click on it. Do you see a banner with a learn more button? No.

Checking for documents

  1. Is there any notification about available documents on this page when you're logged out - No

For District Court PACER

  1. There are two different pages to request documents related to a docket:

    1. Docket report with a search bar

      1. Go here while logged in. Do you see a case number in the first input of the page?

        • Yes. Do you see a link about ① the docket being available and ② to create an alert? - Yes & Yes.
        • No. Do you see a link about ① the docket being available and ② to create an alert? - No & No.

      2. Fill in the first input with the following case number: 16-cv-00745 and click the 'Find this Case' button. Do you see a button with the [R] icon next to the date inputs and links about ① the docket being available and ② to create an alert? - Yes, Yes & Yes.

      3. Click the [R] button. Are the "Parties and Counsel" and "Terminated Parties." checkboxes unchecked? Yes. Is the first date input filled with a date? Yes.

      4. Remove the last two characters of the text in the first input of the form. Do you see a link about ① the docket being available and ② to create an alert? - No & No.

    2. Docket report without a search bar

      1. Go here while logged in. Do you see a link about ① the docket being available and ② to create an alert? - Yes & Yes.

  2. Filter from document 1 to document 1 and exclude parties(uncheck Parties and counsel in the form), and submit the form. You should see the docket page. On the docket page, do you see [R] icons for all of the documents and attachments? - Yes

    • Can you click the icons to download the document from CourtListener? - Yes.
    • Do you see the RECAP actions button on the docket? - Yes.

  3. Click the RECAP actions button. Do you see the following options: ① create alert ② search this docket ③ view this docket ④ refresh RECAP links? Yes & Yes & Yes & Yes.

  4. Click the ③ view this docket option. Does the link work? - Yes.

  5. Click the ④ refresh RECAP links option. were the [R] icons removed from the page? did a spinner appear next to the button? Yes & Yes.

    • Did the [R] icons appear after a few seconds? Yes.

  6. Click the number "1" to go to the attachment page. Do you see the [R] icons again? - Yes.

  7. Click attachment 3 to go to the receipt page. Do you see the notification that the document is available? - Yes.

  8. Return to the docket report page, then click the link to go to CourtListener for the docket. Does the link work? - Yes

  9. Find the "Buy on PACER" link for a document that is already in the RECAP Archive and click it to return to PACER. Click through the warning page. On the receipt page, do you see a notification that the item is available for free on RECAP? - Yes.

  10. Configure your RECAP options to use Internet Archive style links, then click the "View Document" button. In the upper left corner you should see a button to download the item. The title of the link should be something like:

     Save as gov.uscourts.dcd.178502.2.0.pdf

    Is it? - Yes. Is it missing the case ID? No.

  11. Click this link, click through the warning:

    • Do you see the [R] icon for the documents? - Yes
    • Do you see a notification that the page was uploaded to the RECAP Archive? - Yes

  12. Select attachment 1 and click the "View Document" button. In the upper left corner there is a "Save as" link that should look like:

     Save as gov.uscourts.cand.265908.8.1.pdf

    Does it? - Yes.

For Appellate Court PACER

  1. Go here while logged in, do you have permission to file a document?
  • Yes. do you see a link advertising @recap email? Yes.
  • No. do you see a link advertising @recap email? No.

  1. Search for case '20-15019'.

  2. Do you see a link to create an alert? - Yes.

  3. Do you see an [R] icon next to the Case Number? - Yes.

    • Click the link to go to CourtListener for the docket. Does the link work? - Yes

  4. Do you see an [R] icon next to the Originating Case Number? - Yes.

    • Click the link to go to CourtListener for the Originating docket. Does the link work? - Yes

  5. Click on Case No.(20-15029) to get Case Summary

  6. Do you see a button at the top of the page? Yes.

    • Do you see a notification that the page was uploaded to the RECAP Archive? - Yes.
    • Click the button. Do you see an option to ① create alert ② search this docket ③ view this docket ④ refresh RECAP links? Yes & Yes & Yes & Yes.

  7. Click the ③ view this docket option to go to CourtListener for the Docket. Does the link work? - Yes.

  8. Click the ④ refresh RECAP links option. were the [R] icons removed from the page? did a spinner appear next to the button? Yes & Yes.

    • Did the [R] icons appear after a few seconds? Yes.

  9. Use the full docket button to list all the documents related to this docket. After creating the full docket report. Do you see a button at the top of the page? Yes.

    1. Click the button. Do you see an option to ① create alert ② search this docket ③ view this docket ④ refresh RECAP links? Yes & Yes & Yes & Yes.

  10. Click document number "1" to go to the attachment page. Did you get a notification saying the attachment page was uploaded to the RECAP Archive? - Yes.

  11. Click attachment 1 to go to the receipt page. Do you see the notification that the document is available? - Yes.

  12. Go here. Do you see a link about ① the docket being available and ② to create an alert? - Yes & Yes.

  13. Go here and find the "Buy on PACER" link for a document that is already in the RECAP Archive and click it to return to PACER. Do you see a notification that the item is available for free on RECAP? - Yes.

  14. Configure your RECAP options to use Internet Archive style links, then click the "Accept Charges and Retrieve" button. In the upper left corner you should see a button to download the item. The title of the link should be something like:

            Save as gov.uscourts.ca9.318547.18.0.pdf

    Is it? - Yes. Is it missing the case ID? No.

For ACMS PACER

  • Go here, Do you see a button at the top of the page? - Yes.

    • Do you see a notification that the page was uploaded to the RECAP Archive? - Yes.
    • Click the button. Do you see an option to ① create alert ② search this docket ③ view this docket ④ refresh RECAP links? - Yes & Yes & Yes & Yes.

  1. Click the ③ view this docket option to go to CourtListener for the Docket. Does the link work? - Yes.

  2. Click the ④ refresh RECAP links option. were the RECAP icons removed from the page? did a spinner appear next to the button? - Yes & Yes.

    • Did the RECAP icons appear after a few seconds? - Yes.

  3. Click document number "17" to load an attachment page.

    • Did you get a notification saying the attachment page was uploaded to the RECAP Archive? - Yes.
    • Do you see the RECAP icon next for attachment 1? - Yes.

  4. Click attachment 1 to go to the receipt page. Do you see the notification that the document is available? - Yes.

  5. Configure your RECAP options to use Layer style links, then click the "Accept Charges and Retrieve" button. In the upper left corner you should see a button to download the item. The title of the link should be something like:

            Save as 2d-Cir._23-7222_17_1.pdf

    Is it? - Yes.

  6. Go back to the Case Summary, and click entry 18 to load the receipt page. Do you see the notification that the document is available? - Yes.

  7. Click the "Accept Charges and Retrieve" button. In the upper left corner you should see a button to download the item. The title of the link should be something like:

            Save as 2d-Cir._23-7222_18_0.pdf

    Is it? - Yes.

Uploads

These steps require that you find a new docket that has not yet been sent to CourtListener. This can take some trial and error, but here's the general process:

  1. Go to https://ecf.caed.uscourts.gov/cgi-bin/iquery.pl (note that this needs to be a court without RSS)
  2. Search for the last name "Smith", and limit it to a filed date in the last month.
  3. Pick a case, then click Docket Report. Hopefully at this stage you won't see a notification that it's available in RECAP. If you do, back up and try a different one.

Once you have a new case, take note of the URL for the docket report page. In my case, it's:

https://ecf.cand.uscourts.gov/cgi-bin/DktRpt.pl?320338

Then, buy some data:

  1. Filter to documents 1 to 5 or so, and load the docket.
  2. Select a document, preferably one with attachments.
  3. From the attachment page, select a document with few pages.
  4. From the receipt page, purchase the document.

Test if things are uploaded:

  1. Return to the URL you noted above. Does it now show as available? - Yes.

  2. Click the link in the notice from RECAP in order to open the item in CourtListener.

    • Does the page look OK, containing all of the content you purchased? - Yes
    • Is the document you purchased show up as available in CourtListener? - Yes
    • Do you see short descriptions of items as parsed from the attachment page? - Yes
    • If you click its link to view its HTML page in CourtListener, is the text extracted properly into the page? - Yes (note that you may see OCR artifacts)

  3. Press the "View on PACER" link on CourtListener to return to the item on PACER. Does this work? - Yes

  4. Run the report again to show the same documents as before. Do you see [R] icons? - Yes

  5. Return again to CourtListener page for the docket and click a "Buy on PACER" link. Click through the warning page, then buy the document. Does it appear in CourtListener if you refresh the page? - Yes

  6. Pull up a document in PACER that has attachments, and purchase the zip.

    • Does the zip get fully uploaded and incorporated into CL? - Yes.
    • Does the zip have a good filename when you download it, and have contents like you'd expect? - Yes.
    • Does a loading message with a spinner appear next at the bottom of the page? - Yes.

Interstitial mega docket page

  1. Load this URL for a mega docket and then request the complete docket minus parties (this should cost a dime). You should see a page that asks for you to not purchase the whole thing. Click to purchase the most recent week. Do you see an upload notification for the docket? - Yes

MISC

  1. Can we get things from GAND, where they have a weird window.location bug? Try to get a document from this case:

    https://www.courtlistener.com/docket/6139924/curling-v-raffensperger/

    Does it work?

Add a custom footer
Add a custom sidebar
Clone this wiki locally