Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test Coverage by Domain #15

Open
7 tasks
TheBoatyMcBoatFace opened this issue Jul 28, 2023 · 6 comments
Open
7 tasks

Test Coverage by Domain #15

TheBoatyMcBoatFace opened this issue Jul 28, 2023 · 6 comments
Assignees
Labels
📑 Report Issues or reports that involve data reporting or management 🪢 Summary Reports (Domain/Org/Tech) Issues or reports that involve data from Summary Reports

Comments

@TheBoatyMcBoatFace
Copy link
Member

TheBoatyMcBoatFace commented Jul 28, 2023

Question

What is the total number of pages (URLs) that we are currently tracking and evaluating with Axe to prove the comprehensiveness of our accessibility testing?

Target Audience

The intended audience for this report includes web management team, SEO specialists, and stakeholders interested in accessibility compliance.

Input Options

  • domain

Report Output

The columns this report will output

  • domain
  • total_urls
  • active_axe_urls
  • is_objective_urls
  • errored_urls
  • domain_coverage_axe (percent of domain covered0

Team

📊 Domain/URL Analysis

References

Please reference the Accessibility Testing Protocol document and the list of all URLs currently being tracked in our database. Additionally, Axe accessibility evaluation records will help substantiate this report.

@TheBoatyMcBoatFace TheBoatyMcBoatFace self-assigned this Jul 28, 2023
@TheBoatyMcBoatFace TheBoatyMcBoatFace added 🧚 Feature Request Requests for new features 🛠️ Task Issues related to tasks that need to be completed 🆕 New Issues that are newly created 📑 Report Issues or reports that involve data reporting or management 🤔 Unrefined Issues that are still being discussed and refined labels Jul 28, 2023
@TheBoatyMcBoatFace TheBoatyMcBoatFace moved this to 🔖 Ready in Report Manager Jul 28, 2023
@TheBoatyMcBoatFace TheBoatyMcBoatFace added 🪢 Summary Reports (Domain/Org/Tech) Issues or reports that involve data from Summary Reports 🌐 Accessibility Scans Issues or reports that involve data from Accessibility Scans and removed 🛠️ Task Issues related to tasks that need to be completed 🆕 New Issues that are newly created 🤔 Unrefined Issues that are still being discussed and refined 🌐 Accessibility Scans Issues or reports that involve data from Accessibility Scans 🧚 Feature Request Requests for new features labels Jul 28, 2023
@TheBoatyMcBoatFace TheBoatyMcBoatFace changed the title Comprehensive Accessibility Testing Coverage Test Coverage by Domain Jul 28, 2023
@TheBoatyMcBoatFace TheBoatyMcBoatFace moved this from 🔖 Ready to 🆕 New in Report Manager Jul 28, 2023
@TheBoatyMcBoatFace TheBoatyMcBoatFace moved this from 🆕 New to 🔖 Ready in Report Manager Jul 28, 2023
@mgifford
Copy link
Contributor

I'm now thinking it might be useful to have not only the raw numbers, but also:

  • For the list of URLs, how old is the oldest crawled URL & the newest.   Did we crawl the site first 5 weeks ago, and then again 5 minutes ago? Also what is the average? 

  • The same in mode, what is the oldest axe scan, the newest & the average? 

    If we know that we've crawled all pages for the latest URLs in the last two weeks, and then scanned all the pages in the last week, then we have high confidence that we'd have 100% coverage of everything that was live in the last week.

@mgifford mgifford moved this from 🔖 Ready for Work to 👀 In review in Report Manager Sep 14, 2023
@mgifford mgifford moved this from 👀 In review to 🏗 In progress in Report Manager Sep 14, 2023
@TheBoatyMcBoatFace
Copy link
Member Author

  • URL Verification

TheBoatyMcBoatFace added a commit that referenced this issue Sep 26, 2023
 Resolves [Reports #15](#15)

Signed-off-by: Bentley Hensel <bentleyhensel@gmail.com>
@TheBoatyMcBoatFace TheBoatyMcBoatFace moved this from 🏗 In progress to 👀 In review in Report Manager Sep 26, 2023
@TheBoatyMcBoatFace
Copy link
Member Author

@mgifford Can you please run this request under the CivicActions environment in Postman for the Test Coverage by Domain Report

TheBoatyMcBoatFace added a commit that referenced this issue Sep 26, 2023
Hotfix for #15

Signed-off-by: Bentley Hensel <bentleyhensel@gmail.com>
@mgifford
Copy link
Contributor

Did I break it?

"Cloud Agent Error: Couldn't resolve host. Make sure the domain is publicly accessible or select a different agent."

@TheBoatyMcBoatFace
Copy link
Member Author

I've been horrible about updating Github, but a ton of pushes have been going out lately. I am getting very very close to a massive windfall on these projects. By the end of this week, we will have a system which crawls, uppies, tech, and basic Axe with the new data schema and most of the reports will be active.

@mgifford
Copy link
Contributor

How will I validate that when it is ready? Will it just be on gova11y.io or something I build in Docker? What instructions will be provided for me to follow?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
📑 Report Issues or reports that involve data reporting or management 🪢 Summary Reports (Domain/Org/Tech) Issues or reports that involve data from Summary Reports
Projects
Status: 👀 In review
Development

No branches or pull requests

2 participants