-
Notifications
You must be signed in to change notification settings - Fork 4
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Chore/2141 cypress #2305
Chore/2141 cypress #2305
Conversation
Codecov Report
Additional details and impacted files@@ Coverage Diff @@
## develop #2305 +/- ##
===========================================
- Coverage 94.04% 93.55% -0.49%
===========================================
Files 96 96
Lines 2853 2872 +19
Branches 263 265 +2
===========================================
+ Hits 2683 2687 +4
- Misses 123 137 +14
- Partials 47 48 +1
Flags with carried forward coverage won't be shown. Click here to find out more.
Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Outside of a broken link and the email change, LGTM!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just need to delete that extra parenthesis and good to go.
Co-authored-by: Andrew <84722778+andrew-jameson@users.noreply.github.com>
@jtimpe can you get the owasp scan to run on this ticket? |
docs/Technical-Documentation/Architecture-Decision-Record/019-integration-tests.md
Outdated
Show resolved
Hide resolved
docs/Technical-Documentation/Architecture-Decision-Record/019-integration-tests.md
Outdated
Show resolved
Hide resolved
…integration-tests.md Co-authored-by: Alex P. <63075587+ADPennington@users.noreply.github.com>
…integration-tests.md Co-authored-by: Alex P. <63075587+ADPennington@users.noreply.github.com>
|
||
Deployments are slow and require a lot of manual testing; this can cause quite a backup during PR reviews and releases. Unit tests are valuable for fast feedback close to the code, but we are lacking broader-scale automated testing of features. | ||
|
||
### Agile testing quadrants |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
really nice intro discussion to automated testing. thank you @jtimpe
|
||
Tests should be run locally as much as possible during development to ensure changes don't unexpectedly break something else in the system. Tests should at least be run before and during the PR process, so we should add a CircleCI task to run Cypress tests along with the unit tests. | ||
|
||
We should also regularly run tests in a deployed environment. In order to best simulate a production deployment, we should automatically deploy to a specific environment after merges to `develop`, after which the end-to-end tests should automaticfally be run. This would require a few more changes to our CircleCI configuration and processes. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍🏾 it'll be helpful to have a workflow diagram for this when we have this figured out. And figuring out where this will be deployed is another good topic for future discussion. To model production as close as possible, we currently have staging and prod matching at all times. id like to better understand how this testing will coincide with release branching strategy, if at all.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm thanks @jtimpe 🚀
note: i noticed new endpoints related to cypress show up in the backend owasp scans. we should keep an eye on what comes up in the nightly scans to be sure no new or noteworthy issues are raised.
Summary of Changes
Provide a brief summary of changes
Pull request closes #2141
How to Test
List the steps to test the PR
These steps are generic, please adjust as necessary.
account.feature
test fileDeliverables
More details on how deliverables herein are assessed included here.
Deliverable 1: Accepted Features
Checklist of ACs:
lfrohlich
and/oradpennington
confirmed that ACs are met.A couple of relatively easy nice-to-haves
develop
into cloud gov and run tests against the live appdevelop
to a cloudgov environment after PR merge #2337Refer to Cypress's CircleCI integration guide
Deliverable 2: Tested Code
CodeCov Report
comment in PR)CodeCov Report
comment in PR)Deliverable 3: Properly Styled Code
Deliverable 4: Accessible
iamjolly
andttran-hub
using Accessibility Insights reveal any errors introduced in this PR?Deliverable 5: Deployed
Deliverable 6: Documented
Deliverable 7: Secure
Deliverable 8: User Research
Research product(s) clearly articulate(s):