Summary of Test Suite Results for 'OpenActive Reference Implementation'
Mode: Random
✅ 158 passing
❌ 4182 failing
❌ Missing Opportunity Data
Some of the tests failed because there were not enough opportunities matching
the required criteria.
This only happens when using Random Mode
as opposed to Controlled Mode.
In order to pass these tests, you will need to generate more opportunities in
your Booking System. Make sure that there are many opportunities available for
each criteria.
You can use test-data-generator
to get a specification of how much of each type of opportunity you need to
generate.
If any of these criteria are not relevant to your Booking System, you may
need to remove the relevant feature from your Test Suite configuration
(See implementedFeatures
).
Results
This is a list of the criteria, opportunity type, etc for which no opportunities
were found, that also includes a list of which tests failed as a result:
-
❌️ Missing Criteria: TestOpportunityBookable
- Opportunity Types: IndividualFacilityUseSlot, ScheduledSession
- Booking Flows: OpenBookingApprovalFlow, OpenBookingSimpleFlow
- Sellers:
https://localhost:5001/api/identifiers/sellers/1
- Tests failing as a result: 20
-
❌️ Missing Criteria: TestOpportunityBookableFree
- Opportunity Types: IndividualFacilityUseSlot, ScheduledSession
- Booking Flows: OpenBookingApprovalFlow, OpenBookingSimpleFlow
- Sellers:
https://localhost:5001/api/identifiers/sellers/1
- Tests failing as a result: 72
-
❌️ Missing Criteria: TestOpportunityBookableNonFree
- Opportunity Types: IndividualFacilityUseSlot, ScheduledSession
- Booking Flows: OpenBookingApprovalFlow, OpenBookingSimpleFlow
- Sellers:
https://localhost:5001/api/identifiers/sellers/1
- Tests failing as a result: 16
-
❌️ Missing Criteria: TestOpportunityBookableNonFreePrepaymentOptional
- Opportunity Types: IndividualFacilityUseSlot, ScheduledSession
- Booking Flows: OpenBookingApprovalFlow, OpenBookingSimpleFlow
- Sellers:
https://localhost:5001/api/identifiers/sellers/1
- Tests failing as a result: 32
-
❌️ Missing Criteria: TestOpportunityBookableNonFreePrepaymentRequired
- Opportunity Types: IndividualFacilityUseSlot, ScheduledSession
- Booking Flows: OpenBookingApprovalFlow, OpenBookingSimpleFlow
- Sellers:
https://localhost:5001/api/identifiers/sellers/1
- Tests failing as a result: 40
-
❌️ Missing Criteria: TestOpportunityBookableNonFreePrepaymentUnavailable
- Opportunity Types: IndividualFacilityUseSlot, ScheduledSession
- Booking Flows: OpenBookingApprovalFlow, OpenBookingSimpleFlow
- Sellers:
https://localhost:5001/api/identifiers/sellers/1
- Tests failing as a result: 32
-
❌️ Missing Criteria: TestOpportunityBookableUsingPayment
- Opportunity Types: IndividualFacilityUseSlot, ScheduledSession
- Booking Flows: OpenBookingApprovalFlow, OpenBookingSimpleFlow
- Sellers:
https://localhost:5001/api/identifiers/sellers/1
- Tests failing as a result: 24
Tests
OpenBookingApprovalFlow >> IndividualFacilityUseSlot
- ❌️ Payment / Free opportunities (Implemented)
- ❌️ Successful booking of free opportunity with idempotency: (10 failures, 0 warnings, 0 suggestions, 0 passes)
- ✅ Free opportunities must have either a
openBookingPrepayment
value of Unspecified, or have no openBookingPrepayment
specified: (0 failures, 0 warnings, 0 suggestions, 2 passes)
- ⚠️ Fail free bookings which include erroneous payment property: (0 failures, 75 warnings, 0 suggestions, 13 passes)
- ❌️ Successful booking without Checkpoints: (10 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking without payment property: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ⚠️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property is non-zero for free opportunities: (0 failures, 75 warnings, 0 suggestions, 13 passes)
- ❌️ Payment / Opportunities with a non-zero price (Implemented)
- ❌️ Payment / Payment reconciliation detail validation (Implemented)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation, where payment is not required: (19 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment reconciliation detail validation, where payment is required: (19 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment / prepayment optional (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment
identifier
is not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, with
payment
supplied, is successful: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, without
payment
supplied, is successful: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment required and unavailable (Implemented)
- ❌️ Payment / prepayment required (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment details are not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Unsuccessful booking without payment property: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking with payment property: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment unavailable (Implemented)
OpenBookingApprovalFlow >> Multiple
- ❌️ Payment / Free opportunities (Implemented)
- ❌️ Successful booking of free opportunity with idempotency: (25 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Fail free bookings which include erroneous payment property: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking without Checkpoints: (25 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking without payment property: (27 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property is non-zero for free opportunities: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / Opportunities with a non-zero price (Implemented)
- ❌️ Payment / Payment reconciliation detail validation (Implemented)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when no payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when no payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation, where payment is not required: (54 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment reconciliation detail validation, where payment is required: (54 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment / prepayment optional (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment
identifier
is not supplied: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, with
payment
supplied, is successful: (27 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, without
payment
supplied, is successful: (27 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment required and unavailable (Implemented)
- ❌️ Payment / prepayment required (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment details are not supplied: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Unsuccessful booking without payment property: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking with payment property: (27 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment unavailable (Implemented)
OpenBookingApprovalFlow >> ScheduledSession
- ❌️ Payment / Free opportunities (Implemented)
- ❌️ Successful booking of free opportunity with idempotency: (10 failures, 0 warnings, 0 suggestions, 0 passes)
- ✅ Free opportunities must have either a
openBookingPrepayment
value of Unspecified, or have no openBookingPrepayment
specified: (0 failures, 0 warnings, 0 suggestions, 2 passes)
- ⚠️ Fail free bookings which include erroneous payment property: (0 failures, 79 warnings, 30 suggestions, 13 passes)
- ❌️ Successful booking without Checkpoints: (10 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking without payment property: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ⚠️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property is non-zero for free opportunities: (0 failures, 84 warnings, 30 suggestions, 13 passes)
- ❌️ Payment / Opportunities with a non-zero price (Implemented)
- ❌️ Payment / Payment reconciliation detail validation (Implemented)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation, where payment is not required: (19 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment reconciliation detail validation, where payment is required: (19 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment / prepayment optional (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment
identifier
is not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, with
payment
supplied, is successful: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, without
payment
supplied, is successful: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment required and unavailable (Implemented)
- ❌️ Payment / prepayment required (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment details are not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Unsuccessful booking without payment property: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking with payment property: (20 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment unavailable (Implemented)
OpenBookingSimpleFlow >> IndividualFacilityUseSlot
- ❌️ Payment / Free opportunities (Implemented)
- ⚠️ Successful booking of free opportunity with idempotency: (0 failures, 81 warnings, 0 suggestions, 7 passes)
- ✅ Free opportunities must have either a
openBookingPrepayment
value of Unspecified, or have no openBookingPrepayment
specified: (0 failures, 0 warnings, 0 suggestions, 2 passes)
- ❌️ Fail free bookings which include erroneous payment property: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ⚠️ Successful booking without Checkpoints: (0 failures, 76 warnings, 0 suggestions, 7 passes)
- ❌️ Successful booking without payment property: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property is non-zero for free opportunities: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / Opportunities with a non-zero price (Implemented)
- ❌️ Payment / Payment reconciliation detail validation (Implemented)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation, where payment is not required: (15 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment reconciliation detail validation, where payment is required: (15 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment / prepayment optional (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment
identifier
is not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, with
payment
supplied, is successful: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, without
payment
supplied, is successful: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment required and unavailable (Implemented)
- ❌️ Payment / prepayment required (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment details are not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Unsuccessful booking without payment property: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking with payment property: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment unavailable (Implemented)
OpenBookingSimpleFlow >> Multiple
- ❌️ Payment / Free opportunities (Implemented)
- ❌️ Successful booking of free opportunity with idempotency: (27 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Fail free bookings which include erroneous payment property: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking without Checkpoints: (27 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking without payment property: (22 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property is non-zero for free opportunities: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / Opportunities with a non-zero price (Implemented)
- ❌️ Payment / Payment reconciliation detail validation (Implemented)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when no payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when no payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when payment required: (26 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation, where payment is not required: (50 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment reconciliation detail validation, where payment is required: (50 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment / prepayment optional (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment
identifier
is not supplied: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, with
payment
supplied, is successful: (22 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, without
payment
supplied, is successful: (22 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment required and unavailable (Implemented)
- ❌️ Payment / prepayment required (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment details are not supplied: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Unsuccessful booking without payment property: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking with payment property: (22 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (19 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment unavailable (Implemented)
OpenBookingSimpleFlow >> ScheduledSession
- ❌️ Payment / Free opportunities (Implemented)
- ❌️ Successful booking of free opportunity with idempotency: (7 failures, 0 warnings, 0 suggestions, 0 passes)
- ✅ Free opportunities must have either a
openBookingPrepayment
value of Unspecified, or have no openBookingPrepayment
specified: (0 failures, 0 warnings, 0 suggestions, 2 passes)
- ⚠️ Fail free bookings which include erroneous payment property: (0 failures, 79 warnings, 30 suggestions, 13 passes)
- ❌️ Successful booking without Checkpoints: (7 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking without payment property: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ⚠️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property is non-zero for free opportunities: (0 failures, 84 warnings, 30 suggestions, 13 passes)
- ❌️ Payment / Opportunities with a non-zero price (Implemented)
- ❌️ Payment / Payment reconciliation detail validation (Implemented)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - incorrect reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when no payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation - missing reconciliation details, when payment required: (6 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment reconciliation detail validation, where payment is not required: (15 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment reconciliation detail validation, where payment is required: (15 failures, 0 warnings, 0 suggestions, 1 passes)
- ❌️ Payment / prepayment optional (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment
identifier
is not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, with
payment
supplied, is successful: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Prepayment optional, without
payment
supplied, is successful: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment required and unavailable (Implemented)
- ❌️ Payment / prepayment required (Implemented)
- ❌️ IncompletePaymentDetailsError must be returned in the case that payment details are not supplied: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Unsuccessful booking without payment property: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Successful booking with payment property: (15 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Expect a TotalPaymentDueMismatchError when the totalPaymentDue property does not match: (13 failures, 0 warnings, 0 suggestions, 0 passes)
- ❌️ Payment / prepayment unavailable (Implemented)