- Apply --randomize recursively
- Add
--randomize
- Interrupt diff calculation if it takes longer than two seconds (see #415)
- Add compatibility with QuickCheck 2.13.1 (see #410)
- Add
--focused-only
(see #390) - Add
--fail-on-focused
(see #389)
- Add
Test.Hspec.Runner.runSpec
(see #216)
- Allow to focus individual spec items (see #319)
- Do not calculate diff on
--no-diff
(see #332) - Remove deprecated module Test.Hspec.Core
- Extract source locations from RecConError (see #375)
- Add
modifyArgs
andmodifyMaxShrinks
toTest.Hspec.QuickCheck
(see #380)
- GHC 8.6.1 related changes
- Compatibility with
QuickCheck-2.12
- Use
module[line:column]
instead ofmodule:line:column
as default label fordescribe
/it
(fixes #366)
- Show how to rerun individual spec items on test failures (see #205)
- Treat character escapes like
\NUL
as single tokens on--diff
(see #351) - Allow a
/
at the beginning and at the end of an absolute path that is passed to--match
or--skip
- Use module:line:column as default label for describe/it (see #250)
- Warn if user is affected by https://ghc.haskell.org/trac/ghc/ticket/13285 (see #329)
- Disable tests for Test.Hspec.Core.Timer (see #352)
- Add
sequential
(see #311) - Add support for
--diff
whenshouldBe
is uesd withQuickCheck
-properties - Add source locations when
shouldBe
is uesd withQuickCheck
properties - Print
QuickCheck
labels on success (see #297) - Retain output of
verbose
,label
,collect
,classify
, etc. forQuickCheck
properties (see #257) - Extract source location from error / undefined (see #316)
- Parse source locations from pattern match failures
- Include source column when formatting source locations
- Colorize whitespaces with background color instead of foreground color with
--diff
- Run
Test.Hspec.Core.Formatters.exampleProgress
inFormatM
instead ofIO
- Make sure that progress output is always cleared (fixes #301)
- Add location information to
pending
(not used by any formatter yet) - Include duration for each spec item in new formatter API (see #315) (not yet exposed)
- Removed deprecated module
Test.Hspec.HUnit
, useTest.Hspec.Contrib.HUnit
instead - Deprecate
--out
- Remove
BestEffort
source locations
- compatibility with GHC 8.4.1-alpha3
- compatibility with
QuickCheck-2.11.3
and up (note thatQuickCheck
versions2.11
to2.11.2
are not fully supported)
- compatibility with the upcoming version
4.11.0.0
ofbase
hspec-discover
: Sort specs using natural sort order
- Require quickcheck-io >= 0.2.0
- Read command-line options from environment variable
HSPEC_OPTIONS
- Use
--diff
by default - Add
--failure-report
(see #266)
- Compatibility with HUnit < 1.3
- Read command-line options from config files
~/.hspec
and.hspec
- Add support for
--diff
- Add
xit
,xspecify
,xdescribe
andxcontext
(see #252) - Add
--rerun-all-on-success
- Report exceptions in
beforeAll
operations only once - Add indentation when actual/expected contain newlines (see #263)
- More graceful shutdown on ctrl-c (see #270)
- Run around-hook for Bool and Result (see #252)
- Include
CHANGES.markdown
in package tarball
Internal changes:
- Rename
Fail
constructor ofResult
-type toFailure
- Add
FailureReason
type - Add
Test.Hspec.Core.Spec.safeEvaluateExample
- Compatibility with HUnit 1.5
- Fix build for HUnit < 1.4
- Proper support for GHC 8 call stacks
- Compatibility with QuickCheck-2.9
- Make sure that
cabal haddock
works forhspec-discover
- Forward compatibility for HUnit 1.4
- Fix tests for GHC 8.0.1-rc1
- Fix compilation for GHC 8.0.1-rc1
- Make sure that Vim's default
errorformat
recognizes exact locations - GHCJS compatibility
- Add source locations to test
Result
- GHC 7.0.* compatibility
- Make use of GHC 7.10.2 source locations
- Add
--jobs
- Depend on `hspec-expectations-0.7.0"
- Add
beforeAll_
- If there were no previous failures, run all spec items on
--rerun
- Compatibility with QuickCheck-2.8
- Make
hspec-discover
ignore modules with invalid module names, this fixes issues withflycheck
's temporary files
- Format source locations like gcc does
- Re-export
before_
fromTest.Hspec
- Add
before_
- Add command-line option
--skip
- Generalize
after_
,afterAll_
andaround_
- Indent error messages for failed examples (fixes #186)
- Export
defaultParams
fromTest.Hspec.Core.Example
- Bring back
Test.Hspec.HUnit
and deprecate it to provide a smother upgrade path
- Add missing extra source files to for
hspec-discover
- Split package into
hspec
,hspec-core
andhspec-discover
- Allow hooks (
before
,around
, etc.) to pass arguments to spec items - Do not print
-
in front of spec items withspecdoc
formatter - Move
Test.Hspec.HUnit
tohspec-contrib
- Add
specGroup
andspecItem
toTest.Hspec.Core
- Deprecate
Test.Hspec.Core.it
andTest.Hspec.Core.describe
- Make
hspec-discover
work with-XNoImplicitPrelude
- Include
IOErrorType
when printing uncaughtIOException
s (see #204)
- Add
--module-name
option tohspec-discover
(see #168)
- Add optional source location to spec items
- Move item requirement text from
SpecItem
constructor toItem
data type - Remove
BuildSpecs
constructor fromSpecTree
, havingrunIO
this is not really needed - Add
mapSpecTree
toTest.Hspec.Core
- Add
afterAll
(see #188) - Do not return
Result
fromhspecWith
and accept command-line options (the old behavior is still available ashspecWithResult
) - Rename
configHandle
toconfigOutputFile
- Omit empty
describe
groups from report - Do not pass position to
Formatter.exampleGroupStarted
(we can not support this with the upcomming cleanup actions #188) - Do not print empty lines before/after spec groups
- Deprecate
Test.Hspec.Formatters.newParagraph
- Make test suite independent from QuickCheck seed (see #187)
- Depend on
hspec-expectations-0.6.1
- Add
beforeAll
- Add
specify
as an alias forit
- Add
BuildSpecs
constructor to internalSpecTree
data structure. This allows you to doIO
while constructing the spec tree. - Add
runIO
- Do not use exception type to distinguish between synchronous/asynchronous exceptions (thanks to Michael Snoyman)
- Remove
Example
instance forTest.HUnit.Test
(#101), useTest.Hspec.HUnit.fromHUnitTest
instead. - Do not reexport
property
fromTest.Hspec.QuickCheck
- Move
ProgressCallback
out ofParams
- Add show instance for
Params
- Move requirement text from
Item
toSpecItem
constructor - Remove deprecated modules and functions
- Make sure that ctrl-c works properly with GHC 7.8.* and QuickCheck-2.6
- Compatibility with transformers-0.4.0.0
- Make internal Tree data structure more strict (#169)
- Print type of exceptions that are raised from QuickCheck properties (#94)
- Bring back compatibility with older versions of QuickCheck (#166)
- Depend on QuickCheck 2.7
- Do not use color if
TERM=dumb
(see #158)
hspec-discover
now accepts--no-main
which results in a top-level spec being generated instead of a test driver (thanks @DanielG)- Make sure that
after
is run on failing tests (see #159)
- Add
shouldMatchList
- Run
before
/after
/around
for each single check of a QuickCheck property - Add
Test.Hspec.Core.mapSpecItem
- Add
modifyMaxSuccess
,modifyMaxDiscardRatio
andmodifyMaxSize
toTest.Hspec.QuickCheck
- Don't fail if callback is not called in
around
hspec-discover
: Remove--nested
optionhspec-discover
: IgnoreSpec.hs
/Spec.lhs
- Add
after
andaround
- Add
shouldContain
(thanks to Alfredo Di Napoli) - When printing progress, skip total if it is 0
- Do not colorize the description/requirement in failure list
- Add
--depth
for use withhspec-smallcheck
- Add
before
- Add
--qc-max-discard
and--qc-max-size
- Allow to specify the output file with
--out
- Add support for parallelization
- Change license to MIT
- Add MonadIO instance for FormatM
- Add support for custom formatters to hspec-discover
- Add hspecResult
- Rename
--re-run
to--rerun
+ add documentation (#95) - Remove
configVerbose
- Use same
--qc-max-success
on--rerun
(#125) - Add command-line option
--no-color
,--color
does not accept arguments anymore (#130)
- Make sure that QuickCheck is never chatty
- Make sure progress for QuickCheck examples is shown
- Print "Randomized with seed ..." only once
- Add
--seed
, it can be used to specify the seed for QuickCheck properties - Reuse previous seed on
--re-run
- Depend on quickcheck-io
- Allow to use expectations as QuickCheck properties (#80)
- Do not suppress output to
stdout
- Change type of
pending
toExpectation
, addpendingWith
(#121) - Add the
example
function, it fixes the type of an Expectation (#86) - Rename
--fast-fail
to--fail-fast
(for consistency with RSpec) - Do not clutter Cabal test suite logs with QuickCheck output (#112)
- Skip redundant output from QuickCheck failure messages (#102)
- hspec-discover now discovers .lhs files, too
- Visually distinguish error message from requirements in the summary (#100)
- Export
formatException
fromTest.Hspec.Formatters
- Add
--fast-fail
(#82) - Print a summary on UserInterrupt/ctrl-c (#107)
- Add
--dry-run
(#111)
- Properly handle ctrl-c while running QuickCheck properties (#93)
- Default to
--color=always
when--color
is used without argument (#106) - treat
--qc-max-success
as an alias for--maximum-generated-tests
- Used CPU time is now only included in the test summary if run with
--print-cpu-time
.
- We now have a manual at http://hspec.github.io/. The sources are in
doc/
. It's still work in progress. Contributions are very welcome! - The Haddock documentation now indicates the stability of each exposed
module.
Test.Hspec
is now considered stable. hspec
now supports command-line options--color
can be used to enable/disable colored output--format
can be used to pick a specific formatter--html
can be used to produce an HTML report--maximum-generated-tests
can be used to specify QuickCheck'smaxSuccess
--match
only runs spec items that match a given string--re-run
only runs spec items that previously failed. This is undocumented, experimental and only works within GHCi (use:reload
/:main
)!
- Runner functions exported from
Test.Hspec.Runner
new expect a monadic spec. fromHUnitTest
has been added. It can be used to run existing HUnit test suites with Hspec.- The
Example
instance for HUnitTest
s has been deprecated.fromHUnitTest
can be used instead. The primary motivation is, thatfromHUnitTest
gives more detailed reporting for nested HUnit test suites. Test.Hspec.Monadic
has been deprecated, all functionality is available through one ofTest.Hspec
,Test.Hspec.Core
orTest.Hspec.Runner
.- More of Hspec's internals are now exposed from
Test.Hspec.Core
- All runner functions for the core spec type (aka as non-monadic spec) have
been deprecated, use e.g.
Test.Hspec.hspec . fromSpecList
instead. The motivation is to provide an API that does not expose colliding names. - Some other stuff from
Test.Hspec.Core
that collides with other parts of the API has been deprecated. Compatible alternatives are given in each deprecation message. - The default formatter now produces less whitespace (#73) + other minor improvements
- The formatter API has been revamped.
- The exception type is now printed if an example fails due to an exception (#50)
- The number of pending examples is now printed after each test run (#85)
--verbose
has been added (#87)
-
Test.Hspec
now re-exports the monadic API. If you still use the non-monadic API, you can useTest.Hspec.Core
as a drop-in replacement. -
hspec-expectations
, a set of combinators that allow to express expectations about the outcome of code examples, is now included with Hspec. Have a look at the [README ofhspec-expectations
] (https://github.com/sol/hspec-expectations#readme) for a short introduction. -
hspec-discover
, a mechanism for automatic spec discovery, is now an official part of Hspec. Have a look at [hspec-discover
's README] (https://github.com/hspec/hspec/tree/master/hspec-discover#readme) for a short introduction.
-
hspec
has been removed, andhspecX
has been renamed tohspec
(see #71) -
hHspec
now returns a summary of the test run. -
The time reporting after a test run is not colored anymore.
-
Test.Hspec
warns now about future changes: It will re-exportTest.Hspec.Monadic
in the future. If you still use the non-monadic API, you can either useTest.Hspec.Core
as a drop-in replacement, or migrate your code to the monadic API.The monadic API is more stable and easier to use. Now is a good time to switch!
-
Test.Hspec.Core
is now a proper superset ofTest.Hspec
-
All descriptions of nested examples are now included in summary for failing examples
-
context
is now an alias fordescribe
- Specs from Test.Hspec.Monadic has been renamed to Spec. For backward compatibility Specs is still kept as an alias.
With this change, both of the following code snippets work.
it "some behavior" $
pending -- no reason given
it "some other behavior" $
pending "some reason"
This should give more useful error messages when adapting old specs that use
the non-monadic API for hspec-1.0
/hspec-1.1
.
Those are internal functions, and they will be removed/hidden with the next release. If you use any of those, update your code. If you really need them, open a ticket and describe your use case.
Test.Hspec.QuickCheck.property
is now simply a re-exports of
Test.QuickCheck.property
. This has the advantage that you do not get a name
collision if you import both, Test.Hspec.QuickCheck
and Test.QuickCheck
.
NOTE: This is a breaking change to the non-monadic API. The monadic API is not affected.
In some situations parent descriptions for nested specs were not included in the generated report. Solving this required a change to the data structure that is used to represent specs (it was not a proper tree, now it is).
The runner functions (hspec
, hspecB
and hspecX
) now take a list of
descriptions.
The following works with hspec-0.9
, but not with hspec-1.0
.
main = hspecX $
describe "reverse" [
it "reverses a list" $
reverse [1, 2, 3] == [3, 2, 1],
it "gives the original list, if applied twice" $ property $
\xs -> reverse (reverse xs) == (xs :: [Int])
]
For hspec-1.0
, you need to wrap it into a list.
main = hspecX [
describe "reverse" [
it "reverses a list" $
reverse [1, 2, 3] == [3, 2, 1],
it "gives the original list, if applied twice" $ property $
\xs -> reverse (reverse xs) == (xs :: [Int])
]
]
Specs consisting of several desribes, combined with descriptions
, continue
to work unchanged. But descriptions
is now a noop, and it will be removed in
a future release. So it is a good idea to drop it.
The following works with both hspec-0.9
and hspec-1.0
.
main = hspecX $ descriptions [ -- descriptions is redundant
describe "Foo" [
it "has some behavior" True
]
, describe "Bar" [
it "has some behavior" True
]
]
But the following is recommended instead.
main = hspecX [
describe "Foo" [
it "has some behavior" True
]
, describe "Bar" [
it "has some behavior" True
]
]
For all the details, have a look at the [docs] (http://hackage.haskell.org/packages/archive/hspec/latest/doc/html/Test-Hspec-Formatters.html).
In addition to the used CPU time, the total time required to run a spec is now include in the summary. This is useful for specs that do non-CPU-intensive stuff, or fork subprocesses.