doctest-extract: Alternative doctest implementation that extracts comments to modules

Alternative doctest implementation that extracts comments to modules.

Pros:

• Package versions for tests are consistent with tested library

• Tests run much faster, especially QuickCheck property tests

• No dependency on GHCi or GHC-as-library

• QuickCheck properties do not cause confusing type error messages when actually only identifiers are missing.

• You can inspect extracted modules

• doctest collects tests from the transitive hull of imports of the specified modules. This might help you to keep the list of modules short. doctest-extract only processes the specified modules and thus allows you to focus on a module for development of tests.

• With option --verbose format test source path and line number such that Emacs allows you to click and jump to the test definition.

• Report success only of real tests. doctest reports successful imports and definition of helper types and functions as successful tests. This makes it hard to monitor the number of real tests, e.g. whether some tests have been dropped by accident.

Cons:

• Cannot test for output of IO functions or error messages from partial functions.

• All free variables in QuickCheck properties must be all-quantified using lambda. (Could be even seen as an advantage for the reader of your doctests.)

• No support for a single-line let as an example.

• The Test module does not automatically import modules that the tested module imports. Thus, you usually have to add a setup section with required imports.

• You need tools additional to Cabal, e.g. Makefile, in order generate test modules.