Skip to content

sscheck 0.2.1-SNAPSHOT

Compare
Choose a tag to compare
@juanrh juanrh released this 11 Jan 05:58
· 67 commits to master since this release

Bug fix implementation of temporal properties. Uses of DStreamProp.forAll combining with extending the trait SharedStreamingContextBeforeAfterEach should be replaced by extending the trait DStreamTLProperty and calling forAllDStream. This solves:

  • Execution of a test case is now independent from others, as a new streaming context is created for each test case. This is particularly important for stateful DStream transformations
  • Replaced uses DynSingleSeqQueueInputDStream by TestInputStream from spark-testing-base, which implements checkpointing correctly
  • fixed #32 and #31