Skip to content

Releases: j-easy/easy-batch

v7.0.2

14 Mar 19:52
11dda0e
Compare
Choose a tag to compare

This is a patch release that fixes the following issue:

  • Issue #394 : Resource leak in FileRecordReader

This release also includes some minor backward-compatible dependency updates:

  • jackson-databind: 2.12.0 -> 2.12.2
  • yasson: 1.0.7 -> 1.0.8
  • univocity-parsers: 2.9.0 ->2.9.1
  • xstream: 1.4.15 -> 1.4.16
  • spring: 5.3.2 -> 5.3.4
  • hibernate: 5.4.26.Final -> 5.4.29.Final

v7.0.1

18 Dec 22:59
739e1d8
Compare
Choose a tag to compare

This is a patch release that fixes the following issue:

  • Issue #393 : Errors in reader/writer open/close methods are not handled

This release also includes some minor backward-compatible dependency updates:

  • jackson-databind: 2.11.2 -> 2.12.0
  • univocity-parsers: 2.8.4 ->2.9.0
  • xstream: 1.4.12 -> 1.4.15
  • yamlbeans: 1.13 -> 1.15
  • spring: 5.2.9.RELEASE -> 5.3.2
  • hibernate: 5.4.21.Final -> 5.4.26.Final
  • hibernate-validator: 6.1.5.Final -> 6.1.7.Final

v7.0.0

24 Sep 20:56
4026fd9
Compare
Choose a tag to compare

This release is a major version as it requires Java 11 or above. The main theme for this release is API type safety. There are no new features in this version except updating all APIs to be generic:

  • RecordReader (and its listener): 7ed62a5
  • Batch (and its listener): ba60977
  • RecordWriter (and its listener): d437aa5
  • RecordProcessor (and its listener / sub interfaces): 279ed29
  • Predicate: 063fcc5
  • JobBuilder: 6929936

These changes require updating job definitions to use generics for input/output types in order to enforce the correctness and coherence of expected types between the record reader and writer (More details about this in issue #388).

Migration guide from v6.1 to v7.0

1. Job definition updates

The most notable change required by this release is regarding job definitions:

--Job job = new JobBuilder() // v6
++Job job = new JobBuilder<String, Tweet>() // v7
                 // define batch components
                .build();

Specifying input/output types is not mandatory, but not doing so will lead to a raw type usage warning.

2. RecordProcessor generic types updates

Another important change has been introduced in this release about the generic type of RecordProcessor. In v6, the generic types of RecordProcessor were the types of input/output records. In v7, generic types now represent the type of the payload of input/output records:

--public interface RecordProcessor<I extends Record, O extends Record> {  // v6
--      O processRecord(I record) throws Exception;
--}
++public interface RecordProcessor<I, O> { // v7
++     Record<O> processRecord(Record<I> record) throws Exception;  
++}

This change has a direct impact on all interfaces extending RecordProcessor (like RecordFilter, RecordMapper, RecordMarshaller and RecordValidator) and their corresponding implementations.

3. Other API updates

Any usage of the aforementioned APIs (RecordReader, RecordWriter, Batch, etc) and their associated listeners should be updated to use generics where appropriate.

4. Deprecated APIs removal

All deprecated APIs in v6.0 and v6.1 have been removed in this major release. The suggested replacement (if any) should be found in the Javdoc of the deprecated API.

v6.1.0

14 Jul 21:04
48c8188
Compare
Choose a tag to compare

This is a minor release which can be used as a drop-in replacement for v6.0.0. Here are the major changes:

New Features and enhancements

  • Issue #368: Add RetryableRecordProcessor implementation
  • Issue #381: Add default methods in record reader/writer interfaces

Bug fixes

  • Issue #372: BeanPropertiesPreparedStatementProvider is failing to prepare statement if bean properties has null value

Deprecations

  • Issue #380: Deprecate the static factory method JobBuilder#aNewJob
  • Issue #379: Deprecate ContentBasedBlockingQueueRecordWriterBuilder

v6.0.0

07 Feb 21:34
Compare
Choose a tag to compare

This major release marks a new generation of the framework which is now based on Java 8. It has been an opportunity to improve the framework internals as well as some public APIs. All deprecated APIs in v5.3 and before have been removed. Some APIs have changed in a non-backward compatible way to fix a couple of minor design inconsistencies introduced in the v5 line.

The root package has been updated from org.easybatch to org.jeasy.batch for consistency with other Jeasy projects. Artifact IDs have also been changed to match the same naming pattern as other projects. Please refer to the migration guide below for more details.

As you will see in the migration guide, many APIs have been deprecated in previous versions and are now completely removed. As Antoine de Saint-Exupery said:

"Perfection is achieved not when there is nothing more to add, but when there is nothing left to take away"

I believe with this release, there is no much more to take away from Easy Batch, but this does not make it perfect! That said, I am very happy and proud to see some serious companies using it in production as well as encouraging feedback from the community. So I would like to thank all contributors who helped making this release possible! Thank you all for your time and efforts! You are awesome 👍

In addition to dependencies and documentation updates, here are the major highlights for v6.0:

New features

  • Issue #261: Add support for JSON mapping with Yasson (JSON-B RI)
  • Issue #311: Add support for Java 8 date/time classes
  • Issue #353: Add converters for Java 8 date/time types
  • Issue #361: Make JobExecutor implement java.lang.AutoCloseable
  • Issue #363: Add batch scanning feature
  • Issue #366: Add formatting option in BeanFieldExtractor

Enhancements

  • Issue #351: FileRecordWriter should not throw an Exception at construction time
  • Issue #355: Remove system properties from JobReport#toString
  • Issue #356: Improve job duration formatting
  • Issue #357: Show job duration in the logs
  • Issue #364: Add default methods in listener interfaces

Bug fixes

  • Issue #352: XmlRecordReader should close the input stream
  • Issue #365: Incorrect fixed length record marshalling

New tutorials

Breaking changes

  • All usages of java.io.File (namely in constructors of all file based record readers/writers) were deprecated in v5.3 and have been replaced with java.nio.file.Path in v6
  • Quartz support was deprecated in v5.3 and has been removed in v6. The entire module easybatch-quartz has been removed in v6. This module used to provide two classes that act as a bridge between Easy Batch APIs and Quartz APIs. Those two classes (EasyBatchJob and EasyBatchJobFactory) can now be copied from the Quartz tutorial.
  • MongoDB support has been dropped (Issue #354). Please note that this decision was made after releasing v5.3, hence you will not find any @Deprecated annotations on classes of this module in the v5.3 release. Sorry for any inconvenience!
  • JobListener#beforeJobStart and JobListener#afterJobEnd have been renamed to JobListener#beforeJob and JobListener#afterJob (Issue #362)
  • Jms reader/writer now work with a JMS Destination instead of Queue to support Topics as well (Issue #359)
  • The constructor of JmsMessageTransformer now accepts a javax.jms.Session instead of javax.jms.QueueSession to support both queue and topic sessions (Issue #360)
  • The JmsRecordReader now returns null based on a timeout and not a JmsPoisonMessage anymore (because JmsPoisonMessage has been removed, see "Removed APIs" section of the migration guide)
  • The BlockingQueueRecordReader now returns null based on a timeout and not a PoisonRecord anymore (because PoisonRecord has been removed, see "Removed APIs" section of the migration guide)
  • All EIP related APIs (ContentBasedBlockingQueueRecordWriter, ContentBasedBlockingQueueRecordWriterBuilder, DefaultPredicate, Predicate, RandomBlockingQueueRecordWriter, RoundRobinBlockingQueueRecordWriter) and their JMS equivalent were moved to a new extension module called easy-batch-integration

Migration guide from v5.3 to v6.0

Although care has been taken to document all changes in details, a thing or two could have been missed (in which case, apologies upfront).

Maven coordinates

  • The group id has changed from org.easybatch to org.jeasy
  • Artifact IDs have been updated like follows: easybatch-core -> easy-batch-core (same pattern for other artifacts)

Here is the new maven dependency for the core module:

 <dependency>
     <groupId>org.jeasy</groupId>
     <artifactId>easy-batch-core</artifactId>
     <version>6.0.0</version>
 </dependency>

Removed APIs

  • org.easybatch.xml.XmlWrapperTagWriter was deprecated in v5.3 and has been removed in v6
  • org.easybatch.tools.monitoring.CliJobMonitoringListener, org.easybatch.tools.reporting.HtmlJobReportFormatter andorg.easybatch.tools.reporting.JobReportEmailSender were deprecated in v5.3 and have been removed in v6. The entire easybatch-tools module has been removed
  • Quartz support was deprecated in v5.3 and has been removed in v6. The entire module easybatch-quartz has been removed in v6
  • MongoDB support has been be removed in v6 (See issue #354). Please note that this decision has been made after releasing v5.3, hence you will not find any @Deprecated annotation on classes of this module in the v5.3 release. Sorry for any inconvenience!
  • org.easybatch.jms.JmsPoisonMessage, org.easybatch.jms.JmsPoisonRecord, org.easybatch.jms.JmsPoisonRecordBroadcaster and org.easybatch.jms.JmsPoisonRecordFilter were deprecated in v5.3 and have been removed in v6.
  • org.easybatch.core.record.PoisonRecord, org.easybatch.core.listener.PoisonRecordBroadcaster and org.easybatch.core.filter.PoisonRecordFilter were deprecated in v5.3 and have been removed in v6.
  • The constructor org.jeasy.batch.core.reader.BlockingQueueRecordReader#BlockingQueueRecordReader(java.util.concurrent.BlockingQueue<org.jeasy.batch.core.record.Record>, int) has been removed in v6. Please note that this constructor was not marked with @Deprecated in v5.3 by mistake.
  • The constructor BlockingQueueRecordWriter(final List<BlockingQueue<Record>> has been be removed in v6 as this writer now operates on a single blocking queue instead of multiple queues.
  • org.easybatch.core.listener.RecordProcessingTimeListener was deprecated in v5.3 and has been removed in v6
  • org.easybatch.core.filter.RecordNumberBetweenFilter, org.easybatch.core.filter.RecordNumberEqualToFilter, org.easybatch.core.filter.RecordNumberGreaterThanFilter and org.easybatch.core.filter.RecordNumberLowerThanFilter were deprecated in v5.3 and have been removed in v6
  • JobReportFormatter and DefaultJobReportFormatter were deprecated in v5.3 and have been removed in v6
  • Constructors that take a delimiter and qualifier in DelimitedRecordMarshaller and ApacheCommonCsvRecordMarshaller have been removed. Use the new setters for these parameters instead.

Replaced/Renamed/Moved APIs

  • org.easybatch.core.filter.FilteredRecordsSavingRecordFilter was deprecated in v5.3 and has been removed in v6. Use the new org.easybatch.core.filter.FilteredRecordsCollector instead
  • org.easybatch.core.filter.StartWithStringRecordFilter was deprecated in v5.3 and has been removed in v6. Use org.easybatch.core.filter.StartsWithStringRecordFilter instead
  • org.easybatch.core.filter.EmptyRecordFilter was deprecated in v5.3 and will be removed in v6. Use org.easybatch.core.filter.EmptyStringRecordFilter instead
  • org.easybatch.core.filter.EndWithStringRecordFilter was deprecated in v5.3 and will be removed in v6. Use org.easybatch.core.filter.EndsWithStringRecordFilter instead
  • Usages of java.util.date (namely in Header class) were deprecated in v5.3 and have been replaced with java.time.LocalDateTime in v6
  • Usages of java.io.File (namely in constructors of all file based record readers/writers) were deprecated in v5.3 and have been replaced with java.nio.file.Path in v6
  • PayloadExtractor was deprecated in v5.3 and has been removed in v6. Use Utils#extractPayloads instead
  • The constructor org.jeasy.batch.extensions.yaml.YamlRecordReader#YamlRecordReader(java.io.InputStream, java.lang.String) has been replaced with one that takes a java.nio.charset.Charset instead of a String for the charset name. Please note that this constructor was not marked with @Deprecated in v5.3 by mistake.
  • The constructor org.jeasy.batch.json.JsonRecordReader#JsonRecordReader(java.io.InputStream, java.lang.String) has been replaced with one that takes a java.nio.charset.Charset instead of a String for the charset name. Please note that this constructor was not marked with @Deprecated in v5.3 by mistake.
  • org.easybatch.extensions.stream.StreamRecordReader was moved to the core module under `org.e...
Read more

v5.3.0

14 Jan 22:21
Compare
Choose a tag to compare

This is a minor release which is the last release of the v5.x line. Here are the major changes:

New features

  • Issue #333: Add Header/Footer callbacks in FileRecordWriter
  • Issue #350: Add configurable JobReportFormatter in JobReportEmailSender

Enhancements

  • Issue #315: Replace Java Util Logging with SLF4J
  • Issue #320: Error Threshold - Zero Errors
  • Issue #338: Inefficient JobMetrics merge loops in DefaultJobReportMerger
  • Issue #317: Unused XMLStreamException

Bug fixes

  • Issue #349: Incorrect writeCount when the transaction in HibernateRecordWriter is rolled back
  • Issue #348: Incorrect writeCount when the transaction in JpaRecordWriter is rolled back
  • Issue #347: Incorrect writeCount when the transaction in JdbcRecordWriter is rolled back
  • Issue #314: Error while setting a date (java.util.Date) field in JdbcRecordWriter
  • Issue #345: HtmlJobReportFormatter should not generate apache velocity logs
  • Issue #337: XmlRecordReader throws a ClassCastException when reading a comment line
  • Issue #319: Excel reader Skipping Empty Columns

Deprecations

For removal

  • org.easybatch.xml.XmlWrapperTagWriter is deprecated in v5.3 and will be removed in v6
  • org.easybatch.tools.monitoring.CliJobMonitoringListener, org.easybatch.tools.reporting.HtmlJobReportFormatter andorg.easybatch.tools.reporting.JobReportEmailSender are deprecated in v5.3 and will be removed in v6. The entire easybatch-tools module will be removed
  • Quartz support is deprecated in v5.3 and will be removed in v6. All classes in easybatch-quartz module are deprecated and the entire module will be removed in v6
  • MongoDB support will be removed in v6. Please note that this decision has been made after releasing v5.3, hence you will not find any @Deprecated annotation on classes of this module in the v5.3 release.
  • org.easybatch.jms.JmsPoisonMessage, org.easybatch.jms.JmsPoisonRecord, org.easybatch.jms.JmsPoisonRecordBroadcaster and org.easybatch.jms.JmsPoisonRecordFilter are deprecated in v5.3 and will be removed in v6. The JmsRecordReader will return null based on a timeout and not a JmsPoisonMessage.
  • org.easybatch.core.record.PoisonRecord, org.easybatch.core.listener.PoisonRecordBroadcaster and org.easybatch.core.filter.PoisonRecordFilter are deprecated in v5.3 and will be removed in v6. The org.jeasy.batch.core.reader.BlockingQueueRecordReader will return null based on a timeout and not a PoisonRecord
  • The constructor org.jeasy.batch.core.reader.BlockingQueueRecordReader#BlockingQueueRecordReader(java.util.concurrent.BlockingQueue<org.jeasy.batch.core.record.Record>, int) will be removed in v6. Please note that this constructor was not marked with @Deprecated in v5.3 by mistake.
  • The constructor BlockingQueueRecordWriter(final List<BlockingQueue<Record>> will be removed in v6 as this writer will operate on a single blocking queue.
  • org.easybatch.core.listener.RecordProcessingTimeListener is deprecated in v5.3 and will be removed in v6
  • org.easybatch.core.filter.RecordNumberBetweenFilter, org.easybatch.core.filter.RecordNumberEqualToFilter, org.easybatch.core.filter.RecordNumberGreaterThanFilter and org.easybatch.core.filter.RecordNumberLowerThanFilter are deprecated in v5.3 and will be removed in v6
  • JobReportFormatter and DefaultJobReportFormatter are deprecated in v5.3 and will be removed in v6

With replacement

  • org.easybatch.core.filter.FilteredRecordsSavingRecordFilter is deprecated in v5.3 and will be removed in v6. Use the new org.easybatch.core.filter.FilteredRecordsCollector instead
  • org.easybatch.core.filter.StartWithStringRecordFilter is deprecated in v5.3 and will be removed in v6. Use org.easybatch.core.filter.StartsWithStringRecordFilter instead
  • org.easybatch.core.filter.EmptyRecordFilter is deprecated in v5.3 and will be removed in v6. Use org.easybatch.core.filter.EmptyStringRecordFilter instead
  • org.easybatch.core.filter.EndWithStringRecordFilter is deprecated in v5.3 and will be removed in v6. Use org.easybatch.core.filter.EndsWithStringRecordFilter instead
  • Usages of java.util.date (namely in Header class) are deprecated and will be replaced with java.time.LocalDateTime starting from v6
  • Usages of java.io.File (namely in constrcutors of all file based record readers/writers) are deprecated and will be replaced with java.nio.file.Path starting from v6
  • PayloadExtractor is deprecated in v5.3 and will be removed in v6. Use Utils#extractPayloads instead
  • The constructor org.jeasy.batch.extensions.yaml.YamlRecordReader#YamlRecordReader(java.io.InputStream, java.lang.String) will be replaced with one that takes a java.nio.charset.Charset instead of a String for the charset name. Please note that this constructor was not marked with @Deprecated in v5.3 by mistake.
  • The constructor org.jeasy.batch.json.JsonRecordReader#JsonRecordReader(java.io.InputStream, java.lang.String) will be replaced with one that takes a java.nio.charset.Charset instead of a String for the charset name. Please note that this constructor was not marked with @Deprecated in v5.3 by mistake.

For more details about deprecations and replacements, please refer to the Javadocs.

What's next?

The next version will be v6 and will be based on Java 8. The root package name will be updated from org.easybatch to org.jeasy.batch for consistency with other Jeasy projects. Artifact IDs will also change to match the same naming pattern as other projects.

I would like to thank all contributors (@anarayn, @MALPI , @jcamiloradamesa , @IvanAtanasov, @sheikhu, @vian42, @verdi8 and @psoares-resilient) for submitting bug reports, testing fixes and contributing to the project with awesome PRs!

v5.2.0

18 Nov 15:35
Compare
Choose a tag to compare

This is the second maintenance release of the v5.x line. It brings some features and bug fixes:

Features

  • issue #280 : Invert PipelineListener call order
  • issue #283 : Add OSGi headers to manifest
  • issue #303 : Add FilteredRecordsSavingRecordFilter

Bug fixes

  • issue #291 : XmlRecordReader does not escape gt and lt
  • issue #292 : XmlRecordReader does not call getLocalPart() on QName
  • issue #293 : DefaultJobReportFormatter.formatReport duration rolls over after 24 Hours
  • issue #296 : FilteredCount metric should be renamed to FilterCount

Enhancements

  • issue #301 : Add getters for file and charset in AbstractFileRecordReader
  • issue #304 : otherwise method in content based queue record writer builders should be optional

API deprecation

The following methods are deprecated due to renaming FilteredCount to FilterCount in issue #296:

  • Method org.easybatch.core.job.JobMetrics#getFilteredCount
  • Method org.easybatch.core.job.JobMetrics#incrementFilteredCount
  • Method org.easybatch.core.job.JobMonitor#getFilteredCount
  • Method org.easybatch.core.job.JobMonitorMBean#getFilteredCount

These methods will be removed in v5.3.

I would like to thank @DanieleS82, @ipropper and @tobias-- for their time and effort to make this release happen!

v5.1.0

05 Jun 14:36
Compare
Choose a tag to compare

This is minor release adding some new features and bug fixes. Here are the most important changes:

New features

  • issue #92 : Add email sending job listener
  • issue #121 : Add support for univocity-parsers
  • issue #122 : Add support for Yaml format
  • issue #254 : Add MultiFileRecordReader
  • issue #255 : Add XmlFileRecordReader
  • issue #256 : Add JsonFileRecordReader
  • issue #260 : Add parameter to control how quartz should act when certain job is delayed for a long time
  • issue #269 : Add encoding parameter in XmlRecordReader
  • issue #270 : Add encoding parameter in JsonRecordReader
  • issue #278 : Add the ability to interrupt a running job
  • issue #279 : Add the ability to wait for jobs to terminate

Bug fixes

  • issue #266 : Incorrect data source name in text file records
  • issue #267 : Incorrect data source name in JmsRecord header
  • issue #268 : System properties absent from JobReport
  • issue #276 : PreProcessed records are ignored
  • issue #277 : XmlRecordReader should not escape special characters in tag's body

Enhancements

  • issue #271 : Improve performance of the JdbcRecordReader
  • issue #263 : JsonFileRecordReader should not throw a FileNotFoundException at construction time
  • issue #264 : XmlFileRecordReader should not throw a FileNotFoundException at construction time
  • issue #178 : Improve the QueueRecordWriter builders to guide the user through predicate/queue mapping

Deprecations

  • issue #265 : XmlFileRecordReader constructor parameters should be swapped
  • issue #274 : Deprecate JmsQueueSessionListener
  • issue #275 : Deprecate JmsQueueConnectionListener

Many thanks to all contributors for reporting bugs and testing fixes.
A special thank to @AussieGuy0 for adding support for uniVocity parsers!

v4.2.1

25 Feb 09:59
Compare
Choose a tag to compare

This is a bug fix release for the following issue:

  • issue #237 : MsExcel file not closed by the MsExcelRecordReader

Many thanks to @packley1 for reporting the issue and testing the fix.

v5.0.0

23 Oct 19:51
Compare
Choose a tag to compare

The main theme of this new major release is less is more ❗ With this new version, Easy Batch has never been easier! Many APIs have been simplified and improved for more consistency and ease of use. Some APIs have been removed in order for you to do less work and delegate more to the framework 😄

After one year of active development, version 5.0.0 is finally here. This would not have been possible without the amazing open source community !! Many thanks to all contributors who suggested features, filed bugs and reported inconsistencies. I'm really grateful and thankful to all of you!

Version 5 is not 100% backward compatible with version 4. It introduces fundamental changes in the core framework in order to fix some inconsistent APIs. The processing workflow has been modified to improve performance.

This is the final release of v5.0 after many snapshot versions and 2 release candidates. Please find below the complete change log and a migration guide to help you move from v4 to v5.

Major changes

  • issue #211 : Inconsistent Batch API
  • issue #233 : Inconsistent RecordReader API
  • issue #223 : Inconsistent RecordWriter API
  • issue #227 : Inconsistent RecordDispatcher API
  • issue #221 : Resource management should be handled by the framework
  • issue #222 : Transaction management should be handled by the framework
  • issue #230 : JobExecutor should use an ExecutorService
  • issue #220 : Adapt listeners to batch processing workflow

New features

  • issue #253 : Add MongoDBRecordMarshaller
  • issue #251 : Add support for custom metrics
  • issue #250 : Add java 8 stream support
  • issue #248 : Add onConnectionOpened method in JobMonitoringListener
  • issue #243 : add OpenCsvRecordMarshaller
  • issue #242 : add XmlRecordValidator
  • issue #241 : add option to activate/deactivate recursivity in FileRecordReader
  • issue #224 : Add RetryableRecordReader
  • issue #225 : Add RetryableRecordWriter
  • issue #226 : Add CompositeRecordWriter

Bug fixes

  • issue #247 : onConnectionClosed in JobMonitoringListener is inconsistent
  • issue #238 : FlatFileRecordReader should not throw a FileNotFoundException at construction time
  • issue #170 : Unable to determine number of filtered record from batch
  • issue #204 : Unnecessary generic type in BeanValidationRecordValidator
  • issue #209 : Unnecessary generic type in BlockingQueueRecordReader / BlockingQueueRecordWriter
  • issue #228 : Job executionId is not coherent
  • issue #229 : Job name is not a parameter
  • issue #231 : JobStatus.ABORTED is redundant
  • issue #232 : Possible resource leak in XmlWrapperTagWriter

Enhancements and API changes

  • issue #252 : MongoDBRecordWriter should use bulk writes
  • issue #249 : Update example in maven quick start archetype
  • issue #236 : add constructor with java.nio.file.Path in FileRecordReader
  • issue #239 : add constructor with java.nio.file.Path in FileRecordWriter
  • issue #240 : add constructor with java.nio.file.Path in FlatFileRecordReader
  • issue #244 : ApacheCommonCsvRecord is redundant
  • issue #245 : ApacheCommonCsvRecordReader is redundant
  • issue #246 : ApacheCommonCsvRecordMapper should be configurable with field names
  • issue #234 : RecordFieldExtractor is poorly named
  • issue #235 : BeanRecordFieldExtractor is poorly named

Migration guide

JobBuilder

Methods deprecated in v4.2 have been removed in v5:

  • JobBuilder#skip(long)
  • JobBuilder#limit(long)
  • JobBuilder#timeout(long) and JobBuilder#timeout(long, TimeUnit)
  • JobBuilder#silentMode(boolean)
  • JobBuilder#strictMode(boolean)
  • JobBuilder#jmxMode(boolean)
  • JobBuilder#call()

The keepAlive parameter has been removed since resource handling is now done by the framework ( issue #221 ). Hence the following methods have been removed from JobBuilder:

  • JobBuilder#reader(RecordReader recordReader, boolean keepAlive)
  • JobBuilder#reader(RecordReader recordReader, boolean keepAlive, RetryPolicy retryPolicy)

The "Retry Read" feature is now done with a decorator of RecordReader (issue #224 ). Hence the method JobBuilder#reader(RecordReader recordReader, RetryPolicy retryPolicy) has been removed

The RecordDispatcher API has been removed. Hence, the method JobBuilder#dispatcher(RecordDispatcher recordDispatcher) has been removed

JobExecutor

  • The method org.easybatch.core.job.JobExecutor.execute is no more static, you need to create a JobExecutor instance to execute jobs
  • Job executors must be shutdown explicitly

Resource handling & transaction management

  • The constructors of JdbcRecordReader/JdbcRecordWriter now take a JDBC DataSource as argument instead of a Connection and the JdbcConnectionListener/JdbcTransactionListener have been removed
  • The constructors of JpaRecordReader/JpaRecordWriter now take a EntityManagerFactory as argument instead of a EntityManager and the JpaEntityManagerListener/JpaTransactionListener have been removed
  • The constructors of HibernateRecordReader/HibernateRecordWriter now take a SessionFactory as argument instead of a Session and the HibernateSessionListener/HibernateTransactionListener have been removed

Moved APIs

  • org.easybatch.core.dispatcher.Predicate has moved to org.easybatch.core.writer.Predicate
  • org.easybatch.core.dispatcher.DefaultPredicate has moved to org.easybatch.core.writer.DefaultPredicate
  • org.easybatch.core.dispatcher.PoisonRecordBroadcaster has moved to org.easybatch.core.listener.PoisonRecordBroadcaster

Removed APIs

The Batch class is no more a Record. Instead, it now contains a list of records. Hence, all interfaces and implementations related to the previous inconsistent Batch API have been removed: BatchReader, BatchFilter, BatchMapper, BatchProcessor, BatchMarshaller, BatchValidator and BatchWriter.

The "record dispatcher" concept has been removed. All dispatchers have been transformed into writers:

  • BroadcastRecordDispatcher -> BlockingQueueRecordWriter
  • ContentBasedRecordDispatcher -> ContentBasedBlockingQueueRecordWriter
  • ContentBasedRecordDispatcherBuilder -> ContentBasedBlockingQueueRecordWriterBuilder
  • RoundRobinRecordDispatcher -> RoundRobinBlockingQueueRecordWriter
  • RandomRecordDispatcher -> RandomBlockingQueueRecordWriter
  • BroadcastJmsRecordDispatcher -> BroadcastJmsQueueRecordWriter
  • ContentBasedJmsRecordDispatcher -> ContentBasedJmsQueueRecordWriter
  • ContentBasedJmsRecordDispatcherBuilder -> ContentBasedJmsQueueRecordWriterBuilder
  • RandomJmsRecordDispatcher -> RandomJmsQueueRecordWriter
  • RoundRobinJmsRecordDispatcher -> RoundRobinJmsQueueRecordWriter

Exception handling have been simplified, the following exceptions have been removed:

  • org.easybatch.core.reader.RecordReaderOpeningException
  • org.easybatch.core.reader.RecordReaderClosingException
  • org.easybatch.core.reader.RecordReadingException
  • org.easybatch.core.processor.RecordProcessingException
  • org.easybatch.core.dispatcher.RecordDispatchingException
  • org.easybatch.core.field.RecordFieldExtractionException
  • org.easybatch.core.mapper.RecordMappingException
  • org.easybatch.core.marshaller.RecordMarshallingException
  • org.easybatch.core.validator.RecordValidationException
  • org.easybatch.core.writer.RecordWritingException

ApacheCommonCsvRecord was removed. This is redundant with StringRecord.
ApacheCommonCsvRecordReader was removed. This is redundant with FlatFileRecordReader.

Other changes

  • org.easybatch.core.processor.ComputationalRecordProcessor deprecated in v4.2 has been removed
  • JobResult deprecated in v4.2 has been removed from JobReport, this is related to the removal of ComputationalRecordProcessor
  • All constructors in XmlWrapperTagWriter now take a File instead of FileWriter, this is due to a resource leak
  • BeanValidationRecordValidator is no more parametrized type
  • Predicate is no more a parametrized type
  • BlockingQueueRecordReader is no more a parametrized type
  • BlockingQueueRecordWriter is no more a parametrized type
  • RecordFieldExtractor interface has been renamed to FieldExtractor
  • BeanRecordFieldExtractor class has been renamed to BeanFieldExtractor