Support for statistic events handler for Import CSV job state and report

[bahaaldine]

I've honestly not checked in the code if this exists, so if it does, please close this issue.

Just bringing an idea that I've implement in an import data plugin: would be great to persist some of the fundamental statistics related to the import job.

This is how I've done that:

• I've simply used a stat events handler listening for stat events when the plugins is loaded:

https://github.com/elastic/kibastash/blob/master/index.js#L62

• I'm emitting the stats when needed here:

https://github.com/elastic/kibastash/blob/master/server/lib/update_job_remaining_line.js#L15

• Persisting the event here:

https://github.com/elastic/kibastash/blob/master/server/lib/handle_stats_event.js

So I'm able to keep an an history if the users want it, and render standard related kibana reports.

On the client side, I'm using susie (https://github.com/mtharrison/susie) :

https://github.com/elastic/kibastash/blob/master/server/routes/api.js#L26

to emit the event to the browser:

https://github.com/elastic/kibastash/blob/master/server/routes/api.js#L106

So the browser can render a progress bar.

[Bargs]

We take a similar approach now. The import request gets a chunked response that returns indexing results as they become available (see #6844 for more info on that). I just haven't taken advantage of it on the UI side yet.

Someday I'd like to add support for Server Sent Events if IE ever adds support.

[epixa]

I'm going to close this since CSV upload was pulled. We can always refer back to this issue if/when we revisit the feature.