[Meta] Index Patterns Roadmap

[lizozom]

Summary

A lot has been said an written about IndexPatterns. A great summary of pain points and potential solutions can be found here.

The scope of this issue, is building a road map for:

1. Cleaning up and fixing some problems with the existing service.
2. Adding the necessary support for alerting purposes
3. Keeping Data Streams in mind.
4. Develop a longer term roadmap.
   • Priorities

Server Side IndexPatterns

Creating server side alerts, based on visualizations, requires being able to run their underlying expressions on the server side. In that process, there are some IndexPattern dependencies involved, specifically:

• access to fields
• formatting values for alerts (probably 2nd stage)

Clean up tasks

These task should be preferably done before building a new service, to make sure we re-implement the correct APIs.

• Delete unused methods
• Make things private
• IndexPattern, IndexPatternAttributes and IIndexPattern consistency - IndexPattern shouldn't be exported from data plugin 🙏
  • IFieldList vs. IFieldType[] mismatch
• Improve IFieldType

New Common Service

• Create a common and minimal IndexPattern implementation.
• Create a common indexPatterns service and use it from the public service
• Expose the new service to the server side

Improvements

• Improve missing index warnings

[elasticmachine]

Pinging @elastic/kibana-app-arch (Team:AppArch)

[mattkime]

closing in favor of #67574 - but please let me know if anything has been overlooked.