Refactor core to converge Qualification and Profiling Tools implementation

[amahussein]

Describe the bug

Currently, both Qualification and Profiling tools have different data structure and different reporting output.
This issue is to track the refactor process to make both implementation common.

This is an important step toward adding heuristics as a postProcess phase to analysing the eventlogs
There are many benefits of doing so:

• We won't need to run both tools to feed the estimation_model. The input to the estimation_model should be common between the two tools.
• Better code maintainability. Fixing or adding a feature/improvement will be done once instead of twice.
• Code reusability

Tasks

Preview Give feedback

1. Refactor Stage info code between Q/P tools #971
   bug core_tools +2
   
2. Refactor AppBase to use common AppMetaData between Q/P tools #983
   core_tools feature request +2
   
3. Fix handling of clusterTags and SparkVersion in Q/P Tools #991
   bug core_tools +2
   
4. Refactor TaskEnd to be accessible by Q/P tools #1000
   core_tools +1
   
5. [BUG] Fix potential problems and AQE updates in Qual tool #1019
   bug core_tools +2
   
6. [FEA] Split JobStageAggTaskMetrics file into two different files #1017
   2 of 2
   core_tools feature request +2
   
7. [FEA] Generate all CSVs from Profiler in Qualification #1041
   core_tools feature request +2
   

[parthosa]

This is great. This refactoring was much needed to improve the maintainence.