Only test dimensions that are changed #48
Labels
Enhancement
New feature or request
Performance
Making Spectacles faster or more efficient
Validator: SQL
Now that we have the ability to parse LookML in Python with
lkml
, we have the ability to compare the differences in the parsed tree and only run Spectacles against those modified dimensions.I'm imagining running
git diff --name-only $TARGET_BRANCH
to determine which files were changed (it doesn't look like Circle has a target branch environment variable in its context but it is a highly requested issue).For each changed file, we would parse the LookML on the source and target branches and compare the resulting trees to understand which dimensions were changed.
Last, we would need a way to pass specific dimensions to Spectacles via the model selector (might require changes to requirements in #21). Fonz then would query only the modified dimensions.
This could also interact with caching in #22. You might want to run the unchanged dimensions using the cached queries instead of rebuilding them.
The text was updated successfully, but these errors were encountered: