Reduce Processing by Checking File Modified Stamps

[boyter]

With the removal of the deltas updates to the index now need to process the whole of the file repository.

This should hook into the last index time and check the last modified date so that this can be faster. For reindex it needs to determine if the index is in reindex state and if so skip this check.

[boyter]

Currently sitting in master.