Drop support for Swift 5.4
This patch was authored and released by @gwynne.
Also incudes a round of CI modernizations.
There are no API or functional changes in this version, but the minimum Swift version bump nonetheless requires this to be a semver-minor release.