Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[10.x] Switch to UUID v7 #44210

Merged
merged 3 commits into from
Sep 20, 2022
Merged

[10.x] Switch to UUID v7 #44210

merged 3 commits into from
Sep 20, 2022

Conversation

driesvints
Copy link
Member

@driesvints driesvints commented Sep 19, 2022

This will switch the default generated UUID's from v4 to v7 for Laravel v10. Since these are now sortable by default, orderedUuid has become an alias of uuid.

@driesvints driesvints changed the title Switch to UUID v7 [10.x] Switch to UUID v7 Sep 19, 2022
@DarkGhostHunter
Copy link
Contributor

DarkGhostHunter commented Sep 19, 2022

I think that Illuminate\Database\Eloquent\Concerns\HasUuid should call uuid() instead of orderedUuid() then.

@driesvints
Copy link
Member Author

@DarkGhostHunter done, thanks.

@taylorotwell taylorotwell merged commit 8ec8c81 into master Sep 20, 2022
@taylorotwell taylorotwell deleted the uuid-v7-support branch September 20, 2022 13:20
@DarkGhostHunter
Copy link
Contributor

@DarkGhostHunter done, thanks.

👌

@tillkruss
Copy link
Contributor

@driesvints Should Str::uuid() stay version 4 (fully random) and Str::orderedUuid() switch to v7 (timestamp + random).

Otherwise all Str::uuid() will reveal the timestamp it was created at?

@driesvints
Copy link
Member Author

Why would that be bad?

@DarkGhostHunter
Copy link
Contributor

DarkGhostHunter commented Sep 23, 2022 via email

@tillkruss
Copy link
Contributor

Why would that be bad?

It exposes data involuntary, just how incrementing integers expose how many database records (likely) exist, the UUID v6 as a default would expose the timestamp a record was created.

That's fine if we're talking about the ordered UUID for database records, since it's expected.

However when generating a UUID, I'd expect it to be fully random data.

@driesvints
Copy link
Member Author

@tillkruss are you sure that's also the case with uuid v7? I'm also not sure what UUID v6 has to do here, we're not using that one.

@rodrigopedra
Copy link
Contributor

rodrigopedra commented Sep 24, 2022

@driesvints I guess so:

UUID v4:

Version 4 UUIDs are perhaps the most popular form of UUID. They are randomly-generated and do not contain any information about the time they are created or the machine that generated them.

reference: https://uuid.ramsey.dev/en/stable/rfc4122/version4.html

UUID v7:

Version 7 UUIDs combine random data (like version 4 UUIDs) with a timestamp (in milliseconds since the Unix Epoch, i.e., 1970-01-01 00:00:00 UTC) to create a monotonically increasing, sortable UUID that doesn’t have any privacy concerns, since it doesn’t include a MAC address.

reference: https://uuid.ramsey.dev/en/stable/rfc4122/version7.html

Although UUID v7 does not include any machine information, by being monotonic one can infer the order records were created, and probably the time it was created as the specification is based on Unix Epoch.

P.S. I believe @tillkruss reference to UUID v6 was a typo, and his meant v7. But only him can confirm that,

@tillkruss
Copy link
Contributor

Yeah, sorry it was a typo, I meant v7.

@driesvints
Copy link
Member Author

I think I'm a bit indifferent. I personally don't see the issue but maybe @taylorotwell has a different opinion.

@tillkruss
Copy link
Contributor

I think I'm a bit indifferent.

Understandably, I opened a PR.

Copy link

@SignetPlanet SignetPlanet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure of the discussion but we use UUID v4 for tables with few writes but where the UUID needs to reveal as little information as possible. We use v7 for temporary tables or tables with high writes. Keeping v4 is good as it is still the recommended non-ordered UUID.

An important thing overlooked is sessions still use a 40 character string so they suffer from all the index performance issues that non-ordered uuids do plus they are stored in text fields creating indexes that are well over double the size and seriously underperforming. May want to have an option to have session IDs also be UUIDv7 as well and then it makes our sessions compatible with most load distributed systems.

@driesvints
Copy link
Member Author

Hey @SignetPlanet. The former was resolved with #44311. For the latter you can always attempt a PR 👍

@dinandmentink
Copy link

dinandmentink commented Jan 6, 2023

I just noted the following:

Laravel v9's Str::orderedUuid() currently produces uuid v4 id's that, when sorted, would come after Laravel v10's Str::orderedUuid() based on uuid v7.

Example (at time of writing, obviously):

"v4 ordered: ". Str::orderedUuid() . " v7: " . Ramsey\Uuid\Uuid::uuid7()
"v4 ordered: 982878fe-158f-4b5c-9851-4b4ca5a4b8cb v7: 01858654-75f9-7316-b982-2e43994ec53d"

image

Note how the v4 ordered would come AFTER the v7 uuid.

Would this be an issue for the HasUuid trait after upgrading to v10? This would mean that primary keys would not be sorted correctly based on time of generation?

Maybe this was already thought of, but I noticed this in the middle of migrating my database to uuids and figured I would make sure this was flagged as I don't see it in the code or docs.

@driesvints
Copy link
Member Author

Not sure. HasUuids uses v7 right now: #44311

@dinandmentink
Copy link

Yes. I have seen #44311. I'm referring to this issue including the the followup branch.

This is an upgrade issue I currently see when going from laravel v9 to laravel v10.

Given some model User using HasUuid.

  1. User uses laravel v9 ordered uuids, based on uuid v4. (example: 982878fe-158f-4b5c-9851-4b4ca5a4b8cb)
  2. Upgrade to laravel v10.
  3. User will now receive v7 uuids (example: 01858654-75f9-7316-b982-2e43994ec53d)
  4. Because v7 uuids use 0 padding for the most relevant bits HasUuid will now generate ids that will come BEFORE laravel v9's HasUuid.

I hope I'm making sense and getting this across, I do think there is an issue.

@driesvints
Copy link
Member Author

@tillkruss do you have thoughts on the above? I guess for new apps it makes sense to use UUID v7? Should old apps overwrite to use the old UUID v4? Or should we completely revert all this?

@driesvints
Copy link
Member Author

Hey all. We reverted all of the UUID v7 changes. Going forward, Laravel will keep using UUID v4 as a default and let users use UUID v7 manually if they like.

@SignetPlanet
Copy link

SignetPlanet commented Jan 6, 2023 via email

@driesvints
Copy link
Member Author

We're not planning on a config option at this time. You can use Ramsey uuid or symfony one directly. You can overwrite the methods on HasUuids trait.

@SignetPlanet
Copy link

SignetPlanet commented Jan 6, 2023 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants