Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade FBOS dependencies to 2024.09.16.00 #11018

Closed
wants to merge 1 commit into from

Conversation

czentgr
Copy link
Collaborator

@czentgr czentgr commented Sep 17, 2024

folly brings in a new dependency on fast_float. After discussions with @majetideepak I added it as installable for all platforms and made it bundleable to by used by folly if it is bundled.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 17, 2024
Copy link

netlify bot commented Sep 17, 2024

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit 62261c0
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/66ec7aed6420b90007de470e

@czentgr czentgr force-pushed the cz_upgrade_fbos branch 5 times, most recently from e8a868a to ea38319 Compare September 17, 2024 22:35
@czentgr czentgr marked this pull request as ready for review September 18, 2024 02:43
@czentgr
Copy link
Collaborator Author

czentgr commented Sep 18, 2024

@majetideepak @assignUser FYI

@@ -32,11 +32,12 @@ by Velox. See details on bundling below.
| re2 | 2021-04-01 | Yes |
| fmt | 10.1.1 | Yes |
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I thought this folly version also uses fmt11? Or is it backwards compatible?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is backwards compatible. I had originally planned to also upgrade fmt to 11 but there is another PR that needs to be merged first that prepares the code for fmt 11.
Upgrading fmt is next.

Copy link
Collaborator

@majetideepak majetideepak Sep 18, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is backward compatible since Meta internally is still on fmt9 but on latest folly.

Copy link
Collaborator

@majetideepak majetideepak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@czentgr two comments.
Can we also wait until the setup script improvement PR lands as this would conflict with that?

set(VELOX_FOLLY_SOURCE_URL
"https://github.com/facebook/folly/releases/download/${VELOX_FOLLY_BUILD_VERSION}/folly-${VELOX_FOLLY_BUILD_VERSION}.tar.gz"
)

set(fast_float_SOURCE AUTO)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this required? AUTO is the default?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We have to set a source. I was wavering between AUTO or BUNDLED. Given this is only called if Folly is bundled and otherwise was already built with a SYSTEM install of fast_float either one would work. We can set it to BUNDLED to match the way Folly would use this to match it.

@majetideepak
Copy link
Collaborator

@czentgr can you please confirm if you were able to build Velox locally with this change? Unfortunately, CI does not use the latest images to test and we often see build failures after merge when dependencies are updated.

@czentgr
Copy link
Collaborator Author

czentgr commented Sep 20, 2024

@majetideepak I've tested the following:
Ubuntu: BUNDLED build with gcc11, clang15
Centos9: full new dependency install (with the new INSTALL_PREFIX) with gcc12 TBD
MacOS: BUNDLED build

@majetideepak majetideepak added the ready-to-merge PR that have been reviewed and are ready for merging. PRs with this tag notify the Velox Meta oncall label Sep 20, 2024
@facebook-github-bot
Copy link
Contributor

@Yuhta has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@Yuhta merged this pull request in 6d1fbf0.

set(VELOX_FAST_FLOAT_BUILD_SHA256_CHECKSUM
4458aae4b0eb55717968edda42987cabf5f7fc737aee8fede87a70035dba9ab0)
set(VELOX_FAST_FLOAT_SOURCE_URL
"https://github.com/fastfloat/fast_float/archive/v${VELOX_FAST_FLOAT_VERSION}.tar.gz"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if this URL path is broken. I think we expect https://github.com/fastfloat/fast_float/archive/refs/tags/v${VELOX_FAST_FLOAT_VERSION}.tar.gz

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This URL works for me. I can navigate in the browser and download it (https://github.com/fastfloat/fast_float/archive/v6.1.6.tar.gz) This is used when you bundle folly. Other than that it should not come up.

majetideepak added a commit to majetideepak/velox that referenced this pull request Sep 24, 2024
facebook-github-bot pushed a commit that referenced this pull request Sep 25, 2024
Summary:
#11018 added install_fast_float, but didn't specify the version by default. The setup failed to download the package with the "tar: Error opening archive: Unrecognized archive format" error. Also the fast_float.cmake introduced by this PR had the wrong VELOX_FAST_FLOAT_SOURCE_URL. It is missing "refs/tags/".

This PR fixes these two problems.

Fixes #11055

Pull Request resolved: #11056

Reviewed By: DanielHunte

Differential Revision: D63344271

Pulled By: Yuhta

fbshipit-source-id: 6887b0dce4e5bc38f56949275e14d6135dc07c0b
majetideepak added a commit to majetideepak/velox that referenced this pull request Sep 26, 2024
facebook-github-bot pushed a commit that referenced this pull request Sep 27, 2024
Summary:
This reverts commit 6d1fbf0.

I validated locally that reverting this commit fixes the velox_functions_remote_client_test failure.
Resolves #11071

Pull Request resolved: #11079

Reviewed By: kgpai

Differential Revision: D63323399

Pulled By: pedroerp

fbshipit-source-id: a239066f542e3b4867add87a5418c81b7fd3020f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Merged ready-to-merge PR that have been reviewed and are ready for merging. PRs with this tag notify the Velox Meta oncall
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants