Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP-test run] switch rustc allocator to mimalloc #64495

Closed
wants to merge 10 commits into from

Conversation

gnzlbg
Copy link
Contributor

@gnzlbg gnzlbg commented Sep 15, 2019

Follow up to #62340 . Disables secure mode.

r? @mati865

@gnzlbg
Copy link
Contributor Author

gnzlbg commented Sep 15, 2019

@bors: try

@bors
Copy link
Contributor

bors commented Sep 15, 2019

@gnzlbg: 🔑 Insufficient privileges: not in try users

@jonas-schievink
Copy link
Contributor

@bors try

@bors
Copy link
Contributor

bors commented Sep 15, 2019

⌛ Trying commit 111e3f8 with merge 606331a2236eca07e80368668ab5c7b97d68c300...

@rust-highfive
Copy link
Collaborator

The job dist-x86_64-linux-alt of your PR failed (pretty log, raw log). Through arcane magic we have determined that the following fragments from the build log may contain information about the problem.

Click to expand the log.
2019-09-15T21:20:02.8063355Z [RUSTC-TIMING] syntax test:false 197.888
2019-09-15T21:20:02.8115275Z    Compiling syntax_ext v0.0.0 (/checkout/src/libsyntax_ext)
2019-09-15T21:21:08.8090337Z [RUSTC-TIMING] syntax_ext test:false 65.990
2019-09-15T21:24:31.2577457Z [RUSTC-TIMING] rustc_metadata test:false 202.439
2019-09-15T21:24:31.2585661Z rustc exited with signal: 11
2019-09-15T21:24:31.2646057Z 
2019-09-15T21:24:31.2646198Z Caused by:
2019-09-15T21:24:31.2646198Z Caused by:
2019-09-15T21:24:31.2650598Z   process didn't exit successfully: `/checkout/obj/build/bootstrap/debug/rustc --edition=2018 --crate-name rustc_metadata src/librustc_metadata/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=2 -C metadata=1871e670c6bf602e -C extra-filename=-1871e670c6bf602e --out-dir /checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps --target x86_64-unknown-linux-gnu -C linker=clang -L dependency=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps -L dependency=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/release/deps --extern flate2=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libflate2-20b4ea37d0c319b7.rmeta --extern log=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/liblog-7d30fee93959a313.rmeta --extern memmap=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libmemmap-cc50ef514879b804.rmeta --extern rustc=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc-c30ab14709d76449.rmeta --extern rustc_data_structures=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_data_structures-3f6d4dd69650f82a.rmeta --extern errors=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_errors-c4376321d056a9f3.rmeta --extern rustc_target=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_target-f777fd79ce8dc827.rmeta --extern rustc_serialize=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libserialize-a88822e055a29a0c.rmeta --extern smallvec=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libsmallvec-dc451869d2f1f439.rmeta --extern stable_deref_trait=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libstable_deref_trait-a5ad40346bb693b0.rmeta --extern syntax=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libsyntax-a6d554599a98ba05.rmeta --extern syntax_pos=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libsyntax_pos-170bbab53a26865c.rmeta -Zbinary-dep-depinfo -L native=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/build/miniz-sys-4835a9e199480a83/out -L native=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/build/backtrace-sys-df51674e277b31e0/out` (exit code: 254)
2019-09-15T21:24:31.2652266Z warning: build failed, waiting for other jobs to finish...
2019-09-15T21:27:09.3440987Z mimalloc: warning: possibly trying to mi_free a pointer that does not point to a valid heap region: 0x0x40040000100
2019-09-15T21:27:09.3499463Z (this may still be a valid very large allocation (over 64MiB))
2019-09-15T21:27:09.3499642Z mimalloc: warning: (yes, the previous pointer 0x0x40040000100 was valid after all)
2019-09-15T21:27:09.3531688Z mimalloc: warning: possibly trying to mi_free a pointer that does not point to a valid heap region: 0x0x40074400100
2019-09-15T21:27:09.3536360Z (this may still be a valid very large allocation (over 64MiB))
2019-09-15T21:27:09.3540136Z mimalloc: warning: (yes, the previous pointer 0x0x40074400100 was valid after all)
2019-09-15T21:30:52.7172375Z [RUSTC-TIMING] rustc test:false 828.046
2019-09-15T21:30:52.7175436Z rustc exited with signal: 11
2019-09-15T21:30:52.7236247Z 
2019-09-15T21:30:52.7236563Z Caused by:
2019-09-15T21:30:52.7236563Z Caused by:
2019-09-15T21:30:52.7244351Z   process didn't exit successfully: `/checkout/obj/build/bootstrap/debug/rustc --edition=2018 --crate-name rustc src/librustc/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts --crate-type lib --emit=dep-info,metadata,link -C opt-level=2 -C metadata=c30ab14709d76449 -C extra-filename=-c30ab14709d76449 --out-dir /checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps --target x86_64-unknown-linux-gnu -C linker=clang -L dependency=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps -L dependency=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/release/deps --extern arena=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libarena-ffaf86ba0494a30c.rmeta --extern backtrace=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libbacktrace-0eac1d641ff70fde.rmeta --extern bitflags=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libbitflags-c3e1c55170f70055.rmeta --extern byteorder=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libbyteorder-f88c043fc81e7944.rmeta --extern chalk_engine=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libchalk_engine-96afa60e729445d9.rmeta --extern fmt_macros=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libfmt_macros-46e9fead9dc7ed92.rmeta --extern graphviz=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libgraphviz-27db30bc89a3257b.rmeta --extern jobserver=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libjobserver-4ffa71027faff696.rmeta --extern log=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/liblog-7d30fee93959a313.rmeta --extern measureme=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libmeasureme-6358b849a0d95466.rmeta --extern num_cpus=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libnum_cpus-8bb2906494905559.rmeta --extern parking_lot=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libparking_lot-34abf3fd87af206a.rmeta --extern polonius_engine=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libpolonius_engine-f86154674c9d6126.rmeta --extern rustc_rayon=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_rayon-a3d75375d91a8718.rmeta --extern rustc_rayon_core=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_rayon_core-090a463cc3802f1d.rmeta --extern rustc_apfloat=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_apfloat-82cc162e02d60d39.rmeta --extern rustc_data_structures=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_data_structures-3f6d4dd69650f82a.rmeta --extern errors=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_errors-c4376321d056a9f3.rmeta --extern rustc_fs_util=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_fs_util-ea1a89a73a513a23.rmeta --extern rustc_macros=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/release/deps/librustc_macros-8bb550df14400ebd.so --extern rustc_target=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/librustc_target-f777fd79ce8dc827.rmeta --extern scoped_tls=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libscoped_tls-755e4b2b6453848d.rmeta --extern rustc_serialize=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libserialize-a88822e055a29a0c.rmeta --extern smallvec=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libsmallvec-dc451869d2f1f439.rmeta --extern syntax=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libsyntax-a6d554599a98ba05.rmeta --extern syntax_pos=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/deps/libsyntax_pos-170bbab53a26865c.rmeta -Zbinary-dep-depinfo --cfg always_verify_llvm_ir -L native=/checkout/obj/build/x86_64-unknown-linux-gnu/stage1-rustc/x86_64-unknown-linux-gnu/release/build/backtrace-sys-df51674e277b31e0/out` (exit code: 254)
2019-09-15T21:30:52.7287647Z command did not execute successfully: "/checkout/obj/build/x86_64-unknown-linux-gnu/stage0/bin/cargo" "build" "--target" "x86_64-unknown-linux-gnu" "-Zbinary-dep-depinfo" "-j" "2" "--release" "--locked" "--color" "always" "--features" "jemalloc" "--manifest-path" "/checkout/src/rustc/Cargo.toml" "--message-format" "json-render-diagnostics"
2019-09-15T21:30:52.7299184Z failed to run: /checkout/obj/build/bootstrap/debug/bootstrap dist --host x86_64-unknown-linux-gnu --target x86_64-unknown-linux-gnu
2019-09-15T21:30:52.7301304Z Build completed unsuccessfully in 1:24:52
2019-09-15T21:30:52.7358971Z == clock drift check ==
2019-09-15T21:30:52.7376999Z   local time: Sun Sep 15 21:30:52 UTC 2019
2019-09-15T21:30:52.7376999Z   local time: Sun Sep 15 21:30:52 UTC 2019
2019-09-15T21:30:53.0501132Z   network time: Sun, 15 Sep 2019 21:30:53 GMT
2019-09-15T21:30:53.0502088Z == end clock drift check ==
2019-09-15T21:30:55.7137498Z ##[error]Bash exited with code '1'.
2019-09-15T21:30:55.7176936Z ##[section]Starting: Upload CPU usage statistics
2019-09-15T21:30:55.7186497Z ==============================================================================
2019-09-15T21:30:55.7186609Z Task         : Bash
2019-09-15T21:30:55.7186706Z Description  : Run a Bash script on macOS, Linux, or Windows

I'm a bot! I can only do what humans tell me to, so if this was not helpful or you have suggestions for improvements, please ping or otherwise contact @TimNN. (Feature Requests)

@bors
Copy link
Contributor

bors commented Sep 15, 2019

💔 Test failed - checks-azure

@bors bors added the S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author. label Sep 15, 2019
@gnzlbg
Copy link
Contributor Author

gnzlbg commented Sep 18, 2019

The mimalloc maintainers were finally able to reproduce our segfaults, so i'm closing this again since no progress can happen here until those issues are resolved.

@Mark-Simulacrum there is currently a big barrier of entry to debug rustc issues. I think it would be worth documenting how to run rustc build locally in the exact same way that CI does (e.g. using docker as @mati865 explains microsoft/mimalloc#77 ). Also, when running a test fails, there is no easy way to debug it in the same conditions that CI has, and e.g., just launch gdb/lldb/valgrind/etc. on the test. One currently gets the CLI invocation for the command that fails, but this does not includes all the environment variables required to run that command correctly, see this comment: microsoft/mimalloc#77 (comment)

@gnzlbg gnzlbg closed this Sep 18, 2019
@nico-abram
Copy link
Contributor

Now that daanx figured out what was happening in microsoft/mimalloc#77 (comment) , is it worth retrying?

@jq-rs
Copy link

jq-rs commented Feb 5, 2021

I think it is. A new test run has been opened in #81782

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-waiting-on-author Status: This is awaiting some action (such as code changes or more information) from the author.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants