Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[outerloop] System.Runtime.Tests crash with exit code 137 in linux debug coreclr #98964

Open
carlossanlop opened this issue Feb 27, 2024 · 5 comments
Open

[outerloop] System.Runtime.Tests crash with exit code 137 in linux debug coreclr #98964

carlossanlop opened this issue Feb 27, 2024 · 5 comments
Labels
arch-x64 area-System.Runtime blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro) os-linux-musl Linux distributions using musl library. runtime-coreclr specific to the CoreCLR runtime
Milestone
Future

Comments

@carlossanlop
Copy link
Member

carlossanlop commented Feb 27, 2024 •
edited by build-analysis bot
Loading

Found in a PR that fixed an unrelated failure affecting all outerloop runs, hiding other failures. #97135

Error Blob

{
  "ErrorMessage": "",
  "BuildRetry": false,
  "ErrorPattern": "Killed.+System\\.Runtime\\.Tests\\.runtimeconfig\\.json.+OuterLoop",
  "ExcludeConsoleLog": false
}

Reproduction Steps

========================== End custom configuration settings ===============================
----- start Mon Feb 26 23:56:03 UTC 2024 =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
  Discovering: System.Runtime.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Runtime.Tests (found 29 of 9308 test cases)
  Starting:    System.Runtime.Tests (parallel test collections = on [2 threads], stop on fail = off)
./RunTests.sh: line 180:    21 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing $RSP_FILE
/root/helix/work/workitem/e
----- end Mon Feb 26 23:56:28 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill.
ulimit -c value: unlimited
cat /proc/sys/kernel/core_pattern: /home/helixbot/dotnetbuild/dumps/core.%u.%p
cat /proc/sys/kernel/core_uses_pid: 1
cat: /proc/sys/kernel/coredump_filter: No such file or directory
cat /proc/sys/kernel/coredump_filter:
Looking around for any Linux dumps...
Looking for files matching core.* ...
----- start =============== XUnitLogChecker Output =====================================================
dmesg: klogctl: Operation not permitted
No dumps found in /home/helixbot/dotnetbuild/dumps.
----- end =============== XUnitLogChecker Output - exit code 0 ===========================
+ export '_commandExitCode=137'
+ python /root/helix/work/correlation/reporter/run.py https://dev.azure.com/dnceng-public/ public 13931354 eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsIng1dCI6Im9PdmN6NU1fN3AtSGpJS2xGWHo5M3VfVjBabyJ9.eyJuYW1laWQiOiJjNzczZjJjMi01MTIwLTQyMDctYWZlMi1hZmFmMzVhOGJjMGEiLCJzY3AiOiJhcHBfdG9rZW4iLCJhdWkiOiJhMTBlYjk0MS0xNzM2LTRjNzYtOWFiZC1iZDBlZGYxNjg0ODgiLCJzaWQiOiIxZTViN2VlMC1iNmQyLTQzNjgtODZjOS0zOTQ5MGIxM2FlODAiLCJCdWlsZElkIjoiY2JiMTgyNjEtYzQ4Zi00YWJiLTg2NTEtOGNkY2I1NDc0NjQ5OzU4MDE5NSIsImpvYnJlZiI6IjMxNTZhMmQwLTExYWItNGExMC04NTA0LWY3Y2UxM2ZiMTk2OTo1OTJlZWQ4OS03OGY1LTUyMDItOWRhNS1hZDE3ZGYzYmVmNGEiLCJwcGlkIjoidnN0ZnM6Ly8vQnVpbGQvQnVpbGQvNTgwMTk1Iiwib3JjaGlkIjoiMzE1NmEyZDAtMTFhYi00YTEwLTg1MDQtZjdjZTEzZmIxOTY5LmJ1aWxkLmJ1aWxkX2xpbnV4X211c2xfeDY0X2RlYnVnX2NvcmVjbHJfZGVidWcuX19kZWZhdWx0IiwicmVwb0lkcyI6IiIsImlzcyI6ImFwcC52c3Rva2VuLnZpc3VhbHN0dWRpby5jb20iLCJhdWQiOiJhcHAudnN0b2tlbi52aXN1YWxzdHVkaW8uY29tfHZzbzo2ZmNjOTJlNS03M2E3LTRmODgtOGQxMy1kOTA0NWI0NWZiMjciLCJuYmYiOjE3MDg5ODg5MzgsImV4cCI6MTcwOTAwMDkzOH0.rjlcWYrlHLfuHwUtUIiDkhhUDwy8cnQZ3rCBJjmd8FuCN0BDFzjz0jEMQEbQ9WZ7LHqdWN40vrD1MHH2p9a2tC9JYY7ca4b2w8Yy05wlbG-_cjF_ksT3jfhgz4EOLBiSmE7-bW_m1b3gtKHo-rdFDyMt_vciLiIB_C3543QhcPGJJdph5ok1SjBVKbl1q9wzw4Tut1lLyo8-ToLRotVPvv2Fahz3TSp--EDbdhY2SYtNrPyGVW7t9F8o3TZdG5iyrtyTnCAlr2Qdu-cOUJhyXM_4vhztXvLdgDMuDgGINPpA7sDXoqo_7LB9RP1iNc35uIEM-430j7jeG9MDrZzEZQ
2024-02-26T23:56:35.053Z	INFO   	run.py	run(48)	main	Beginning reading of test results.
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/e' for test results files
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/uploads' for test results files
2024-02-26T23:56:35.062Z	WARNING	run.py	__init__(55)	read_results	No results file found in any of the following formats: xunit, junit, trx
2024-02-26T23:56:35.063Z	INFO   	run.py	packing_test_reporter(30)	report_results	Packing 0 test reports to '/root/helix/work/workitem/e/__test_report.json'
2024-02-26T23:56:35.067Z	INFO   	run.py	packing_test_reporter(33)	report_results	Packed 1541 bytes
+ python /root/helix/work/correlation/gen-debug-dump-docs.py -buildid 580195 -workitem System.Runtime.Tests -jobid 6fc0e798-b0d8-4fd9-9e43-a36cfb9441c4 -outdir /root/helix/work/workitem/uploads -templatedir /root/helix/work/correlation -dumpdir /home/helixbot/dotnetbuild/dumps -productver 9.0.0
gen-debug-dump-docs.py: Did not find dumps, skipping dump docs generation.
+ exit 137
+ export '_commandExitCode=137'
+ chmod -R 777 /home/helixbot/dotnetbuild/dumps
+ exit 137

[END EXECUTION]
Exit Code:137

Report

Build Definition Test Pull Request
899592 dotnet/runtime System.Runtime.Tests.WorkItemExecution
899596 dotnet/runtime System.Runtime.Tests.WorkItemExecution
899571 dotnet/runtime System.Runtime.Tests.WorkItemExecution
899572 dotnet/runtime System.Runtime.Tests.WorkItemExecution
898420 dotnet/runtime System.Runtime.Tests.WorkItemExecution
898418 dotnet/runtime System.Runtime.Tests.WorkItemExecution
898403 dotnet/runtime System.Runtime.Tests.WorkItemExecution
898419 dotnet/runtime System.Runtime.Tests.WorkItemExecution
897395 dotnet/runtime System.Runtime.Tests.WorkItemExecution
897407 dotnet/runtime System.Runtime.Tests.WorkItemExecution
897415 dotnet/runtime System.Runtime.Tests.WorkItemExecution
897418 dotnet/runtime System.Runtime.Tests.WorkItemExecution
896050 dotnet/runtime System.Runtime.Tests.WorkItemExecution
896055 dotnet/runtime System.Runtime.Tests.WorkItemExecution
896060 dotnet/runtime System.Runtime.Tests.WorkItemExecution
896031 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895749 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895734 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895754 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895756 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895423 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895416 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895426 dotnet/runtime System.Runtime.Tests.WorkItemExecution
895418 dotnet/runtime System.Runtime.Tests.WorkItemExecution
894559 dotnet/runtime System.Runtime.Tests.WorkItemExecution
894550 dotnet/runtime System.Runtime.Tests.WorkItemExecution
894551 dotnet/runtime System.Runtime.Tests.WorkItemExecution
894546 dotnet/runtime System.Runtime.Tests.WorkItemExecution
894058 dotnet/runtime System.Runtime.Tests.WorkItemExecution #109648
893462 dotnet/runtime System.Runtime.Tests.WorkItemExecution
893469 dotnet/runtime System.Runtime.Tests.WorkItemExecution
893468 dotnet/runtime System.Runtime.Tests.WorkItemExecution
893463 dotnet/runtime System.Runtime.Tests.WorkItemExecution
892302 dotnet/runtime System.Runtime.Tests.WorkItemExecution
892305 dotnet/runtime System.Runtime.Tests.WorkItemExecution
892308 dotnet/runtime System.Runtime.Tests.WorkItemExecution
892315 dotnet/runtime System.Runtime.Tests.WorkItemExecution
891122 dotnet/runtime System.Runtime.Tests.WorkItemExecution
891130 dotnet/runtime System.Runtime.Tests.WorkItemExecution
891118 dotnet/runtime System.Runtime.Tests.WorkItemExecution
891117 dotnet/runtime System.Runtime.Tests.WorkItemExecution
891115 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889812 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889802 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889811 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889794 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889336 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889337 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889327 dotnet/runtime System.Runtime.Tests.WorkItemExecution
889326 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888972 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888978 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888962 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888965 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888057 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888050 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888047 dotnet/runtime System.Runtime.Tests.WorkItemExecution
888045 dotnet/runtime System.Runtime.Tests.WorkItemExecution
887024 dotnet/runtime System.Runtime.Tests.WorkItemExecution
886995 dotnet/runtime System.Runtime.Tests.WorkItemExecution
887021 dotnet/runtime System.Runtime.Tests.WorkItemExecution
887025 dotnet/runtime System.Runtime.Tests.WorkItemExecution
886014 dotnet/runtime System.Runtime.Tests.WorkItemExecution
886008 dotnet/runtime System.Runtime.Tests.WorkItemExecution
885981 dotnet/runtime System.Runtime.Tests.WorkItemExecution
886002 dotnet/runtime System.Runtime.Tests.WorkItemExecution
884797 dotnet/runtime System.Runtime.Tests.WorkItemExecution
884796 dotnet/runtime System.Runtime.Tests.WorkItemExecution
884764 dotnet/runtime System.Runtime.Tests.WorkItemExecution
884785 dotnet/runtime System.Runtime.Tests.WorkItemExecution
883407 dotnet/runtime System.Runtime.Tests.WorkItemExecution
883413 dotnet/runtime System.Runtime.Tests.WorkItemExecution
883398 dotnet/runtime System.Runtime.Tests.WorkItemExecution
883387 dotnet/runtime System.Runtime.Tests.WorkItemExecution
883008 dotnet/runtime System.Runtime.Tests.WorkItemExecution
883019 dotnet/runtime System.Runtime.Tests.WorkItemExecution
883000 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882999 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882698 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882699 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882706 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882705 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882243 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882227 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882233 dotnet/runtime System.Runtime.Tests.WorkItemExecution
882242 dotnet/runtime System.Runtime.Tests.WorkItemExecution
881693 dotnet/runtime System.Runtime.Tests.WorkItemExecution
881705 dotnet/runtime System.Runtime.Tests.WorkItemExecution
881704 dotnet/runtime System.Runtime.Tests.WorkItemExecution
881685 dotnet/runtime System.Runtime.Tests.WorkItemExecution
880790 dotnet/runtime System.Runtime.Tests.WorkItemExecution
880797 dotnet/runtime System.Runtime.Tests.WorkItemExecution
880795 dotnet/runtime System.Runtime.Tests.WorkItemExecution
880801 dotnet/runtime System.Runtime.Tests.WorkItemExecution
879496 dotnet/runtime System.Runtime.Tests.WorkItemExecution
879498 dotnet/runtime System.Runtime.Tests.WorkItemExecution
879503 dotnet/runtime System.Runtime.Tests.WorkItemExecution
879505 dotnet/runtime System.Runtime.Tests.WorkItemExecution
878259 dotnet/runtime System.Runtime.Tests.WorkItemExecution
878257 dotnet/runtime System.Runtime.Tests.WorkItemExecution
Displaying 100 of 122 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 28 122

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=580195
Error message validated: [Killed.+System\.Runtime\.Tests\.runtimeconfig\.json.+OuterLoop]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 2/27/2024 11:09:08 PM UTC
@carlossanlop carlossanlop added area-System.Runtime os-linux Linux OS (any supported distro) arch-x64 blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' runtime-coreclr specific to the CoreCLR runtime os-linux-musl Linux distributions using musl library. Known Build Error Use this to report build issues in the .NET Helix tab labels Feb 27, 2024
@ghost
Copy link

ghost commented Feb 27, 2024

Tagging subscribers to this area: @dotnet/area-system-runtime
See info in area-owners.md if you want to be subscribed.

Issue Details

Error Blob

{
  "ErrorMessage": "",
  "BuildRetry": false,
  "ErrorPattern": "Killed.+System\.Runtime\.Tests\.runtimeconfig\.json.+OuterLoop",
  "ExcludeConsoleLog": false
}

Reproduction Steps

========================== End custom configuration settings ===============================
----- start Mon Feb 26 23:56:03 UTC 2024 =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing 
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
  Discovering: System.Runtime.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Runtime.Tests (found 29 of 9308 test cases)
  Starting:    System.Runtime.Tests (parallel test collections = on [2 threads], stop on fail = off)
./RunTests.sh: line 180:    21 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Runtime.Tests.runtimeconfig.json --depsfile System.Runtime.Tests.deps.json xunit.console.dll System.Runtime.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=AdditionalTimezoneChecks -notrait category=IgnoreForCI -notrait category=failing $RSP_FILE
/root/helix/work/workitem/e
----- end Mon Feb 26 23:56:28 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill.
ulimit -c value: unlimited
cat /proc/sys/kernel/core_pattern: /home/helixbot/dotnetbuild/dumps/core.%u.%p
cat /proc/sys/kernel/core_uses_pid: 1
cat: /proc/sys/kernel/coredump_filter: No such file or directory
cat /proc/sys/kernel/coredump_filter:
Looking around for any Linux dumps...
Looking for files matching core.* ...
----- start =============== XUnitLogChecker Output =====================================================
dmesg: klogctl: Operation not permitted
No dumps found in /home/helixbot/dotnetbuild/dumps.
----- end =============== XUnitLogChecker Output - exit code 0 ===========================
+ export '_commandExitCode=137'
+ python /root/helix/work/correlation/reporter/run.py https://dev.azure.com/dnceng-public/ public 13931354 eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsIng1dCI6Im9PdmN6NU1fN3AtSGpJS2xGWHo5M3VfVjBabyJ9.eyJuYW1laWQiOiJjNzczZjJjMi01MTIwLTQyMDctYWZlMi1hZmFmMzVhOGJjMGEiLCJzY3AiOiJhcHBfdG9rZW4iLCJhdWkiOiJhMTBlYjk0MS0xNzM2LTRjNzYtOWFiZC1iZDBlZGYxNjg0ODgiLCJzaWQiOiIxZTViN2VlMC1iNmQyLTQzNjgtODZjOS0zOTQ5MGIxM2FlODAiLCJCdWlsZElkIjoiY2JiMTgyNjEtYzQ4Zi00YWJiLTg2NTEtOGNkY2I1NDc0NjQ5OzU4MDE5NSIsImpvYnJlZiI6IjMxNTZhMmQwLTExYWItNGExMC04NTA0LWY3Y2UxM2ZiMTk2OTo1OTJlZWQ4OS03OGY1LTUyMDItOWRhNS1hZDE3ZGYzYmVmNGEiLCJwcGlkIjoidnN0ZnM6Ly8vQnVpbGQvQnVpbGQvNTgwMTk1Iiwib3JjaGlkIjoiMzE1NmEyZDAtMTFhYi00YTEwLTg1MDQtZjdjZTEzZmIxOTY5LmJ1aWxkLmJ1aWxkX2xpbnV4X211c2xfeDY0X2RlYnVnX2NvcmVjbHJfZGVidWcuX19kZWZhdWx0IiwicmVwb0lkcyI6IiIsImlzcyI6ImFwcC52c3Rva2VuLnZpc3VhbHN0dWRpby5jb20iLCJhdWQiOiJhcHAudnN0b2tlbi52aXN1YWxzdHVkaW8uY29tfHZzbzo2ZmNjOTJlNS03M2E3LTRmODgtOGQxMy1kOTA0NWI0NWZiMjciLCJuYmYiOjE3MDg5ODg5MzgsImV4cCI6MTcwOTAwMDkzOH0.rjlcWYrlHLfuHwUtUIiDkhhUDwy8cnQZ3rCBJjmd8FuCN0BDFzjz0jEMQEbQ9WZ7LHqdWN40vrD1MHH2p9a2tC9JYY7ca4b2w8Yy05wlbG-_cjF_ksT3jfhgz4EOLBiSmE7-bW_m1b3gtKHo-rdFDyMt_vciLiIB_C3543QhcPGJJdph5ok1SjBVKbl1q9wzw4Tut1lLyo8-ToLRotVPvv2Fahz3TSp--EDbdhY2SYtNrPyGVW7t9F8o3TZdG5iyrtyTnCAlr2Qdu-cOUJhyXM_4vhztXvLdgDMuDgGINPpA7sDXoqo_7LB9RP1iNc35uIEM-430j7jeG9MDrZzEZQ
2024-02-26T23:56:35.053Z	INFO   	run.py	run(48)	main	Beginning reading of test results.
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/e' for test results files
2024-02-26T23:56:35.054Z	INFO   	run.py	__init__(42)	read_results	Searching '/root/helix/work/workitem/uploads' for test results files
2024-02-26T23:56:35.062Z	WARNING	run.py	__init__(55)	read_results	No results file found in any of the following formats: xunit, junit, trx
2024-02-26T23:56:35.063Z	INFO   	run.py	packing_test_reporter(30)	report_results	Packing 0 test reports to '/root/helix/work/workitem/e/__test_report.json'
2024-02-26T23:56:35.067Z	INFO   	run.py	packing_test_reporter(33)	report_results	Packed 1541 bytes
+ python /root/helix/work/correlation/gen-debug-dump-docs.py -buildid 580195 -workitem System.Runtime.Tests -jobid 6fc0e798-b0d8-4fd9-9e43-a36cfb9441c4 -outdir /root/helix/work/workitem/uploads -templatedir /root/helix/work/correlation -dumpdir /home/helixbot/dotnetbuild/dumps -productver 9.0.0
gen-debug-dump-docs.py: Did not find dumps, skipping dump docs generation.
+ exit 137
+ export '_commandExitCode=137'
+ chmod -R 777 /home/helixbot/dotnetbuild/dumps
+ exit 137

[END EXECUTION]
Exit Code:137
Author: carlossanlop
Assignees: -
Labels:

area-System.Runtime, os-linux, arch-x64, blocking-clean-ci, runtime-coreclr, os-linux-musl, Known Build Error
Milestone: -

@ghost ghost added the untriaged New issue has not been triaged by the area owner label Feb 27, 2024
@danmoseley
Copy link
Member 


dmesg: read kernel buffer failed: Operation not permitted

Again.. so we can't see whether it was OOM. But presumably it was

@ericstj ericstj added the blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs label Mar 18, 2024
@jeffschwMSFT jeffschwMSFT removed the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Apr 1, 2024
@ilonatommy
Copy link
Member

Hit on net9.0-linux-Debug-x64-coreclr_release queue, LibraryImportGenerator.Tests but not caught by the query:
https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-99685-merge-4e96f500c0fc4768b9/LibraryImportGenerator.Tests/1/console.9506f96c.log?helixlogtype=result

./RunTests.sh: line 180:    24 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig LibraryImportGenerator.Tests.runtimeconfig.json --depsfile LibraryImportGenerator.Tests.deps.json xunit.console.dll LibraryImportGenerator.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing $RSP_FILE
----- end Wed Apr 3 08:14:35 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed either due to out of memory/resources (see /var/log/messages) or by explicit kill.
ulimit -c value: unlimited
cat /proc/sys/kernel/core_pattern: /home/helixbot/dotnetbuild/dumps/core.%u.%p
cat /proc/sys/kernel/core_uses_pid: 1
cat: /proc/sys/kernel/coredump_filter: No such file or directory
cat /proc/sys/kernel/coredump_filter:
Looking around for any Linux dumps...
Looking for files matching core.* ...
dmesg: read kernel buffer failed: Operation not permitted

@pavelsavara
Copy link
Member

again https://helixre107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-pull-98492-merge-31c70303cf32472f92/LibraryImportGenerator.Tests/1/console.c806de40.log?helixlogtype=result

@pavelsavara
Copy link
Member

should we edit the filter here to match exit code 137 ? It didn't found and reported LibraryImportGenerator.Tests in build

@pavelsavara pavelsavara mentioned this issue Apr 4, 2024
Merged
@am11 am11 mentioned this issue May 29, 2024
Closed
@elinor-fung elinor-fung mentioned this issue Jul 9, 2024
Open
@jeffhandley jeffhandley added this to the Future milestone Jul 19, 2024
@jeffhandley jeffhandley removed the untriaged New issue has not been triaged by the area owner label Jul 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
arch-x64 area-System.Runtime blocking-outerloop Blocking the 'runtime-coreclr outerloop' and 'runtime-libraries-coreclr outerloop' runs Known Build Error Use this to report build issues in the .NET Helix tab os-linux Linux OS (any supported distro) os-linux-musl Linux distributions using musl library. runtime-coreclr specific to the CoreCLR runtime
Projects
None yet
Milestone
Future
Development

No branches or pull requests
7 participants
@pavelsavara @jeffhandley @carlossanlop @danmoseley @ericstj @jeffschwMSFT @ilonatommy