Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_analyzer_bfloat16_resnet50 fail on 5117 machine #28025

Closed
luotao1 opened this issue Oct 16, 2020 · 0 comments
Closed

test_analyzer_bfloat16_resnet50 fail on 5117 machine #28025

luotao1 opened this issue Oct 16, 2020 · 0 comments
Assignees
Labels

Comments

@luotao1
Copy link
Contributor

luotao1 commented Oct 16, 2020

[06:49:52] :	 [Step 1/2] 	212 - test_analyzer_bfloat16_resnet50 (Failed)
[06:49:52] :	 [Step 1/2] At least one test failed with exit code => 0
[06:49:52] :	 [Step 1/2] 1/2 Test #212: test_analyzer_bfloat16_resnet50 ...***Failed   26.42 sec
[06:49:52] :	 [Step 1/2] [==========] Running 1 test from 1 test case.
[06:49:52] :	 [Step 1/2] [----------] Global test environment set-up.
[06:49:52] :	 [Step 1/2] [----------] 1 test from Analyzer_int8_image_classification
[06:49:52] :	 [Step 1/2] [ RUN      ] Analyzer_int8_image_classification.bfloat16
[06:49:52] :	 [Step 1/2] WARNING: Logging before InitGoogleLogging() is written to STDERR
[06:49:52] :	 [Step 1/2] I1016 06:49:26.977586  1525 tester_helper.h:221] Total images in file: 100
[06:49:52] :	 [Step 1/2] I1016 06:49:27.111459  1525 tester_helper.h:849] FP32 & BF16 prediction run: batch_size 50
[06:49:52] :	 [Step 1/2] I1016 06:49:27.111490  1525 tester_helper.h:851] --- FP32 prediction start ---
[06:49:52] :	 [Step 1/2] WARNING: Logging before InitGoogleLogging() is written to STDERR
[06:49:52] :	 [Step 1/2] W1016 06:49:27.111521  1525 api.cc:121] The paddle::NativeConfig interface is going to be deprecated in the next release, plase use the latest paddle_infer::Config instead.
[06:49:52] :	 [Step 1/2] I1016 06:49:27.111496  1525 tester_helper.h:98] AnalysisConfig {
[06:49:52] :	 [Step 1/2]   NativeConfig {
[06:49:52] :	 [Step 1/2]     PaddlePredictor::Config {
[06:49:52] :	 [Step 1/2]       model_dir: /root/.cache/inference_demo/int8v2/resnet50/model
[06:49:52] :	 [Step 1/2]     }
[06:49:52] :	 [Step 1/2]     use_gpu: 0
[06:49:52] :	 [Step 1/2]     device: 0
[06:49:52] :	 [Step 1/2]     fraction_of_gpu_memory: 0.00219466
[06:49:52] :	 [Step 1/2]     specify_input_name: 1
[06:49:52] :	 [Step 1/2]   }
[06:49:52] :	 [Step 1/2]   prog_file: 
[06:49:52] :	 [Step 1/2]   param_file: 
[06:49:52] :	 [Step 1/2]   enable_ir_optim: 1
[06:49:52] :	 [Step 1/2]   cpu_num_threads: 1
[06:49:52] :	 [Step 1/2]   use_feed_fetch_ops: 1
[06:49:52] :	 [Step 1/2]   use_tensorrt: 0
[06:49:52] :	 [Step 1/2]   use_mkldnn: 1
[06:49:52] :	 [Step 1/2] }
... 
[06:49:52] :	 [Step 1/2]  [1m [35m--- Running analysis [ir_params_sync_among_devices_pass] [0m
[06:49:52] :	 [Step 1/2]  [1m [35m--- Running analysis [adjust_cudnn_workspace_size_pass] [0m
[06:49:52] :	 [Step 1/2]  [1m [35m--- Running analysis [inference_op_replace_pass] [0m
[06:49:52] :	 [Step 1/2]  [1m [35m--- Running analysis [ir_graph_to_program_pass] [0m
[06:49:52] :	 [Step 1/2] I1016 06:49:51.519055  1525 analysis_predictor.cc:537] ======= optimize end =======
[06:49:52] :	 [Step 1/2] I1016 06:49:51.520159  1525 tester_helper.h:528] Thread 0, number of threads 1, run 1 times...
[06:49:52] :	 [Step 1/2] W1016 06:49:51.530292  1525 operator.cc:205] conv2d raises an exception dnnl::error, could not create a primitive descriptor iterator
[06:49:52] :	 [Step 1/2] unknown file: Failure
[06:49:52] :	 [Step 1/2] C++ exception with description "could not create a primitive descriptor iterator" thrown in the test body.
[06:49:52] :	 [Step 1/2] [  FAILED  ] Analyzer_int8_image_classification.bfloat16 (24567 ms)
[06:49:52] :	 [Step 1/2] [----------] 1 test from Analyzer_int8_image_classification (24567 ms total)
[06:49:52] :	 [Step 1/2] 
[06:49:52] :	 [Step 1/2] [----------] Global test environment tear-down
[06:49:52] :	 [Step 1/2] [==========] 1 test from 1 test case ran. (24567 ms total)
[06:49:52] :	 [Step 1/2] [  PASSED  ] 0 tests.
[06:49:52] :	 [Step 1/2] [  FAILED  ] 1 test, listed below:
[06:49:52] :	 [Step 1/2] [  FAILED  ] Analyzer_int8_image_classification.bfloat16
[06:49:52] :	 [Step 1/2] 
[06:49:52] :	 [Step 1/2]  1 FAILED TEST

Paddle_PR_CI_Night_36265.log

The 5117 machine config in #27588
related: #27755

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants