Tests using Onnx fail with LoadOrtModelWithLoader ORT model verification failed

[ericstj]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=895122
Build error leg or test failing: Microsoft.ML.Tests.DnnImageFeaturizerTests.TestDnnImageFeaturizer
Pull request: #7334

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "LoadOrtModelWithLoader ORT model verification failed.",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Sample stack:

System.InvalidOperationException : Error during class instantiation
---- System.Reflection.TargetInvocationException : Exception has been thrown by the target of an invocation.
-------- System.InvalidOperationException : Error during class instantiation
------------ System.Reflection.TargetInvocationException : Exception has been thrown by the target of an invocation.
---------------- System.InvalidOperationException : Error initializing model :Microsoft.ML.OnnxRuntime.OnnxRuntimeException: [ErrorCode:Fail] inference_session.cc:1357 onnxruntime::InferenceSession::LoadOrtModelWithLoader ORT model verification failed.
   at Microsoft.ML.OnnxRuntime.InferenceSession.Init(String modelPath, SessionOptions options, PrePackedWeightsContainer prepackedWeightsContainer)
   at Microsoft.ML.OnnxRuntime.InferenceSession..ctor(String modelPath, SessionOptions options)
   at Microsoft.ML.Transforms.Onnx.OnnxModel..ctor(IHostEnvironment env, String modelFile, Nullable`1 gpuDeviceId, Boolean fallbackToCpu, Boolean ownModelFile, IDictionary`2 shapeDictionary, Int32 recursionLimit, Nullable`1 interOpNumThreads, Nullable`1 intraOpNumThreads) in D:\a\_work\1\s\src\Microsoft.ML.OnnxTransformer\OnnxUtils.cs:line 242
   at Microsoft.ML.Transforms.Onnx.OnnxModel.CreateFromBytes(Byte[] modelBytes, IHostEnvironment env, Nullable`1 gpuDeviceId, Boolean fallbackToCpu, IDictionary`2 shapeDictionary, Int32 recursionLimit) in D:\a\_work\1\s\src\Microsoft.ML.OnnxTransformer\OnnxUtils.cs:line 410
   at Microsoft.ML.Transforms.Onnx.OnnxTransformer..ctor(IHostEnvironment env, Options options, Byte[] modelBytes) in D:\a\_work\1\s\src\Microsoft.ML.OnnxTransformer\OnnxTransform.cs:line 280
-------------------- Microsoft.ML.OnnxRuntime.OnnxRuntimeException : [ErrorCode:Fail] inference_session.cc:1357 onnxruntime::InferenceSession::LoadOrtModelWithLoader ORT model verification failed.

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=895122
Error message validated: [LoadOrtModelWithLoader ORT model verification failed.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 12/16/2024 9:15:15 PM UTC

Report

Build	Definition	Test	Pull Request
896731	dotnet/machinelearning	Microsoft.ML.Tests.DnnImageFeaturizerTests.TestDnnImageFeaturizer
895122	dotnet/machinelearning	Microsoft.ML.OnnxTransformerTest.WorkItemExecution	#7334

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	1	2