Publish nightly nupkg / .Net SDK Validation (#2523) * Adding DotNetSDK Validation * Added support for Wasm and NativeAot * Added missing case statements * Code cleanup * Separated providers for .Net and .Net Framework. Added validation to MonoAotLLVMToolChain and CsProjClassicNetToolchain * Put code into static utility class. Updated toolchains * Updated validator and toolchains * Updated toolchains and framework validation #11
GitHub Actions / report
succeeded
Mar 5, 2024 in 1s
report ✅
| Report | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| test-linux-trx/TestResults/linux-integration-net8.0.trx | 217✅ | 16⚪ | 22m 52s 691ms | |
| test-linux-trx/TestResults/linux-unit-net8.0.trx | 904✅ | 8⚪ | 4s 443ms | |
| test-macos-trx/TestResults/macos-integration-net8.0.trx | 219✅ | 16⚪ | 23m 32s 044ms | |
| test-macos-trx/TestResults/macos-unit-net8.0.trx | 904✅ | 8⚪ | 5s 234ms | |
| test-windows-core-trx/TestResults/windows-integration-net8.0.trx | 226✅ | 8⚪ | 22m 02s 860ms | |
| test-windows-full-trx/TestResults/windows-integration-net462.trx | 248✅ | 12⚪ | 18m 43s 402ms |
✅ test-linux-trx/TestResults/linux-integration-net8.0.trx
233 tests were completed in 22m 52s 691ms with 217 passed, 0 failed and 16 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 12✅ | 3⚪ | 3m 15s 534ms | |
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 55✅ | 3m 03s 838ms | ||
| BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests | 4✅ | 2m 11s 913ms | ||
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 21✅ | 1m 49s 173ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 1m 12s 048ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 11✅ | 1m 10s 319ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 50s 470ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1✅ | 48s 208ms | ||
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 1✅ | 1⚪ | 45s 691ms | |
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 41s 682ms | ||
| BenchmarkDotNet.IntegrationTests.MonoTests | 1✅ | 40s 374ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1✅ | 38s 165ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 6✅ | 38s 094ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 6✅ | 37s 516ms | ||
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 4✅ | 26s 801ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 20s 157ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 19s 191ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 16s 723ms | ||
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 15s 723ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 13s 062ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 12s 816ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 2✅ | 12s 716ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 10s 483ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 2✅ | 10s 030ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 1✅ | 7s 727ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 7s 509ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 7s 120ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 6s 931ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 6s 890ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 6s 780ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 6s 557ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 6s 557ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 6s 446ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 6s 411ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 3✅ | 1⚪ | 6s 365ms | |
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 6s 357ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 6s 323ms | ||
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 6s 295ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 6s 195ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 4s 625ms | ||
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 4s 593ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1s 082ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 2✅ | 1⚪ | 164ms | |
| BenchmarkDotNet.IntegrationTests.InProcessTest | 10✅ | 135ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 19ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 3✅ | 1⚪ | 4ms | |
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 3ms | ||
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms |
✅ test-linux-trx/TestResults/linux-unit-net8.0.trx
912 tests were completed in 4s 443ms with 904 passed, 0 failed and 8 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Tests.Engine.EngineFactoryTests | 11✅ | 2s 982ms | ||
| BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests | 24✅ | 922ms | ||
| BenchmarkDotNet.Tests.Validators.ConfigCompatibilityValidatorTests | 6✅ | 357ms | ||
| BenchmarkDotNet.Tests.ConfigParserTests | 81✅ | 3⚪ | 288ms | |
| BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests | 3✅ | 271ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.CpuInfoFormatterTests | 1✅ | 135ms | ||
| BenchmarkDotNet.Tests.TypeFilterTests | 16✅ | 129ms | ||
| BenchmarkDotNet.Tests.Running.BenchmarkConverterTests | 11✅ | 127ms | ||
| BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests | 17✅ | 116ms | ||
| BenchmarkDotNet.Tests.GlobFilterTests | 20✅ | 95ms | ||
| BenchmarkDotNet.Tests.Columns.RatioColumnTest | 1✅ | 85ms | ||
| BenchmarkDotNet.Tests.Configs.CategoriesTests | 3✅ | 62ms | ||
| BenchmarkDotNet.Tests.AppConfigGeneratorTests | 8✅ | 1⚪ | 49ms | |
| BenchmarkDotNet.Tests.Configs.ImmutableConfigTests | 27✅ | 2⚪ | 48ms | |
| BenchmarkDotNet.Tests.Order.DefaultOrdererTests | 2✅ | 45ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTests | 1✅ | 44ms | ||
| BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests | 3✅ | 42ms | ||
| BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests | 25✅ | 36ms | ||
| BenchmarkDotNet.Tests.CorrectionsSuggesterTests | 10✅ | 33ms | ||
| BenchmarkDotNet.Tests.Configs.JobTests | 13✅ | 33ms | ||
| BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests | 15✅ | 31ms | ||
| BenchmarkDotNet.Tests.BuildResultTests | 4✅ | 30ms | ||
| BenchmarkDotNet.Tests.Validators.ParamsValidatorTests | 32✅ | 28ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTableTests | 10✅ | 28ms | ||
| BenchmarkDotNet.Tests.CsProjGeneratorTests | 10✅ | 26ms | ||
| BenchmarkDotNet.Tests.FullNameProviderTests | 20✅ | 21ms | ||
| BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests | 4✅ | 1⚪ | 21ms | |
| BenchmarkDotNet.Tests.Engine.EnginePilotStageTests | 3✅ | 18ms | ||
| BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests | 10✅ | 18ms | ||
| BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests | 21✅ | 18ms | ||
| BenchmarkDotNet.Tests.Validators.CompilationValidatorTests | 14✅ | 18ms | ||
| BenchmarkDotNet.Tests.Engine.EngineActualStageTests | 3✅ | 17ms | ||
| BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests | 4✅ | 16ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests | 4✅ | 16ms | ||
| BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests | 7✅ | 15ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.WmicCpuInfoParserTests | 5✅ | 13ms | ||
| BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests | 10✅ | 13ms | ||
| BenchmarkDotNet.Tests.Reports.RatioPrecisionTests | 3✅ | 12ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.ProcCpuInfoParserTests | 9✅ | 12ms | ||
| BenchmarkDotNet.Tests.Reports.RatioStyleTests | 2✅ | 12ms | ||
| BenchmarkDotNet.Tests.Environments.OsBrandStringTests | 29✅ | 11ms | ||
| BenchmarkDotNet.Tests.StringExtensionsTests | 19✅ | 11ms | ||
| BenchmarkDotNet.Tests.SizeUnitTests | 16✅ | 11ms | ||
| BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests | 7✅ | 11ms | ||
| BenchmarkDotNet.Tests.EventPipeProfilerTests | 5✅ | 10ms | ||
| BenchmarkDotNet.Tests.CodeGeneratorTests | 2✅ | 10ms | ||
| BenchmarkDotNet.Tests.Mathematics.StatisticsTests | 9✅ | 9ms | ||
| BenchmarkDotNet.Tests.Exporters.XmlSerializerTests | 23✅ | 8ms | ||
| BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests | 6✅ | 8ms | ||
| BenchmarkDotNet.Tests.RuntimeVersionDetectionTests | 32✅ | 7ms | ||
| BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests | 12✅ | 7ms | ||
| BenchmarkDotNet.Tests.SimpleJsonTests | 2✅ | 7ms | ||
| BenchmarkDotNet.Tests.ParameterComparerTests | 6✅ | 6ms | ||
| BenchmarkDotNet.Tests.FrameworkVersionHelperTests | 16✅ | 6ms | ||
| BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs | 4✅ | 5ms | ||
| BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests | 4✅ | 5ms | ||
| BenchmarkDotNet.Tests.ReflectionTests | 8✅ | 5ms | ||
| BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests | 2✅ | 5ms | ||
| BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests | 29✅ | 5ms | ||
| BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests | 11✅ | 4ms | ||
| BenchmarkDotNet.Tests.Engine.EngineResultStageTests | 1✅ | 4ms | ||
| BenchmarkDotNet.Tests.GenericBuilderTests | 6✅ | 4ms | ||
| BenchmarkDotNet.Tests.TimeUnitTests | 2✅ | 4ms | ||
| BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests | 6✅ | 4ms | ||
| BenchmarkDotNet.Tests.Reports.ColumnTests | 1✅ | 3ms | ||
| BenchmarkDotNet.Tests.ParameterInstanceTests | 25✅ | 3ms | ||
| BenchmarkDotNet.Tests.SourceCodeHelperTests | 25✅ | 3ms | ||
| BenchmarkDotNet.Tests.Environments.ProcessorBrandStringTests | 24✅ | 2ms | ||
| BenchmarkDotNet.Tests.ParamsSourceTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.Mathematics.RankTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.Columns.MetricColumnTests | 4✅ | 2ms | ||
| BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests | 3✅ | 2ms | ||
| BenchmarkDotNet.Tests.FolderNameTests | 12✅ | 1ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigOptionsTests | 10✅ | 1ms | ||
| BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests | 14✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.SysctlCpuInfoParserTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.ArtifactFileNameHelperTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.Tests.SummaryStyleTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.VirtualBoxTests | 5✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.HyperVTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.CsvHelperTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.CharacteristicPresenterTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.VMwareTests | 7✅ | 1ms | ||
| BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests | 6✅ | 1ms | ||
| BenchmarkDotNet.Tests.dotTrace.DotTraceTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.Columns.TagColumnTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests | 5✅ | 1ms |
✅ test-macos-trx/TestResults/macos-integration-net8.0.trx
235 tests were completed in 23m 32s 044ms with 219 passed, 0 failed and 16 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 55✅ | 4m 01s 743ms | ||
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 12✅ | 3⚪ | 2m 35s 888ms | |
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 21✅ | 2m 08s 075ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 11✅ | 1m 43s 716ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 1m 34s 073ms | ||
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 58s 777ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 6✅ | 50s 458ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 6✅ | 50s 048ms | ||
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 1✅ | 1⚪ | 46s 223ms | |
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 45s 470ms | ||
| BenchmarkDotNet.IntegrationTests.MonoTests | 1✅ | 43s 114ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1✅ | 41s 134ms | ||
| BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests | 2✅ | 30s 784ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 26s 467ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 24s 508ms | ||
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 20s 547ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 20s 229ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 2✅ | 19s 629ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 18s 414ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 17s 198ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 13s 459ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 2✅ | 12s 728ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 1✅ | 11s 026ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 10s 809ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 10s 341ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 9s 626ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 9s 323ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 9s 258ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 8s 994ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 8s 727ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 8s 539ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 8s 411ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 8s 374ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 3✅ | 1⚪ | 8s 347ms | |
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 8s 330ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 8s 318ms | ||
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 7s 999ms | ||
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 6s 113ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 5s 451ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 2✅ | 1⚪ | 246ms | |
| BenchmarkDotNet.IntegrationTests.InProcessTest | 10✅ | 177ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 27ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 3✅ | 1⚪ | 5ms | |
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 3ms | ||
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 3ms | ||
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 8✅ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms |
✅ test-macos-trx/TestResults/macos-unit-net8.0.trx
912 tests were completed in 5s 234ms with 904 passed, 0 failed and 8 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Tests.Engine.EngineFactoryTests | 11✅ | 3s 596ms | ||
| BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests | 24✅ | 707ms | ||
| BenchmarkDotNet.Tests.Columns.RatioColumnTest | 1✅ | 690ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.CpuInfoFormatterTests | 1✅ | 603ms | ||
| BenchmarkDotNet.Tests.ConfigParserTests | 81✅ | 3⚪ | 460ms | |
| BenchmarkDotNet.Tests.Validators.ConfigCompatibilityValidatorTests | 6✅ | 393ms | ||
| BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests | 3✅ | 209ms | ||
| BenchmarkDotNet.Tests.Reports.RatioPrecisionTests | 3✅ | 205ms | ||
| BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests | 3✅ | 154ms | ||
| BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests | 17✅ | 134ms | ||
| BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests | 25✅ | 124ms | ||
| BenchmarkDotNet.Tests.Configs.ImmutableConfigTests | 27✅ | 2⚪ | 109ms | |
| BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests | 15✅ | 98ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTests | 1✅ | 91ms | ||
| BenchmarkDotNet.Tests.CorrectionsSuggesterTests | 10✅ | 44ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTableTests | 10✅ | 40ms | ||
| BenchmarkDotNet.Tests.TypeFilterTests | 16✅ | 39ms | ||
| BenchmarkDotNet.Tests.CsProjGeneratorTests | 10✅ | 38ms | ||
| BenchmarkDotNet.Tests.Reports.RatioStyleTests | 2✅ | 37ms | ||
| BenchmarkDotNet.Tests.Configs.CategoriesTests | 3✅ | 36ms | ||
| BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests | 4✅ | 30ms | ||
| BenchmarkDotNet.Tests.Engine.EnginePilotStageTests | 3✅ | 29ms | ||
| BenchmarkDotNet.Tests.FullNameProviderTests | 20✅ | 29ms | ||
| BenchmarkDotNet.Tests.Mathematics.RankTests | 1✅ | 28ms | ||
| BenchmarkDotNet.Tests.Running.BenchmarkConverterTests | 11✅ | 27ms | ||
| BenchmarkDotNet.Tests.Engine.StoppingCriteria.AutoWarmupStoppingCriteriaTests | 12✅ | 27ms | ||
| BenchmarkDotNet.Tests.BuildResultTests | 4✅ | 27ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.ProcCpuInfoParserTests | 9✅ | 24ms | ||
| BenchmarkDotNet.Tests.EventPipeProfilerTests | 5✅ | 24ms | ||
| BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests | 4✅ | 1⚪ | 23ms | |
| BenchmarkDotNet.Tests.Validators.CompilationValidatorTests | 14✅ | 23ms | ||
| BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests | 7✅ | 23ms | ||
| BenchmarkDotNet.Tests.Exporters.XmlSerializerTests | 23✅ | 21ms | ||
| BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests | 2✅ | 20ms | ||
| BenchmarkDotNet.Tests.Validators.ParamsValidatorTests | 32✅ | 20ms | ||
| BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests | 10✅ | 16ms | ||
| BenchmarkDotNet.Tests.SourceCodeHelperTests | 25✅ | 16ms | ||
| BenchmarkDotNet.Tests.Engine.EngineResultStageTests | 1✅ | 16ms | ||
| BenchmarkDotNet.Tests.Configs.JobTests | 13✅ | 15ms | ||
| BenchmarkDotNet.Tests.Engine.EngineActualStageTests | 3✅ | 14ms | ||
| BenchmarkDotNet.Tests.ParameterInstanceTests | 25✅ | 14ms | ||
| BenchmarkDotNet.Tests.Environments.OsBrandStringTests | 29✅ | 13ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests | 4✅ | 13ms | ||
| BenchmarkDotNet.Tests.GlobFilterTests | 20✅ | 12ms | ||
| BenchmarkDotNet.Tests.Engine.StoppingCriteria.FixedStoppingCriteriaTests | 10✅ | 12ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigOptionsTests | 10✅ | 12ms | ||
| BenchmarkDotNet.Tests.SizeUnitTests | 16✅ | 11ms | ||
| BenchmarkDotNet.Tests.Mathematics.StatisticsTests | 9✅ | 11ms | ||
| BenchmarkDotNet.Tests.AppConfigGeneratorTests | 8✅ | 1⚪ | 11ms | |
| BenchmarkDotNet.Tests.ParamsSourceTests | 1✅ | 10ms | ||
| BenchmarkDotNet.Tests.FolderNameTests | 12✅ | 9ms | ||
| BenchmarkDotNet.Tests.SimpleJsonTests | 2✅ | 7ms | ||
| BenchmarkDotNet.Tests.CodeGeneratorTests | 2✅ | 7ms | ||
| BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests | 1✅ | 7ms | ||
| BenchmarkDotNet.Tests.TimeUnitTests | 2✅ | 6ms | ||
| BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests | 29✅ | 6ms | ||
| BenchmarkDotNet.Tests.StringExtensionsTests | 19✅ | 6ms | ||
| BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests | 7✅ | 6ms | ||
| BenchmarkDotNet.Tests.ParameterComparerTests | 6✅ | 6ms | ||
| BenchmarkDotNet.Tests.GenericBuilderTests | 6✅ | 6ms | ||
| BenchmarkDotNet.Tests.RuntimeVersionDetectionTests | 32✅ | 6ms | ||
| BenchmarkDotNet.Tests.Portability.VirtualBoxTests | 5✅ | 5ms | ||
| BenchmarkDotNet.Tests.Order.DefaultOrdererTests | 2✅ | 5ms | ||
| BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests | 6✅ | 5ms | ||
| BenchmarkDotNet.Tests.ReflectionTests | 8✅ | 4ms | ||
| BenchmarkDotNet.Tests.Environments.ProcessorBrandStringTests | 24✅ | 4ms | ||
| BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests | 6✅ | 4ms | ||
| BenchmarkDotNet.Tests.Portability.VMwareTests | 7✅ | 4ms | ||
| BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests | 11✅ | 4ms | ||
| BenchmarkDotNet.Tests.Columns.MetricColumnTests | 4✅ | 3ms | ||
| BenchmarkDotNet.Tests.Reports.ColumnTests | 1✅ | 3ms | ||
| BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests | 4✅ | 3ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.SysctlCpuInfoParserTests | 3✅ | 3ms | ||
| BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests | 21✅ | 3ms | ||
| BenchmarkDotNet.Tests.Portability.Cpu.WmicCpuInfoParserTests | 5✅ | 2ms | ||
| BenchmarkDotNet.Tests.CharacteristicPresenterTests | 3✅ | 2ms | ||
| BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests | 14✅ | 1ms | ||
| BenchmarkDotNet.Tests.dotTrace.DotTraceTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.ArtifactFileNameHelperTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.FrameworkVersionHelperTests | 16✅ | 1ms | ||
| BenchmarkDotNet.Tests.CsvHelperTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.SummaryStyleTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.HyperVTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests | 6✅ | 1ms | ||
| BenchmarkDotNet.Tests.Columns.TagColumnTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests | 5✅ | 1ms |
✅ test-windows-core-trx/TestResults/windows-integration-net8.0.trx
234 tests were completed in 22m 02s 860ms with 226 passed, 0 failed and 8 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 12✅ | 3⚪ | 3m 40s 339ms | |
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 55✅ | 3m 10s 307ms | ||
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 21✅ | 1m 46s 033ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 1m 14s 166ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 11✅ | 1m 12s 069ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 49s 841ms | ||
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 1✅ | 1⚪ | 45s 085ms | |
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 42s 247ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 6✅ | 38s 909ms | ||
| BenchmarkDotNet.IntegrationTests.MonoTests | 1✅ | 38s 278ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1✅ | 37s 992ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 7✅ | 34s 514ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 5✅ | 1⚪ | 33s 768ms | |
| BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests | 2✅ | 27s 632ms | ||
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 4✅ | 27s 238ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 20s 669ms | ||
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 19s 421ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 19s 327ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 15s 575ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 15s 181ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2✅ | 13s 086ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 13s 027ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 2✅ | 12s 924ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 11s 404ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 2✅ | 9s 841ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 9s 086ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1✅ | 9s 012ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1✅ | 7s 847ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 7s 776ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 1✅ | 7s 736ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 7s 137ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 7s 067ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 7s 033ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 6s 964ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 6s 710ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 6s 622ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 6s 547ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 6s 523ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1✅ | 6s 503ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 6s 491ms | ||
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 6s 471ms | ||
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 6s 414ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 4s 588ms | ||
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 4s 469ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1s 248ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 2✅ | 1⚪ | 355ms | |
| BenchmarkDotNet.IntegrationTests.InProcessTest | 10✅ | 227ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2✅ | 31ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 23ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 4✅ | 9ms | ||
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 4ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 3ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms |
✅ test-windows-full-trx/TestResults/windows-integration-net462.trx
260 tests were completed in 18m 43s 402ms with 248 passed, 0 failed and 12 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 12✅ | 6m 32s 170ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 7✅ | 2m 32s 057ms | ||
| BenchmarkDotNet.IntegrationTests.TailCallDiagnoserTests | 4✅ | 2m 05s 145ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 51s 263ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1✅ | 51s 072ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1✅ | 50s 527ms | ||
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 10✅ | 5⚪ | 44s 760ms | |
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 19✅ | 2⚪ | 44s 204ms | |
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 2✅ | 39s 555ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 9✅ | 35s 936ms | ||
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 53✅ | 1⚪ | 21s 054ms | |
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 15s 964ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 5✅ | 1⚪ | 12s 827ms | |
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 10s 516ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 9s 961ms | ||
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 7s 172ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 5s 366ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 11✅ | 3s 569ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 4✅ | 2s 944ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 2s 304ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 2s 145ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 7✅ | 1s 976ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 1s 747ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 1✅ | 1s 700ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1s 634ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 4✅ | 1s 206ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 1s 043ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 973ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 3✅ | 877ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessTest | 10✅ | 852ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 844ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 825ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 816ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2✅ | 606ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 558ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 548ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 546ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 356ms | ||
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 309ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 303ms | ||
| BenchmarkDotNet.IntegrationTests.CopyToOutputTests | 1✅ | 293ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1✅ | 291ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 284ms | ||
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 276ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 274ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1✅ | 274ms | ||
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 250ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 202ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 59ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2✅ | 35ms | ||
| BenchmarkDotNet.IntegrationTests.Diagnosers.ProcessMetricsTests | 3✅ | 21ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 4✅ | 11ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 6ms | ||
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 5ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.MonoTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1⚪ | 1ms |
Loading