Convert ref and runtime packs to use the SharedFramework SDK and Arcade's installer tooling

[jkoritzinsky]

Convert ref and runtime packs to use the SharedFramework SDK and Arcade's installer tooling (for Linux installers)

Replace the custom infrastructure in ASP.NET Core for building shared frameworks, .debs, and .rpms with the Arcade infrastructure

Description

Replace the custom infrastructure in this repo with the Arcade infrastructure. This provides a number of benefits:

• Crossgen2/R2R support is hooked up correctly through the SDK support
• Construction of targeting and runtime packs uses standard tooling, so less for aspnetcore to maintain and free updates to "best practices" from Arcade
• Support for building deb and rpm packages on any Linux distro

Fixes #48013
Fixes #49486
Fixes #58073
Contributes to dotnet/source-build#3986

Depends on dotnet/arcade#15200
Depends on an SDK with dotnet/sdk#44436 (#58862)
Depends on dotnet/runtime#109169
Replaces #58600
Depends on dotnet/arcade#15208
Depends on dotnet/arcade#15209
Depends on #58934

[wtgodbe]

Whoa, awesome! Feel free to ping me on Teams if/when you want me to take a look

[wtgodbe]

What's the purpose of this proj?

[jkoritzinsky]

This project builds an archive containing the .NET runtime and the ASP.NET Core runtime with the Composite ReadyToRun image (which is used in some of our docker images).

[wtgodbe]

Can you run an internal build of this branch so we can inspect the produced SharedFx/Targeting packs packages/installers?

[jkoritzinsky]

Official build at https://dev.azure.com/dnceng/internal/_build/results?buildId=2580559&view=results

[ViktorHofer]

According to the official build, the targeting pack project is built and published from multiple legs:

##[error].packages\microsoft.dotnet.arcade.sdk\10.0.0-beta.24560.1\tools\SdkTasks\PublishBuildAssets.proj(42,5): error : Repeated Package entry: 'Microsoft.AspNetCore.App.Ref' - '10.0.0-alpha.2.24562.3' 
D:\a\_work\1\s\.packages\microsoft.dotnet.arcade.sdk\10.0.0-beta.24560.1\tools\SdkTasks\PublishBuildAssets.proj(42,5): error : InvalidOperationException: Duplicate package entries are not allowed for publishing to BAR, as this can cause race conditions and unexpected behavior
D:\a\_work\1\s\.packages\microsoft.dotnet.arcade.sdk\10.0.0-beta.24560.1\tools\SdkTasks\PublishBuildAssets.proj(42,5): error :    at Microsoft.DotNet.Maestro.Tasks.PushMetadataToBuildAssetRegistry.MergeManifests(List`1 parsedManifests) in /_/src/Maestro/Microsoft.DotNet.Maestro.Tasks/src/PushMetadataToBuildAssetRegistry.cs:line 557
D:\a\_work\1\s\.packages\microsoft.dotnet.arcade.sdk\10.0.0-beta.24560.1\tools\SdkTasks\PublishBuildAssets.proj(42,5): error :    at Microsoft.DotNet.Maestro.Tasks.PushMetadataToBuildAssetRegistry.PushMetadataAsync(CancellationToken cancellationToken) in /_/src/Maestro/Microsoft.DotNet.Maestro.Tasks/src/PushMetadataToBuildAssetRegistry.cs:line 105
D:\a\_work\1\s\.packages\microsoft.dotnet.arcade.sdk\10.0.0-beta.24560.1\tools\SdkTasks\PublishBuildAssets.proj(42,5): error : 

[jkoritzinsky]

Failures in the Linux x64 leg will be fixed by #58934

[wtgodbe]

LGTM, the only other thing would be to confirm the manifest from an internal build of this branch matches the manifest from an internal build of main

[jkoritzinsky]

I ran an official build and it looks fine. However, the manually-triggered official build does in-build signing instead of post-build, so comparing apples-to-apples is difficult. I think this is okay for merge, but let me know if you think more validation is necessary.

[jkoritzinsky]

Fixed an issue with in-build signing, new official build at https://dev.azure.com/dnceng/internal/_build/results?buildId=2595419&view=results

[jkoritzinsky]

New official build link: https://dev.azure.com/dnceng/internal/_build/results?buildId=2595988&view=results

[jkoritzinsky]

New official build link: https://dev.azure.com/dnceng/internal/_build/results?buildId=2596133&view=results

[jkoritzinsky]

Okay there's an ongoing infra issue that broke the official build. If this build produces the right installers for Linux arm64, we're good to merge (as that's the last thing I needed to validate).

[jkoritzinsky]

ARM64 rpms are being produced, setting auto-merge.

[ViktorHofer]

I was surprised to see this. Are you sure that this is still an issue?

[jkoritzinsky]

Yes I believe that is still the case (to the point that I think I messed up this condition and we're seeing failures related to it in the Aspnet->SDK update).

I have some thoughts about it and I'll open an issue today to track fixing it.