[3.1.107-SDK] Build fails during core-setup

[cerebrate]

I'm trying to build the 3.1.107-SDK release of source-build on Debian under WSL, looking towards packaging it for Debian, and am running into trouble during compilation; specifically, 11 errors show up during core-setup building, ending with:

      0 Warning(s)                                                                                                                                                                              
      11 Error(s)                                                                                                                                                                                                                                                                                                                                                                     Time Elapsed 00:03:57.30
##vso[task.logissue type=error]Build failed (exit code '1').

'core-setup' failed during build.
See '/home/avatar/src/source-build-3.1.107-SDK/artifacts/logs/core-setup.log' for more information.
'aspnet-extensions' failed during build.
'aspnetcore-tooling' failed during build.
'aspnetcore' failed during build.
'websdk' failed during build.
'known-good' failed during build.

Build FAILED.

I have attached core-setup.log here, which contains a number of errors of the form:

##vso[task.logissue type=error;sourcepath=/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets;linenumber=1260;columnnumber=5;code=;](NETCORE_ENGINEERING_TELEMETRY=Build) Error when creating nuget lib package from /home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/artifacts/packages/Release/specs/runtime.debian-x64.Microsoft.NETCore.DotNetAppHost.nuspec. System.IO.DirectoryNotFoundException: Could not find a part of the path '/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/artifacts/bin/debian-x64.Release/corehost'.%0A   at System.IO.Enumeration.FileSystemEnumerator`1.CreateDirectoryHandle(String path, Boolean ignoreNotFound)%0A   at System.IO.Enumeration.FileSystemEnumerator`1.Init()%0A   at System.IO.Enumeration.FileSystemEnumerable`1..ctor(String directory, FindTransform transform, EnumerationOptions options, Boolean isNormalized)%0A   at System.IO.Enumeration.FileSystemEnumerableFactory.UserFiles(String directory, String expression, EnumerationOptions options)%0A   at System.IO.Directory.InternalEnumeratePaths(String path, String searchPattern, SearchTarget searchTarget, EnumerationOptions options)%0A   at System.IO.Directory.GetFiles(String path, String searchPattern, SearchOption searchOption)%0A   at NuGet.Common.PathResolver.PerformWildcardSearch(String basePath, String searchPath, Boolean includeEmptyDirectories, String& normalizedBasePath)%0A   at NuGet.Packaging.PackageBuilder.ResolveSearchPattern(String basePath, String searchPath, String targetPath, Boolean includeEmptyDirectories)%0A   at NuGet.Packaging.PackageBuilder.AddFiles(String basePath, String source, String destination, String exclude)%0A   at NuGet.Packaging.PackageBuilder.PopulateFiles(String basePath, IEnumerable`1 files)%0A   at Microsoft.DotNet.Build.Tasks.Packaging.NuGetPack.Pack(String nuspecPath, String nupkgPath, Manifest manifest, Boolean packSymbols) in /_/src/Microsoft.DotNet.Build.Tasks.Packaging/src/NuGetPack.cs:line 256
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error : Error when creating nuget lib package from /home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/artifacts/packages/Release/specs/runtime.debian-x64.Microsoft.NETCore.DotNetAppHost.nuspec. System.IO.DirectoryNotFoundException: Could not find a part of the path '/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/artifacts/bin/debian-x64.Release/corehost'. [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at System.IO.Enumeration.FileSystemEnumerator`1.CreateDirectoryHandle(String path, Boolean ignoreNotFound) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at System.IO.Enumeration.FileSystemEnumerator`1.Init() [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at System.IO.Enumeration.FileSystemEnumerable`1..ctor(String directory, FindTransform transform, EnumerationOptions options, Boolean isNormalized) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at System.IO.Enumeration.FileSystemEnumerableFactory.UserFiles(String directory, String expression, EnumerationOptions options) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at System.IO.Directory.InternalEnumeratePaths(String path, String searchPattern, SearchTarget searchTarget, EnumerationOptions options) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at System.IO.Directory.GetFiles(String path, String searchPattern, SearchOption searchOption) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at NuGet.Common.PathResolver.PerformWildcardSearch(String basePath, String searchPath, Boolean includeEmptyDirectories, String& normalizedBasePath) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at NuGet.Packaging.PackageBuilder.ResolveSearchPattern(String basePath, String searchPath, String targetPath, Boolean includeEmptyDirectories) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at NuGet.Packaging.PackageBuilder.AddFiles(String basePath, String source, String destination, String exclude) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at NuGet.Packaging.PackageBuilder.PopulateFiles(String basePath, IEnumerable`1 files) [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]
/home/avatar/src/source-build-3.1.107-SDK/packages/restored/microsoft.dotnet.build.tasks.packaging/1.0.0-beta.20113.5/build/Packaging.targets(1260,5): error :    at Microsoft.DotNet.Build.Tasks.Packaging.NuGetPack.Pack(String nuspecPath, String nupkgPath, Manifest manifest, Boolean packSymbols) in /_/src/Microsoft.DotNet.Build.Tasks.Packaging/src/NuGetPack.cs:line 256 [/home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/src/pkg/projects/Microsoft.NETCore.DotNetAppHost/Microsoft.NETCore.DotNetAppHost.pkgproj]

I can confirm that corehost does not exist under /home/avatar/src/source-build-3.1.107-SDK/artifacts/src/core-setup.fcfdef8d6ba770e4d7ba9efefe2591d8c33a1fc6/artifacts/bin/debian-x64.Release; however, it does exist under a parallel directory named debian.-x64.Release, which seems odd.

Thoughts?

[omajid]

What version of Debian is this? I would have expected the version to be between the . and - in debian.-x64.

[cerebrate]

It's bullseye. My /etc/os-release is as follows:

PRETTY_NAME="Debian GNU/Linux bullseye/sid"
NAME="Debian GNU/Linux"
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

[dagood]

Hmm, yeah, that's "missing" some version variables vs. 9/stretch which we build on routinely in PR validation / CI, and 10/buster:

PRETTY_NAME="Debian GNU/Linux 10 (buster)"
NAME="Debian GNU/Linux"
VERSION_ID="10"
VERSION="10 (buster)"
VERSION_CODENAME=buster
ID=debian
HOME_URL="https://www.debian.org/"
SUPPORT_URL="https://www.debian.org/support"
BUG_REPORT_URL="https://bugs.debian.org/"

(They're optional in the /etc/os-release spec from what I see, but source-build currently needs them so it can end up with a RID like debian.11-x64.)

I think that #297 probably tracks fixing this requirement--in general it tracks broadening how well we support distros that are unknown in similar ways.

@cerebrate do you know if Debian bullseye will get VERSION_ID=11 in its /etc/os-release, perhaps once it becomes more stable?

[cerebrate]

Aha! Well, that's easy enough to fix for now.

And I would presume bullseye would get those fields once it formally ships as Debian 11 and becomes the new stable, as that's what's seemed to happen in the past, but I don't have any inside insight on that. It's a little inconvenient from a packaging point of view, though, because new packages are supposed to be built against testing or unstable, which lack those fields.