Meta-ticket: Fix optional and experimental packages

[mkoeppe]

Broken optional packages (from #29890):

• boost (broken on macOS), database_stein_watkins_mini, texlive (although why anyone would want to install texlive via Sage is baffling to me).
  broken experimental packages:
• The experimental packages are even worse: I tried most of them, and only one (compilerwrapper) succeeded.

Also broken:

• cryptominisat on Ubuntu 20.04 - https://groups.google.com/d/msg/sage-devel/e53fr1CObk8/dLFTqxHeBgAJ
• Fix spkg-install of p_group_cohomology #28711, package modular_resolution: Split out from p_group_cohomology #30787 - p_group_cohomology
• Upgrade symengine, symengine_py, fix build #34141 - symengine_py
• Update isl + polylib + barvinok packages #33758 - polylib

Downgrading what's broken:

• Downgrade broken optional packages to experimental for Sage 9.2 #30349 - Downgrade broken optional packages to experimental for Sage 9.2
• Downgrade some optional packages to experimental in Sage 9.7 #34291 - Downgrade some optional packages to experimental in Sage 9.7

Tickets for optional packages:

• database_stein_watkins_mini installation is broken #29897 - database_stein_watkins_mini
• Update e-antic to 0.1.8 #30262 - e_antic 0.1.8
• upgrade Normaliz to 3.8.8, PyNormaliz to 2.12, add script package libnauty #27952: upgrade Normaliz to 3.8.8, PyNormaliz to 2.12, install nauty header/library
• Optional package deformation fails to build: mpir.h not found #30325 - Optional package deformation fails to build: mpir.h not found
• Move giacpy_sage into sage source code #29171/Add ipywidgets as a dependency to packages using the sage doctester #30324 - giacpy_sage
• Upgrade cryptominisat to 5.8.0, fix build on Cygwin #25374 - cryptominisat
• Update FriCAS to 1.3.6 #27309 - Update FriCAS to 1.3.6
• Upgrade: boost_cropped 1.78.0 #31250 - boost, boost_cropped: Update

Tickets for experimental packages:

• Remove autotools SPKG #29174 - Remove autotools SPKG
• Remove broken experimental package scons #30155 - Remove broken experimental package scons
• Remove broken experimental package gambit #30156 - Remove broken experimental package gambit
• Reduce outdated gdb and valgrind packages to dummy script packages #30158 - Update gdb package
• Upgrade polymake to 4.3 #28435 - Upgrade polymake to 4.0r1, jupymake to ...

Tickets for mutually exclusive standard packages:

• Upgrade ATLAS to version 3.11.38 #19719/Remove ATLAS #30350 - ATLAS

Supporting tickets:

• .github/workflows/: Test all optional packages, add workflow for testing all experimental packages #29901: .github/workflows/: Test all optional packages, add workflow for testing all experimental packages
• Drop support for optional packages with system gcc 4.x on ubuntu-trusty, debian-jessie, linuxmint-17, centos-7 #31526: Drop support for optional packages on ubuntu-trusty, debian-jessie, linuxmint-17, centos-7
• GH Actions: tox-optional.yml: Remove misleading error messages regarding optional script packages #31522: GH Actions: tox-optional.yml: Remove misleading error messages regarding optional script packages

See also:

• Open non-wishlist tickets on optional/experimental packages
• texlive package: Fix installs for existing, root-owned texlive #21922: texlive package: Fix installs for existing, root-owned texlive
• Fix or disable failing package testsuites (spkg-check) #29322: Fix or disable failing package testsuites (spkg-check)
• meta-ticket: failing internet/optional doctests #25536 meta-ticket: failing internet/optional doctests

Depends on #29901

CC: @jhpalmieri @kliem @slel @fchapoton @DRKWang

Component: packages: optional

Issue created by migration from https://trac.sagemath.org/ticket/29900

[seblabbe]

comment:8

added a link to #25536 in the see-also section of description.

[mkoeppe]

Dependencies: #29901

[mkoeppe]

comment:11

Tests for experimental packages at ​https://github.com/mkoeppe/sage/actions/runs/170318716

Tests for optional packages at ​https://github.com/mkoeppe/sage/actions/runs/170362341

(from #29901)

[mkoeppe]

comment:17

Run of optional packages in 9.2.beta6 at https://github.com/sagemath/sage/actions/runs/182648184