Notes: building skare3 static packages for shiny

Linux

On Linux, I didn't have success using the 'perl' 5.26.2 packages from the defaults channel to build and install other perl packages so I updated the package build recipes to use perl from conda-forge explicitly.

conda activate ska-builder
cd ~/git/skare3-static

# Build all packages
python build.py --build-root localbuild all

# Now that we have a local repo, just grab that conda-forge perl and stick it there for future work
cd localbuild/builds/linux-64
wget https://conda.anaconda.org/conda-forge/linux-64/perl-5.26.2-h516909a_1006.tar.bz2
cd ../..
conda index builds
cd ..

# Build a temp test environment using the local perl packages and shiny
conda create -n shiny-tmp -c file://$PWD/localbuild/builds -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny -c defaults -c conda-forge ska3-flight-latest ska3-core-latest perl-app-cpanminus perl-core-deps perl-ska-classic xtime perl-extended-deps perl-chandra-time perl-cxc-sysarch perl-ska-convert perl-ska-web perl-ska-agasc perl-app-env-ascds perl-dbd-sybase perl-tk

cd ~/skare3
conda activate shiny-tmp
#(at this point, not sure why conda was mad at me, but I couldn't get the shiny-tmp python in my path:
#(shiny-tmp) jeanconn-fido> echo $CONDA_PREFIX
#/fido.real/conda_4.8.3_py38/envs/shiny-tmp
#(shiny-tmp) jeanconn-fido> which python
#/fido.real/conda_4.8.3_py38/bin/python
#But python clearly in my shiny-tmp environment.  So I started a new terminal)

rm -rf repo-shiny  
python upload_packages.py --repo-dir repo-shiny
conda index repo-shiny
conda create -n test-test  --dry-run --override-channels -c file://$PWD/repo-shiny ska3-flight-latest ska3-core-latest perl-app-cpanminus perl-core-deps perl-ska-classic xtime perl-extended-deps perl-chandra-time perl-cxc-sysarch perl-ska-convert perl-ska-web perl-ska-agasc perl-app-env-ascds perl-dbd-sybase perl-tk

# I had trouble with the sftp of upload_packages so manually did this locally on my fido machine
su aca
source ~jeanconn/conda.init
conda activate shiny-tmp
python upload_packages.py --repo-dir=/proj/sot/ska/www/ASPECT_ICXC/ska3conda/shiny_plus_perl

#as aca user on kady
/export/tom/miniconda37/bin/conda index /proj/sot/ska/www/ASPECT_ICXC/ska3-conda/shiny_plus_perl

# Make a new shiny use the primary repo
conda create -n ska3-shiny --override-channels -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny

conda activate ska3-shiny

conda install --override-channels -c https://icxc.harvard.edu/aspect/ska3-conda/shiny  -c https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl perl-app-cpanminus perl-core-deps perl-ska-classic xtime perl-extended-deps perl-chandra-time perl-cxc-sysarch perl-ska-convert perl-ska-web perl-ska-agasc perl-app-env-ascds perl-dbd-sybase perl-tk

It looks like the environment has 2 package updates from conda-forge that are somewhat unexpected but probably benign. Not sure about the package resolution printing at the beginning

Collecting package metadata (current_repodata.json): done
Solving environment: / 
Warning: >10 possible package resolutions (only showing differing packages):
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0
  - https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::intel-openmp-2020.1-217, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::ld_impl_linux-64-2.33.1-h53a641e_7, https://icxc.cfa.harvard.edu/aspect/ska3-conda/shiny/linux-64::pandoc-2.10-0, https://icxc.harvard.edu/aspect/ska3-conda/shiny/linux-64::ripgrep-11.0.2-he32d670_0
  ... and othedone

## Package Plan ##

  environment location: /fido.real/conda_4.8.3_py38/envs/ska3-shiny

  added / updated specs:
    - perl-app-cpanminus
    - perl-app-env-ascds
    - perl-chandra-time
    - perl-core-deps
    - perl-cxc-sysarch
    - perl-dbd-sybase
    - perl-extended-deps
    - perl-ska-agasc
    - perl-ska-classic
    - perl-ska-convert
    - perl-ska-web
    - perl-tk
    - xtime


The following packages will be downloaded:

    package                    |            build
    ---------------------------|-----------------
    _sysroot_linux-64_curr_repodata_hack-3|       ha9d2b57_9           6 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    cfitsio-3.470              |       hf0d0db6_5         833 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    fontconfig-2.13.1          |    he4413a7_1000         327 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    gsl-2.4                    |       h14c3975_4         1.8 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    kernel-headers_linux-64-3.10.0|       h77966d4_9         944 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    krb5-1.18.2                |       h173b8e3_0         1.3 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    libcurl-7.71.1             |       h20c2e04_1         305 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    libssh2-1.9.0              |       h1ba5d50_1         269 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    libuuid-2.32.1             |    h14c3975_1000          26 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    libx11-common-cos7-x86_64-1.6.7|    ha826a6f_1103         138 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    libx11-cos7-x86_64-1.6.7   |    ha826a6f_1103         754 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    libx11-devel-cos7-x86_64-1.6.7|    ha826a6f_1103         926 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-5.26.2                |    h516909a_1006        15.4 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-app-cpanminus-1.7044  |          pl526_0         233 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-app-env-ascds-0.04    |          pl526_0           7 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-chandra-time-0.9.2    |  pl526h6bb024c_0          13 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-core-deps-0.3         |py38pl526hf484d3e_0         1.3 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-cxc-sysarch-1.00      |          pl526_0          21 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-dbd-sybase-1.15       |  pl526h14c3975_0         100 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-extended-deps-0.1     |  pl526hf484d3e_0        10.7 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-ska-agasc-3.5.0       |          pl526_1          12 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-ska-classic-0.6       |          pl526_0         7.8 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-ska-convert-4.3       |          pl526_1           7 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-ska-web-4.0           |          pl526_0           8 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    perl-tk-804.035            |  pl526hf484d3e_0         2.0 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    pkg-config-0.29.2          |       h1bed415_8         245 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    sysroot_linux-64-2.17      |       h77966d4_9        32.5 MB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    xorg-kbproto-1.0.7         |    h14c3975_1002          26 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    xorg-libx11-1.6.9          |       h516909a_0         918 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    xorg-libxft-2.3.3          |       h71203ad_0          54 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    xorg-libxrender-0.9.10     |    h516909a_1002          31 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    xorg-renderproto-0.11.1    |    h14c3975_1002           8 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    xorg-xproto-7.0.31         |    h14c3975_1007          72 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    xtime-1.2.2                |       h6bb024c_0          45 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    zip-3.0                    |       h1adfe0e_0         114 KB  https://icxc.harvard.edu/aspect/ska3-conda/shiny_plus_perl
    ------------------------------------------------------------
                                           Total:        79.1 MB

The following NEW packages will be INSTALLED:

  _sysroot_linux-64~ aspect/ska3-conda/shiny_plus_perl/noarch::_sysroot_linux-64_curr_repodata_hack-3-ha9d2b57_9
  cfitsio            aspect/ska3-conda/shiny_plus_perl/linux-64::cfitsio-3.470-hf0d0db6_5
  gsl                aspect/ska3-conda/shiny_plus_perl/linux-64::gsl-2.4-h14c3975_4
  kernel-headers_li~ aspect/ska3-conda/shiny_plus_perl/noarch::kernel-headers_linux-64-3.10.0-h77966d4_9
  krb5               aspect/ska3-conda/shiny_plus_perl/linux-64::krb5-1.18.2-h173b8e3_0
  libcurl            aspect/ska3-conda/shiny_plus_perl/linux-64::libcurl-7.71.1-h20c2e04_1
  libssh2            aspect/ska3-conda/shiny_plus_perl/linux-64::libssh2-1.9.0-h1ba5d50_1
  libx11-common-cos~ aspect/ska3-conda/shiny_plus_perl/noarch::libx11-common-cos7-x86_64-1.6.7-ha826a6f_1103
  libx11-cos7-x86_64 aspect/ska3-conda/shiny_plus_perl/noarch::libx11-cos7-x86_64-1.6.7-ha826a6f_1103
  libx11-devel-cos7~ aspect/ska3-conda/shiny_plus_perl/noarch::libx11-devel-cos7-x86_64-1.6.7-ha826a6f_1103
  perl               aspect/ska3-conda/shiny_plus_perl/linux-64::perl-5.26.2-h516909a_1006
  perl-app-cpanminus aspect/ska3-conda/shiny_plus_perl/linux-64::perl-app-cpanminus-1.7044-pl526_0
  perl-app-env-ascds aspect/ska3-conda/shiny_plus_perl/linux-64::perl-app-env-ascds-0.04-pl526_0
  perl-chandra-time  aspect/ska3-conda/shiny_plus_perl/linux-64::perl-chandra-time-0.9.2-pl526h6bb024c_0
  perl-core-deps     aspect/ska3-conda/shiny_plus_perl/linux-64::perl-core-deps-0.3-py38pl526hf484d3e_0
  perl-cxc-sysarch   aspect/ska3-conda/shiny_plus_perl/linux-64::perl-cxc-sysarch-1.00-pl526_0
  perl-dbd-sybase    aspect/ska3-conda/shiny_plus_perl/linux-64::perl-dbd-sybase-1.15-pl526h14c3975_0
  perl-extended-deps aspect/ska3-conda/shiny_plus_perl/linux-64::perl-extended-deps-0.1-pl526hf484d3e_0
  perl-ska-agasc     aspect/ska3-conda/shiny_plus_perl/linux-64::perl-ska-agasc-3.5.0-pl526_1
  perl-ska-classic   aspect/ska3-conda/shiny_plus_perl/linux-64::perl-ska-classic-0.6-pl526_0
  perl-ska-convert   aspect/ska3-conda/shiny_plus_perl/linux-64::perl-ska-convert-4.3-pl526_1
  perl-ska-web       aspect/ska3-conda/shiny_plus_perl/linux-64::perl-ska-web-4.0-pl526_0
  perl-tk            aspect/ska3-conda/shiny_plus_perl/linux-64::perl-tk-804.035-pl526hf484d3e_0
  pkg-config         aspect/ska3-conda/shiny_plus_perl/linux-64::pkg-config-0.29.2-h1bed415_8
  sysroot_linux-64   aspect/ska3-conda/shiny_plus_perl/noarch::sysroot_linux-64-2.17-h77966d4_9
  xorg-kbproto       aspect/ska3-conda/shiny_plus_perl/linux-64::xorg-kbproto-1.0.7-h14c3975_1002
  xorg-libx11        aspect/ska3-conda/shiny_plus_perl/linux-64::xorg-libx11-1.6.9-h516909a_0
  xorg-libxft        aspect/ska3-conda/shiny_plus_perl/linux-64::xorg-libxft-2.3.3-h71203ad_0
  xorg-libxrender    aspect/ska3-conda/shiny_plus_perl/linux-64::xorg-libxrender-0.9.10-h516909a_1002
  xorg-renderproto   aspect/ska3-conda/shiny_plus_perl/linux-64::xorg-renderproto-0.11.1-h14c3975_1002
  xorg-xproto        aspect/ska3-conda/shiny_plus_perl/linux-64::xorg-xproto-7.0.31-h14c3975_1007
  xtime              aspect/ska3-conda/shiny_plus_perl/linux-64::xtime-1.2.2-h6bb024c_0
  zip                aspect/ska3-conda/shiny_plus_perl/linux-64::zip-3.0-h1adfe0e_0

The following packages will be UPDATED:

  fontconfig         aspect/ska3-conda/shiny::fontconfig-2~ --> aspect/ska3-conda/shiny_plus_perl::fontconfig-2.13.1-he4413a7_1000
  libuuid            aspect/ska3-conda/shiny::libuuid-1.0.~ --> aspect/ska3-conda/shiny_plus_perl::libuuid-2.32.1-h14c3975_1000

OSX

To build the skare3-static packages for the shiny release on an OSX Catalina machine, there are presently some manual steps:

1. get a copy of the MacOS SDK per Anaconda compiler notes
   1. I used the MacOSX10.9.sdk
   2. I just tried to follow the directions here but am not entirely sure this SDK is used/respected.
2. put the SDK in the path that matches the conda_build_config.yaml path (or update path in those files in xtime, perl-core-deps, and perl-chandra-time recipe directories)