Agent SSL, new options, change defaults

• opscenter/install.sh:
  • default v6.5.3
  • agent SSL on by default
• lcm/addNode.py: optional --nograph flag, disables graph workload for DC created by first node up.
• lcm/setupCluster.py: change default values for num_tokens, allocate_tokens_for_local_replication_factor, compaction_throughput_mb_per_sec
• os/os.sh: takes $cloud_type arg (currently only azure, else no-op), change some OS settings

7.1.0

• alterKeyspaces.py, default behavior unchanged
  • add optional --nodesync flag, enables nodesync on all system keyspaces except system_auth and Opscenter
  • add optional --norepair flag, skips all repairs
  • add optional --verbose flag
  • add optional --delay X argument, delays all operations by X sec
  • better diagnostic messages
• setupCluster.py, default behavior unchanged
  • add optional --nojava flag, tells LCM to not install java or manage JCE, allows use of OpenJDK which requires install in caller shell
  • add optional --aoss flag, enables AOSS in config profile, note experimental
  • --verbose flag not a no-op
• waitForJobs.py, add job state WILL_FAIL in status check to stop early exit
• opscenter/install.sh, default version to 6.5.2, still overrideable
• os/install_java.sh, add optional -o flag to install OpenJDK 8 with running apt/dpkg check
• os/extra_packages.sh, add sysstat, zip

Add timeout in `alterKeyspaces.py`

• Timeout (30s) added to alterKeyspaces.py to unblock/continue with longer running repairs. No changes to caller shell.

Bugfix for alterKeyspaces.py, dsefs paths

• repair calls in alterKeyspaces.py now block until repair is not in running state
• move dsefs paths under datadir argument passed to setupCluster.py

Repair calls in alterKeyspaces.py

Add explicit repair calls to OpsC API in alterKeyspaces.py

Versions to DSE 6.0.0, OpsC 6.5.0, LCM API v2

Refactoring python scripts for new versions. Changes to script arguments require changes in calling shell.

• DSE to 6.0.0, python and shell
• OpsC to 6.5.0, python calls to LCM API v2
• setupCluster.py:
  • added required arg --dbpasswd
  • added optional arg --config (experimental)
  • added optional arg --becomepw
• triggerInstall.py:
  • removed required arg --dbpasswd
• changes to data posted for node, cluster existence logic, error parsing (internal)

LCM scripts understand https/auth

Significant refactoring of the LCM scripts so that they can call into OpsC if https/auth enabled (still function with http/no-auth).

• can now call opscenter/set_opsc_pw_https.sh immediately after install and not wait until waitForJobs returns.
• all scripts take optional --opscuser/--opscpw args with default admin/admin. Correct password must be passed if auth enable and pw changed.
• all scripts (except addNode) have optional --opsc-ip that defaults to 127.0.0.1
• module methods moved into OpsCenter class to save state (ie pw and session token)
• general cleanup/linting

Update default versions

• setupCluster.py DSE version default to 5.1.6
• install_java.sh -m manual java install to 8u162
• dse/install.sh to 5.1.6 agent to 6.1.5

apt and OpsC pw bug fixes

• checks for running apt/dpkg procs to avoid issues where unattended-upgrades is running on start
• new extra_packages.sh script, no need for apt calls in template shell
• fix for race condition setting OpsC pw in set_opsc_pw_https.sh

OpsC update, manual Java install update

• OpsCenter default install version to 6.1.5 in bin/opscenter/install.sh
• install_java.sh -m tar/manual install of java to version jdk1.8.0_152