DAOS-16484 test: Support mixed speeds when selecting a default interf…

[phender]

…ace (#15050)

Allow selecting a default interface that is running at a different speed on different hosts. Primarily this is to support selecting the ib0 interface by default when the launch node has a slower ib0 interface than the cluster hosts.

Skip-unit-tests: true
Skip-fault-injection-test: true
Test-tag: test_setup test_setup_vm

Before requesting gatekeeper:

• Two review approvals and any prior change requests have been resolved.
• Testing is complete and all tests passed or there is a reason documented in the PR why it should be force landed and forced-landing tag is set.
• Features: (or Test-tag*) commit pragma was used or there is a reason documented that there are no appropriate tags for this PR.
• Commit messages follows the guidelines outlined here.
• Any tests skipped by the ticket being addressed have been run and passed in the PR.

Gatekeeper:

• You are the appropriate gatekeeper to be landing the patch.
• The PR has 2 reviews by people familiar with the code, including appropriate owners.
• Githooks were used. If not, request that user install them and check copyright dates.
• Checkpatch issues are resolved. Pay particular attention to ones that will show up on future PRs.
• All builds have passed. Check non-required builds for any new compiler warnings.
• Sufficient testing is done. Check feature pragmas and test tags and that tests skipped for the ticket are run and now pass with the changes.
• If applicable, the PR has addressed any potential version compatibility issues.
• Check the target branch. If it is master branch, should the PR go to a feature branch? If it is a release branch, does it have merge approval in the JIRA ticket.
• Extra checks if forced landing is requested
  • Review comments are sufficiently resolved, particularly by prior reviewers that requested changes.
  • No new NLT or valgrind warnings. Check the classic view.
  • Quick-build or Quick-functional is not used.
• Fix the commit message upon landing. Check the standard here. Edit it to create a single commit. If necessary, ask submitter for a new summary.

[github-actions]

Ticket title is 'Mixed speed ib0 addapters results in eth0 being selected '
Status is 'In Review'
Labels: 'scrubbed_2.8'
Job should run at elevated priority (1)
https://daosio.atlassian.net/browse/DAOS-16484

[phender]

Fix proven in HW Large stage:

2024/09/06 02:46:46 DEBUG             _default_interface: Detecting network devices - D_INTERFACE not set
2024/09/06 02:46:46 DEBUG                     run_remote: Running on wolf-[304,318-325] with a 120 second timeout: grep -l 'up' /sys/class/net/*/operstate | grep -Ev '/(lo|bond)/' | sort
2024/09/06 02:46:47 DEBUG                log_result_data:   wolf-304 (rc=0):
2024/09/06 02:46:47 DEBUG                log_result_data:     /sys/class/net/eth0/operstate
2024/09/06 02:46:47 DEBUG                log_result_data:     /sys/class/net/ib0/operstate
2024/09/06 02:46:47 DEBUG                log_result_data:   wolf-[318-325] (rc=0):
2024/09/06 02:46:47 DEBUG                log_result_data:     /sys/class/net/eth0/operstate
2024/09/06 02:46:47 DEBUG                log_result_data:     /sys/class/net/ib0/operstate
2024/09/06 02:46:47 DEBUG                log_result_data:     /sys/class/net/ib1/operstate
2024/09/06 02:46:47 INFO           get_common_interfaces: Active network interfaces detected:
2024/09/06 02:46:47 INFO           get_common_interfaces:   - eth0     on wolf-[304,318-325] (Common=True)
2024/09/06 02:46:47 INFO           get_common_interfaces:   - ib0      on wolf-[304,318-325] (Common=True)
2024/09/06 02:46:47 INFO           get_common_interfaces:   - ib1      on wolf-[318-325] (Common=False)
2024/09/06 02:46:47 DEBUG                     run_remote: Running on wolf-[304,318-325] with a 120 second timeout: cat /sys/class/net/eth0/speed
2024/09/06 02:46:47 DEBUG                log_result_data:   wolf-[304,318-325] (rc=0): 1000
2024/09/06 02:46:47 DEBUG                     run_remote: Running on wolf-[304,318-325] with a 120 second timeout: cat /sys/class/net/ib0/speed
2024/09/06 02:46:47 DEBUG                log_result_data:   wolf-304 (rc=0): 100000
2024/09/06 02:46:47 DEBUG                log_result_data:   wolf-[318-325] (rc=0): 200000
2024/09/06 02:46:47 INFO           get_fastest_interface: Active network interface speeds on wolf-[304,318-325]:
2024/09/06 02:46:47 INFO           get_fastest_interface:   - eth0     (speed:   1000)
2024/09/06 02:46:47 INFO           get_fastest_interface:   - ib0      (speed: 100000)
2024/09/06 02:46:47 INFO           get_fastest_interface: Available interfaces on wolf-[304,318-325]: {1000: 'eth0', 100000: 'ib0'}
2024/09/06 02:46:47 INFO           get_fastest_interface: Fastest interface detected on wolf-[304,318-325]: ib0

Stopped https://build.hpdd.intel.com/job/daos-stack/job/daos/job/PR-15080/1/ as the HW Medium run wasn't required.