periodic-software-upgrade-test-bbsim: failure traige

Problems reported while running a regression testing job on Gustavo(s) patch.

This Jira ticket is for high-level triage, open sub-tasks for problems if needed.

Question  why did this job continue on, it should have failed hard/early on any of these failures.

job # 1008

 
10:54:12 W1104 15:54:12.297735 3688 loader.go:223] Config not found: /home/jenkins/.kube/kind-config-voltha-minimal*10:54:12* W1104 15:54:12.297912 3688 loader.go:223] Config not found: /home/jenkins/.kube/kind-config-voltha-minimal*10:54:12* Error: Kubernetes cluster unreachable: Get "http://localhost:8080/version?timeout=32s": dial tcp 127.0.0.1:8080: connect: connection refused
 
11:01:22 ==============================================================================11:01:22 ONOS AppsUpgrade :: Test ONOS Apps Software Upgrade 11:01:22 ==============================================================================11:01:22 11:01:22 Sadis File:None*11:06:45* Test ONOS App Minor Version Upgrade :: Validates the ONOS App Mino... | FAIL |11:06:45 Keyword 'Perform Sanity Test' failed after retrying for 1 minute. The last error was: Keyword 'Verify Meters in ONOS' failed after retrying for 1 minute. The last error was: SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer
 
11:06:45 Also teardown failed:11:06:45 Several failures occurred:
 
11:06:45 ONOS AppsUpgrade :: Test ONOS Apps Software Upgrade | FAIL |11:06:45 1 critical test, 0 passed, 1 failed*11:06:45* 1 test total, 0 passed, 1 failed*11:06:45* ==============================================================================
CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.11:06:45 from cryptography.hazmat.backends import default_backend*11:06:45* Makefile:663: recipe for target 'software-upgrade-test' failed
 
11:18:04 ==============================================================================11:18:04 Voltha ComponentsUpgrade :: Test Voltha Components Software Upgrade 11:18:04 ==============================================================================11:18:05 11:18:05 Sadis File:None*11:22:12* Test Voltha Components Minor Version Rolling Upgrade :: Validates ... ERROR: UNAVAILABLE: timed out waiting for server handshake*11:22:31* ERROR: UNAVAILABLE: timed out waiting for server handshake*11:22:49* ERROR: UNAVAILABLE: timed out waiting for server handshake*11:26:12* | FAIL |11:26:12 "Error while fetching device list from VOLTHA": 1 != 0*11:26:12* 11:26:12 Also teardown failed:11:26:12 Several failures occurred:11:26:12 11:26:12 1) Keyword 'Test Empty Device List' failed after retrying for 1 minute. The last error was: Several failures occurred: