Uploaded image for project: 'CORD'
  1. CORD
  2. CORD-2735

preppedpod broken with SSL error

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Resolved (View Workflow)
    • Priority: Medium
    • Resolution: Fixed
    • Affects Version/s: 6.0
    • Fix Version/s: None
    • Component/s: Build System, OpenStack
    • Labels:
      None

      Description

      Errors like this when trying to run the e2e on master:

      2018-02-14 16:37:47.975 28455 ERROR nova.compute.manager [req-9c017cb6-3e5e-4d89-a249-be7d0f76aaf5 - - - - -] [instance: c9f202a5-d603-48f0-b360-ee8acaa51417] An error occurred while refreshing the network cache.
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417] Traceback (most recent call last):
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 5690, in _heal_instance_info_cache
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     self._get_instance_nw_info(context, instance)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1383, in _get_instance_nw_info
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     return self.network_api.get_instance_nw_info(context, instance)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 747, in get_instance_nw_info
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     preexisting_port_ids)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 763, in _get_instance_nw_info
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     preexisting_port_ids)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 1515, in _build_network_info_model
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     client = get_client(context, admin=True)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/nova/network/neutronv2/api.py", line 205, in get_client
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     auth_token = _ADMIN_AUTH.get_token(_SESSION)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/keystoneclient/auth/identity/base.py", line 104, in get_token
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     return self.get_access(session).auth_token
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/keystoneclient/auth/identity/base.py", line 144, in get_access
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     self.auth_ref = self.get_auth_ref(session)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/keystoneclient/auth/identity/v2.py", line 78, in get_auth_ref
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     authenticated=False, log=False)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py", line 488, in post
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     return self.request(url, 'POST', **kwargs)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/keystoneclient/utils.py", line 318, in inner
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     return func(*args, **kwargs)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py", line 374, in request
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     resp = send(**kwargs)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]   File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py", line 411, in _send_request
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417]     raise exceptions.SSLError(msg)
      2018-02-14 16:37:47.975 28455 TRACE nova.compute.manager [instance: c9f202a5-d603-48f0-b360-ee8acaa51417] SSLError: SSL exception connecting to https://keystone.cord.lab:35357/v2.0/tokens
      

      Fix appears to be to remove the updated `requests` library, which is in the code, but installing docker on the comptue node seems to re-update it.

      This likely won't be an issue once we get to 16.04/new openstack

        Attachments

          Activity

            People

            Assignee:
            zdw Zack Williams
            Reporter:
            zdw Zack Williams
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved:

                Gerrit Reviews

                There are no open Gerrit changes