[SEBA-792] OLT stuck activating - OpenCORD JIRA

XML

Word

Printable

Details

Type: Bug
Status: To Do (View Workflow)
Priority: Medium
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: Future
Component/s: ONOS & Apps
Labels:
None
Environment:

Hide

root@sbat1:/home/user1/volt2# kubectl describe pods --all-namespaces | grep Image:
Image: xosproject/att-workflow-driver-synchronizer:1.2.3
Image: xosproject/tosca-loader:1.3.1
Image: busybox:latest
Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
Image: busybox:latest
Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
Image: busybox:latest
Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
Image: busybox:latest
Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4
Image: quay.io/coreos/etcd-operator:v0.9.3
Image: quay.io/coreos/etcd-operator:v0.9.3
Image: quay.io/coreos/etcd-operator:v0.9.3
Image: kiwigrid/k8s-sidecar:0.0.3
Image: grafana/grafana:5.1.3
Image: confluentinc/cp-kafka:5.0.1
Image: docker.elastic.co/kibana/kibana-oss:6.5.4
Image: docker.elastic.co/kibana/kibana-oss:6.5.4
Image: docker.elastic.co/logstash/logstash-oss:6.5.4
Image: onosproject/onos:1.13.9
Image: docker.elastic.co/beats/filebeat-oss:6.4.2
Image: prom/alertmanager:v0.15.0
Image: jimmidyson/configmap-reload:v0.2.2
Image: quay.io/coreos/kube-state-metrics:v1.3.1
Image: prom/node-exporter:v0.16.0
Image: prom/node-exporter:v0.16.0
Image: prom/node-exporter:v0.16.0
Image: prom/pushgateway:v0.5.2
Image: busybox:latest
Image: jimmidyson/configmap-reload:v0.2.2
Image: prom/prometheus:v2.3.1
Image: gcr.io/google_samples/k8szk:v3
Image: busybox:1.28.1-glibc
Image: quay.io/coreos/etcd:v3.2.18
Image: opencord/kafka-topic-exporter:1.2.3
Image: opencord/kafka-topic-exporter:1.2.3
Image: opencord/sadis-server:1.1.0
Image: xosproject/tosca-loader:1.3.1
Image: xosproject/fabric-synchronizer:2.2.2
Image: xosproject/fabric-crossconnect-synchronizer:1.2.2
Image: xosproject/kubernetes-synchronizer:1.3.1
Image: xosproject/onos-synchronizer:2.1.2
Image: xosproject/rcord-synchronizer:1.3.2
Image: xosproject/tosca-loader:1.3.1
Image: xosproject/volt-synchronizer:2.2.4
Image: xosproject/chameleon:3.3.0
Image: xosproject/xos-core:3.3.1
Image: postgres:10.3-alpine
Image: xosproject/xos-gui:1.0.6
Image: xosproject/xos-tosca:1.3.0
Image: xosproject/xos-rest-gw:2.0.2
Image: docker.io/calico/kube-controllers:v3.4.0
Image: docker.io/calico/cni:v3.4.0
Image: docker.io/calico/node:v3.4.0
Image: docker.io/calico/cni:v3.4.0
Image: docker.io/calico/node:v3.4.0
Image: docker.io/calico/cni:v3.4.0
Image: docker.io/calico/node:v3.4.0
Image: docker.io/coredns/coredns:1.5.0
Image: docker.io/coredns/coredns:1.5.0
Image: k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0
Image: gcr.io/google-containers/kube-apiserver:v1.14.3
Image: gcr.io/google-containers/kube-apiserver:v1.14.3
Image: gcr.io/google-containers/kube-apiserver:v1.14.3
Image: gcr.io/google-containers/kube-controller-manager:v1.14.3
Image: gcr.io/google-containers/kube-controller-manager:v1.14.3
Image: gcr.io/google-containers/kube-controller-manager:v1.14.3
Image: gcr.io/google-containers/kube-proxy:v1.14.3
Image: gcr.io/google-containers/kube-proxy:v1.14.3
Image: gcr.io/google-containers/kube-proxy:v1.14.3
Image: gcr.io/google-containers/kube-scheduler:v1.14.3
Image: gcr.io/google-containers/kube-scheduler:v1.14.3
Image: gcr.io/google-containers/kube-scheduler:v1.14.3
Image: gcr.io/google_containers/kubernetes-dashboard-amd64:v1.10.1
Image: k8s.gcr.io/k8s-dns-node-cache:1.15.1
Image: k8s.gcr.io/k8s-dns-node-cache:1.15.1
Image: k8s.gcr.io/k8s-dns-node-cache:1.15.1
Image: gcr.io/kubernetes-helm/tiller:v2.13.1
Image: gcr.io/google_containers/defaultbackend:1.4
Image: tpdock/freeradius:2.2.9
Image: voltha/voltha-netconf:1.7.0
Image: alpine:3.6
Image: quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.10.2
Image: voltha/voltha-ofagent:1.7.0
Image: voltha/voltha-cli:1.7.0
Image: voltha/voltha-voltha:1.7.0
Image: voltha/voltha-envoy:1.7.0
root@sbat1:/home/user1/volt2# kubeadm version
kubeadm version: &version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.3", GitCommit:"5e53fd6bc17c0dec8434817e69b04a25d8ae0ff0", GitTreeState:"clean", BuildDate:"2019-06-06T01:41:54Z", GoVersion:"go1.12.5", Compiler:"gc", Platform:"linux/amd64"}

Show
root@sbat1:/home/user1/volt2# kubectl describe pods --all-namespaces | grep Image: Image: xosproject/att-workflow-driver-synchronizer:1.2.3 Image: xosproject/tosca-loader:1.3.1 Image: busybox:latest Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4 Image: busybox:latest Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4 Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4 Image: busybox:latest Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4 Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4 Image: busybox:latest Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4 Image: docker.elastic.co/elasticsearch/elasticsearch-oss:6.5.4 Image: quay.io/coreos/etcd-operator:v0.9.3 Image: quay.io/coreos/etcd-operator:v0.9.3 Image: quay.io/coreos/etcd-operator:v0.9.3 Image: kiwigrid/k8s-sidecar:0.0.3 Image: grafana/grafana:5.1.3 Image: confluentinc/cp-kafka:5.0.1 Image: docker.elastic.co/kibana/kibana-oss:6.5.4 Image: docker.elastic.co/kibana/kibana-oss:6.5.4 Image: docker.elastic.co/logstash/logstash-oss:6.5.4 Image: onosproject/onos:1.13.9 Image: docker.elastic.co/beats/filebeat-oss:6.4.2 Image: prom/alertmanager:v0.15.0 Image: jimmidyson/configmap-reload:v0.2.2 Image: quay.io/coreos/kube-state-metrics:v1.3.1 Image: prom/node-exporter:v0.16.0 Image: prom/node-exporter:v0.16.0 Image: prom/node-exporter:v0.16.0 Image: prom/pushgateway:v0.5.2 Image: busybox:latest Image: jimmidyson/configmap-reload:v0.2.2 Image: prom/prometheus:v2.3.1 Image: gcr.io/google_samples/k8szk:v3 Image: busybox:1.28.1-glibc Image: quay.io/coreos/etcd:v3.2.18 Image: opencord/kafka-topic-exporter:1.2.3 Image: opencord/kafka-topic-exporter:1.2.3 Image: opencord/sadis-server:1.1.0 Image: xosproject/tosca-loader:1.3.1 Image: xosproject/fabric-synchronizer:2.2.2 Image: xosproject/fabric-crossconnect-synchronizer:1.2.2 Image: xosproject/kubernetes-synchronizer:1.3.1 Image: xosproject/onos-synchronizer:2.1.2 Image: xosproject/rcord-synchronizer:1.3.2 Image: xosproject/tosca-loader:1.3.1 Image: xosproject/volt-synchronizer:2.2.4 Image: xosproject/chameleon:3.3.0 Image: xosproject/xos-core:3.3.1 Image: postgres:10.3-alpine Image: xosproject/xos-gui:1.0.6 Image: xosproject/xos-tosca:1.3.0 Image: xosproject/xos-rest-gw:2.0.2 Image: docker.io/calico/kube-controllers:v3.4.0 Image: docker.io/calico/cni:v3.4.0 Image: docker.io/calico/node:v3.4.0 Image: docker.io/calico/cni:v3.4.0 Image: docker.io/calico/node:v3.4.0 Image: docker.io/calico/cni:v3.4.0 Image: docker.io/calico/node:v3.4.0 Image: docker.io/coredns/coredns:1.5.0 Image: docker.io/coredns/coredns:1.5.0 Image: k8s.gcr.io/cluster-proportional-autoscaler-amd64:1.4.0 Image: gcr.io/google-containers/kube-apiserver:v1.14.3 Image: gcr.io/google-containers/kube-apiserver:v1.14.3 Image: gcr.io/google-containers/kube-apiserver:v1.14.3 Image: gcr.io/google-containers/kube-controller-manager:v1.14.3 Image: gcr.io/google-containers/kube-controller-manager:v1.14.3 Image: gcr.io/google-containers/kube-controller-manager:v1.14.3 Image: gcr.io/google-containers/kube-proxy:v1.14.3 Image: gcr.io/google-containers/kube-proxy:v1.14.3 Image: gcr.io/google-containers/kube-proxy:v1.14.3 Image: gcr.io/google-containers/kube-scheduler:v1.14.3 Image: gcr.io/google-containers/kube-scheduler:v1.14.3 Image: gcr.io/google-containers/kube-scheduler:v1.14.3 Image: gcr.io/google_containers/kubernetes-dashboard-amd64:v1.10.1 Image: k8s.gcr.io/k8s-dns-node-cache:1.15.1 Image: k8s.gcr.io/k8s-dns-node-cache:1.15.1 Image: k8s.gcr.io/k8s-dns-node-cache:1.15.1 Image: gcr.io/kubernetes-helm/tiller:v2.13.1 Image: gcr.io/google_containers/defaultbackend:1.4 Image: tpdock/freeradius:2.2.9 Image: voltha/voltha-netconf:1.7.0 Image: alpine:3.6 Image: quay.io/kubernetes-ingress-controller/nginx-ingress-controller:0.10.2 Image: voltha/voltha-ofagent:1.7.0 Image: voltha/voltha-cli:1.7.0 Image: voltha/voltha-voltha:1.7.0 Image: voltha/voltha-envoy:1.7.0 root@sbat1:/home/user1/volt2# kubeadm version kubeadm version: &version.Info{Major:"1", Minor:"14", GitVersion:"v1.14.3", GitCommit:"5e53fd6bc17c0dec8434817e69b04a25d8ae0ff0", GitTreeState:"clean", BuildDate:"2019-06-06T01:41:54Z", GoVersion:"go1.12.5", Compiler:"gc", Platform:"linux/amd64"}

Story Points:
1
Epic Link:
Maintenance

Description

I am trying to pass traffic with an edgecore olt. Provisioning results in the olt being stuck in the activating state. I have attached the tosca files used to provision the SEBA POD done in the order whitelist->subscriber->pod-olt. In addition There are no devices shown in onos cli.

Commands used to install SEBA
helm install -n cord-platform cord/cord-platform --version=7.0.0
helm install -n seba cord/seba --version=2.0.0-alpha1
helm install -n att-workflow cord/att-workflow --version=1.2.4

(voltha) devices
Devices:
-----------------------------------------------------------------------------------

id type root admin_state oper_status connect_status host_and_port

-----------------------------------------------------------------------------------

0001d1fcce912b1e openolt True ENABLED ACTIVATING UNREACHABLE xxx.xx.xx.150:9191

-----------------------------------------------------------------------------------

Attachments

Options
- Sort By Name
- Sort By Date
- Ascending
- Descending
- Thumbnails
- List
- Download All

Attachments

seba2-olt-activating-onos-logs.txt
189 kB
2019/07/10 11:56 AM
seba2-olt-activating-vcore-logs.txt
222 kB
2019/07/10 11:56 AM
seba2-toscas.txt
8 kB
2019/07/10 11:56 AM

Options
- Issue Only
- Show All Reviews
- Show Open Reviews

Gerrit Reviews

No reviews matched the request. Check your Options in the drop-down menu of this sections header.

Activity

People

Assignee:: Unassigned

Reporter:: Kevin Riordan (Inactive)

Watchers:: 1 Start watching this issue

Dates

Created:: 2019/07/10 11:57 AM

Updated:: 2019/09/26 3:20 PM

Gerrit Reviews

There are no open Gerrit changes