Contrail

Hi, I'm trying to install contrail and have been following a guide provided by a local Juniper tech. But I hit an error and would appreciate some guidance on how to overcome the error.

system.

Three centos 7 servers with two NICs - management 10.xxx.128.26/27/28 with gw 10.xxx.128.254 and data 10.xxx.129.26/27/28 with gw 10.xxx.129.254. Both use the same dns and ntp.

loading docker-ce-18.06.0.ce

container 1911.31

confirmed that 26 can ssh 27 and 28

setup /etc/hosts files on all servers guided by local Juniper tech

setup is minimal and works for the local Juniper tech on his testbed.

any ideas on how to fix this welcome.

error

--------------------

time="2020-03-04T01:36:52-05:00" level=info msg="TASK [nova : Create base cell for legacy instances] ****************************" logger=reporter

time="2020-03-04T01:36:52-05:00" level=info msg="changed: [10.102.128.27 -> 10.102.128.27]" logger=reporter

time="2020-03-04T01:36:57-05:00" level=info msg="[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using " logger=reporter

time="2020-03-04T01:36:57-05:00" level=info msg="`result|success` use `result is success`. This feature will be removed in " logger=reporter

time="2020-03-04T01:36:57-05:00" level=info msg="version 2.9. Deprecation warnings can be disabled by setting " logger=reporter

time="2020-03-04T01:36:57-05:00" level=info msg="deprecation_warnings=False in ansible.cfg." logger=reporter

time="2020-03-04T01:36:57-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (20 retries left)." logger=reporter

time="2020-03-04T01:37:11-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (19 retries left)." logger=reporter

time="2020-03-04T01:37:25-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (18 retries left)." logger=reporter

time="2020-03-04T01:37:38-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (17 retries left)." logger=reporter

time="2020-03-04T01:37:52-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (16 retries left)." logger=reporter

time="2020-03-04T01:38:06-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (15 retries left)." logger=reporter

time="2020-03-04T01:38:19-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (14 retries left)." logger=reporter

time="2020-03-04T01:38:32-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (13 retries left)." logger=reporter

time="2020-03-04T01:38:46-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (12 retries left)." logger=reporter

time="2020-03-04T01:39:00-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (11 retries left)." logger=reporter

time="2020-03-04T01:39:14-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (10 retries left)." logger=reporter

time="2020-03-04T01:39:27-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (9 retries left)." logger=reporter

time="2020-03-04T01:39:41-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (8 retries left)." logger=reporter

time="2020-03-04T01:39:54-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (7 retries left)." logger=reporter

time="2020-03-04T01:40:09-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (6 retries left)." logger=reporter

time="2020-03-04T01:40:22-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (5 retries left)." logger=reporter

time="2020-03-04T01:40:35-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (4 retries left)." logger=reporter

time="2020-03-04T01:40:49-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (3 retries left)." logger=reporter

time="2020-03-04T01:41:02-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (2 retries left)." logger=reporter

time="2020-03-04T01:41:16-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (1 retries left)." logger=reporter

time="2020-03-04T01:41:29-05:00" level=info logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="TASK [nova : Waiting for nova-compute service up] ******************************" logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="fatal: [10.102.128.27 -> 10.102.128.27]: FAILED! => {\"attempts\": 20, \"changed\": false, \"cmd\": [\"docker\", \"exec\", \"kolla_toolbox\", \"openstack\", \"--os-interface\", \"internal\", \"--os-auth-url\", \"http://10.102.128.27:35357\", \"--os-identity-api-version\", \"3\", \"--os-project-domain-name\", \"default\", \"--os-tenant-name\", \"admin\", \"--os-username\", \"admin\", \"--os-password\", \"c0ntrail123\", \"--os-user-domain-name\", \"default\", \"compute\", \"service\", \"list\", \"-f\", \"json\", \"--service\", \"nova-compute\"], \"delta\": \"0:00:02.928487\", \"end\": \"2020-03-04 17:41:29.435457\", \"rc\": 0, \"start\": \"2020-03-04 17:41:26.506970\", \"stderr\": \"\", \"stderr_lines\": [], \"stdout\": \"[]\", \"stdout_lines\": [\"[]\"]}" logger=reporter

time="2020-03-04T01:41:29-05:00" level=info logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="NO MORE HOSTS LEFT *************************************************************" logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="\tto retry, use: --limit @/usr/share/contrail/contrail-ansible-deployer/playbooks/install_openstack.retry" logger=reporter

time="2020-03-04T01:41:29-05:00" level=info logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="PLAY RECAP *********************************************************************" logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="10.102.128.27              : ok=172  changed=101  unreachable=0    failed=1   " logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="10.102.128.28              : ok=63   changed=33   unreachable=0    failed=0   " logger=reporter

time="2020-03-04T01:41:29-05:00" level=info msg="localhost                  : ok=56   changed=2    unreachable=0    failed=0   " logger=reporter

-------------------

The error is because nova-compute service can't register to novaDB. Check the status of nova related dockers both in controllers as well as compute nodes ? Also validate if you are able to run any of the openstack commands ?

Hi Ashish, thank you for responding. I've gone back to the beginning and have started to re-enter the Juniper Contrail cluster configuration through the GUI. I'm following step by step instructions and they appear to work in the local Juniper tech's testbed but not in my cloud environment at RMIT University. Unfortunately, I'm new to this, don't have a support contract and would need a bit of a pointer as to why the GUI provision is failing and how to get past this point.

Can you attach the o/p of the following from your nodes ?

uname -a

cat /etc/redhat-release

docker ps

Hi Ashish, I have three servers - none are configured now as I've gone back to a previous snapshot.

26 is the contrail_command box.

uname -a

Linux contprdap21.sece.rmit.edu.au 3.10.0-1062.el7.x86_64 #1 SMP Wed Aug 7 18:08:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

cat /etc/redhat-release

CentOS Linux release 7.7.1908 (Core)

docker ps

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
6960dc3bc879 hub.juniper.net/contrail/contrail-command:1912.32 "/bin/contrailgo -c …" 31 minutes ago Up 30 minutes contrail_command
225020f9ddbc circleci/postgres:10.3-alpine "docker-entrypoint.s…" 33 minutes ago Up 33 minutes contrail_psql

27 is to be the aio - controller and compute node

uname -a

Linux contprdap22.sece.rmit.edu.au 3.10.0-1062.el7.x86_64 #1 SMP Wed Aug 7 18:08:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

cat /etc/redhat-release

CentOS Linux release 7.7.1908 (Core)

docker ps

-bash: docker: command not found

28 is to be a compute node

uname -a

Linux contprdap23.sece.rmit.edu.au 3.10.0-1062.el7.x86_64 #1 SMP Wed Aug 7 18:08:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

cat /etc/redhat-release

CentOS Linux release 7.7.1908 (Core)

docker ps

-bash: docker: command not found

If you have reverted back the sanpshot, the o/p is not going to help.

Please ensure that you meet all the requirement for the contrail release as per the supported platform section below (assuming you are deploying contrail version 1912)

https://www.juniper.net/documentation/en_US/contrail19/information-products/topic-collections/release-notes/topic-145208.html#jd0e69

Hi Ashish, I tried several more times to install Contrail and eventually it worked. I'm going to close this thread now and ask other questions in new threads.