Contrail

 View Only
last person joined: 13 days ago 

Get answers on the Contrail portfolio and share your expertise.
  • 1.  Nova installation error

    Posted 03-03-2020 23:33

    Hi, I'm trying to install contrail and have been following a guide provided by a local Juniper tech. But I hit an error and would appreciate some guidance on how to overcome the error.

     

    system.

    Three centos 7 servers with two NICs - management 10.xxx.128.26/27/28 with gw 10.xxx.128.254 and data 10.xxx.129.26/27/28 with gw 10.xxx.129.254. Both use the same dns and ntp.

    loading docker-ce-18.06.0.ce

    container 1911.31

     

    confirmed that 26 can ssh 27 and 28

    setup /etc/hosts files on all servers guided by local Juniper tech

     

    setup is minimal and works for the local Juniper tech on his testbed.

     

    any ideas on how to fix this welcome.

     

    error

    --------------------

    time="2020-03-04T01:36:52-05:00" level=info msg="TASK [nova : Create base cell for legacy instances] ****************************" logger=reporter

    time="2020-03-04T01:36:52-05:00" level=info msg="changed: [10.102.128.27 -> 10.102.128.27]" logger=reporter

    time="2020-03-04T01:36:57-05:00" level=info msg="[DEPRECATION WARNING]: Using tests as filters is deprecated. Instead of using " logger=reporter

    time="2020-03-04T01:36:57-05:00" level=info msg="`result|success` use `result is success`. This feature will be removed in " logger=reporter

    time="2020-03-04T01:36:57-05:00" level=info msg="version 2.9. Deprecation warnings can be disabled by setting " logger=reporter

    time="2020-03-04T01:36:57-05:00" level=info msg="deprecation_warnings=False in ansible.cfg." logger=reporter

    time="2020-03-04T01:36:57-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (20 retries left)." logger=reporter

    time="2020-03-04T01:37:11-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (19 retries left)." logger=reporter

    time="2020-03-04T01:37:25-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (18 retries left)." logger=reporter

    time="2020-03-04T01:37:38-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (17 retries left)." logger=reporter

    time="2020-03-04T01:37:52-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (16 retries left)." logger=reporter

    time="2020-03-04T01:38:06-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (15 retries left)." logger=reporter

    time="2020-03-04T01:38:19-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (14 retries left)." logger=reporter

    time="2020-03-04T01:38:32-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (13 retries left)." logger=reporter

    time="2020-03-04T01:38:46-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (12 retries left)." logger=reporter

    time="2020-03-04T01:39:00-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (11 retries left)." logger=reporter

    time="2020-03-04T01:39:14-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (10 retries left)." logger=reporter

    time="2020-03-04T01:39:27-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (9 retries left)." logger=reporter

    time="2020-03-04T01:39:41-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (8 retries left)." logger=reporter

    time="2020-03-04T01:39:54-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (7 retries left)." logger=reporter

    time="2020-03-04T01:40:09-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (6 retries left)." logger=reporter

    time="2020-03-04T01:40:22-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (5 retries left)." logger=reporter

    time="2020-03-04T01:40:35-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (4 retries left)." logger=reporter

    time="2020-03-04T01:40:49-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (3 retries left)." logger=reporter

    time="2020-03-04T01:41:02-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (2 retries left)." logger=reporter

    time="2020-03-04T01:41:16-05:00" level=info msg="FAILED - RETRYING: Waiting for nova-compute service up (1 retries left)." logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="TASK [nova : Waiting for nova-compute service up] ******************************" logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="fatal: [10.102.128.27 -> 10.102.128.27]: FAILED! => {\"attempts\": 20, \"changed\": false, \"cmd\": [\"docker\", \"exec\", \"kolla_toolbox\", \"openstack\", \"--os-interface\", \"internal\", \"--os-auth-url\", \"http://10.102.128.27:35357\", \"--os-identity-api-version\", \"3\", \"--os-project-domain-name\", \"default\", \"--os-tenant-name\", \"admin\", \"--os-username\", \"admin\", \"--os-password\", \"c0ntrail123\", \"--os-user-domain-name\", \"default\", \"compute\", \"service\", \"list\", \"-f\", \"json\", \"--service\", \"nova-compute\"], \"delta\": \"0:00:02.928487\", \"end\": \"2020-03-04 17:41:29.435457\", \"rc\": 0, \"start\": \"2020-03-04 17:41:26.506970\", \"stderr\": \"\", \"stderr_lines\": [], \"stdout\": \"[]\", \"stdout_lines\": [\"[]\"]}" logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="NO MORE HOSTS LEFT *************************************************************" logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="\tto retry, use: --limit @/usr/share/contrail/contrail-ansible-deployer/playbooks/install_openstack.retry" logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="PLAY RECAP *********************************************************************" logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="10.102.128.27              : ok=172  changed=101  unreachable=0    failed=1   " logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="10.102.128.28              : ok=63   changed=33   unreachable=0    failed=0   " logger=reporter

    time="2020-03-04T01:41:29-05:00" level=info msg="localhost                  : ok=56   changed=2    unreachable=0    failed=0   " logger=reporter

    -------------------



  • 2.  RE: Nova installation error

     
    Posted 03-04-2020 00:03

    The error is because nova-compute service can't register to novaDB. Check the status of nova related dockers both in controllers as well as compute nodes ? Also validate if you are able to run any of the openstack commands ?



  • 3.  RE: Nova installation error

    Posted 03-04-2020 00:11

    Hi Ashish, thank you for responding. I've gone back to the beginning and have started to re-enter the Juniper Contrail cluster configuration through the GUI. I'm following step by step instructions and they appear to work in the local Juniper tech's testbed but not in my cloud environment at RMIT University. Unfortunately, I'm new to this, don't have a support contract and would need a bit of a pointer as to why the GUI provision is failing and how to get past this point.



  • 4.  RE: Nova installation error

     
    Posted 03-04-2020 00:17

    Can you attach the o/p of the following from your nodes ?

    uname -a

    cat /etc/redhat-release

    docker ps



  • 5.  RE: Nova installation error

    Posted 03-04-2020 00:31

    Hi Ashish, I have three servers - none are configured now as I've gone back to a previous snapshot.

    26 is the contrail_command box.

    uname -a

    Linux contprdap21.sece.rmit.edu.au 3.10.0-1062.el7.x86_64 #1 SMP Wed Aug 7 18:08:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

    cat /etc/redhat-release

    CentOS Linux release 7.7.1908 (Core)

    docker ps

    CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
    6960dc3bc879 hub.juniper.net/contrail/contrail-command:1912.32 "/bin/contrailgo -c …" 31 minutes ago Up 30 minutes contrail_command
    225020f9ddbc circleci/postgres:10.3-alpine "docker-entrypoint.s…" 33 minutes ago Up 33 minutes contrail_psql

    27 is to be the aio - controller and compute node

    uname -a

    Linux contprdap22.sece.rmit.edu.au 3.10.0-1062.el7.x86_64 #1 SMP Wed Aug 7 18:08:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

    cat /etc/redhat-release

    CentOS Linux release 7.7.1908 (Core)

    docker ps

    -bash: docker: command not found

    28 is to be a compute node

    uname -a

    Linux contprdap23.sece.rmit.edu.au 3.10.0-1062.el7.x86_64 #1 SMP Wed Aug 7 18:08:02 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

    cat /etc/redhat-release

    CentOS Linux release 7.7.1908 (Core)

    docker ps

    -bash: docker: command not found

     

     



  • 6.  RE: Nova installation error

     
    Posted 03-04-2020 00:46

    If you have reverted back the sanpshot, the o/p is not going to help.

    Please ensure that you meet all the requirement for the contrail release as per the supported platform section below (assuming you are deploying contrail version 1912)

    https://www.juniper.net/documentation/en_US/contrail19/information-products/topic-collections/release-notes/topic-145208.html#jd0e69



  • 7.  RE: Nova installation error
    Best Answer

    Posted 03-07-2020 16:23

    Hi Ashish, I tried several more times to install Contrail and eventually it worked. I'm going to close this thread now and ask other questions in new threads.