Switching

Expand all | Collapse all

[EX] fxpc cpu usage is high

  • 1.  [EX] fxpc cpu usage is high

    Posted 02-02-2021 05:02
    Hello,

    (warning... long message)

    I see that fxpc CPU usage is high. I have setup a virtual chassis with 4 * EX2300, but using monitoring, i suspect there is an error in my configuration.
    See:
    CPU usage on master node:


    CPU usage on second node:

    while 3rd and 4th nodes are good:



    This command confirmed that:
    root@volvic-01> show system processes extensive | except 0.00
    last pid: 32204;  load averages:  1.19,  1.43,  1.48  up 70+22:16:21    10:44:05
    226 processes: 3 running, 203 sleeping, 20 waiting
    
    Mem: 106M Active, 1224M Inact, 338M Wired, 82M Buf, 238M Free
    Swap:
    
    
      PID USERNAME PRI NICE   SIZE    RES STATE    TIME    WCPU COMMAND
     6075 root      85    0   750M   192M RUN    509.0H  42.97% fxpc{fxpc}
       11 root     155 ki31     0K    16K RUN    930.3H  38.96% idle
     6075 root     -52   r0   750M   192M select  91.6H   7.96% fxpc{fxpc}
       16 root     -16    -     0K    16K -       35.4H   0.98% rand_harvestq
    
    
    {master:0}​


    The VC is composed with 2xEX2300 48P, 1xEX2300 24P and 1xEX2300 24T:

    root@volvic-01> show virtual-chassis
    
    Preprovisioned Virtual Chassis
    Virtual Chassis ID: a3ff.c1cc.ecd7
    Virtual Chassis Mode: Enabled
                                                    Mstr           Mixed Route Neighbor List
    Member ID  Status   Serial No    Model          prio  Role      Mode  Mode ID  Interface
    0 (FPC 0)  Prsnt    JW0220171359 ex2300-48p     129   Master*      N  VC   2  vcp-255/1/2
                                                                               1  vcp-255/1/3
    1 (FPC 1)  Prsnt    JW0220171403 ex2300-48p     129   Backup       N  VC   3  vcp-255/1/2
                                                                               0  vcp-255/1/3
    2 (FPC 2)  Prsnt    JY0220420016 ex2300-24p       0   Linecard     N  VC   0  vcp-255/1/2
                                                                               3  vcp-255/1/3
    3 (FPC 3)  Prsnt    JZ0220490288 ex2300-24t       0   Linecard     N  VC   1  vcp-255/1/2
                                                                               2  vcp-255/1/3
    
    {master:0}


    versions:

    root@volvic-01> show version
    fpc0:
    --------------------------------------------------------------------------
    Hostname: volvic-01
    Model: ex2300-48p
    Junos: 20.2R1.10
    JUNOS OS Kernel 32-bit  [20200608.0016468_builder_stable_11]
    JUNOS OS libs [20200608.0016468_builder_stable_11]
    JUNOS OS runtime [20200608.0016468_builder_stable_11]
    JUNOS OS time zone information [20200608.0016468_builder_stable_11]
    JUNOS py extensions2 [20200625.123713_builder_junos_202_r1]
    JUNOS py extensions [20200625.123713_builder_junos_202_r1]
    JUNOS py base2 [20200625.123713_builder_junos_202_r1]
    JUNOS py base [20200625.123713_builder_junos_202_r1]
    JUNOS network stack and utilities [20200625.123713_builder_junos_202_r1]
    JUNOS libs [20200625.123713_builder_junos_202_r1]
    JUNOS runtime [20200625.123713_builder_junos_202_r1]
    JUNOS package hooks ex [20191022.160523_sjg_dev_common]
    JUNOS OS package [20191113.002318_sjg_stable_11]
    JUNOS OS crypto [20200608.0016468_builder_stable_11]
    JUNOS na telemetry [20.2R1.10]
    JUNOS Web Management Platform Package [20200625.123713_builder_junos_202_r1]
    JUNOS Web Management Application package [20.2A1.2]
    JUNOS ex libs [20200625.123713_builder_junos_202_r1]
    JUNOS ex runtime [20200625.123713_builder_junos_202_r1]
    JUNOS ex platform support [20200625.123713_builder_junos_202_r1]
    JUNOS Openconfig [20.2R1.10]
    JUNOS dcp network modules [20200625.123713_builder_junos_202_r1]
    JUNOS modules [20200625.123713_builder_junos_202_r1]
    JUNOS ex modules [20200625.123713_builder_junos_202_r1]
    JUNOS ex Data Plane Crypto Support [20200625.123713_builder_junos_202_r1]
    JUNOS daemons [20200625.123713_builder_junos_202_r1]
    JUNOS SDN Software Suite [20200625.123713_builder_junos_202_r1]
    JUNOS Extension Toolkit [20200625.123713_builder_junos_202_r1]
    JUNOS Phone-home [20200625.123713_builder_junos_202_r1]
    JUNOS Packet Forwarding Engine Support (EX34XX) [20200625.123713_builder_junos_202_r1]
    JUNOS jdocs ex [20200625.123713_builder_junos_202_r1]
    JUNOS jail runtime [20200608.0016468_builder_stable_11]
    JUNOS FIPS mode utilities [20200625.123713_builder_junos_202_r1]
    
    fpc1:
    --------------------------------------------------------------------------
    Hostname: volvic-01
    Model: ex2300-48p
    Junos: 20.2R1.10
    JUNOS OS Kernel 32-bit  [20200608.0016468_builder_stable_11]
    JUNOS OS libs [20200608.0016468_builder_stable_11]
    JUNOS OS runtime [20200608.0016468_builder_stable_11]
    JUNOS OS time zone information [20200608.0016468_builder_stable_11]
    JUNOS py extensions2 [20200625.123713_builder_junos_202_r1]
    JUNOS py extensions [20200625.123713_builder_junos_202_r1]
    JUNOS py base2 [20200625.123713_builder_junos_202_r1]
    JUNOS py base [20200625.123713_builder_junos_202_r1]
    JUNOS network stack and utilities [20200625.123713_builder_junos_202_r1]
    JUNOS libs [20200625.123713_builder_junos_202_r1]
    JUNOS runtime [20200625.123713_builder_junos_202_r1]
    JUNOS package hooks ex [20191022.160523_sjg_dev_common]
    JUNOS OS package [20191113.002318_sjg_stable_11]
    JUNOS OS crypto [20200608.0016468_builder_stable_11]
    JUNOS na telemetry [20.2R1.10]
    JUNOS ex libs [20200625.123713_builder_junos_202_r1]
    JUNOS ex runtime [20200625.123713_builder_junos_202_r1]
    JUNOS ex platform support [20200625.123713_builder_junos_202_r1]
    JUNOS Openconfig [20.2R1.10]
    JUNOS dcp network modules [20200625.123713_builder_junos_202_r1]
    JUNOS modules [20200625.123713_builder_junos_202_r1]
    JUNOS ex modules [20200625.123713_builder_junos_202_r1]
    JUNOS ex Data Plane Crypto Support [20200625.123713_builder_junos_202_r1]
    JUNOS daemons [20200625.123713_builder_junos_202_r1]
    JUNOS SDN Software Suite [20200625.123713_builder_junos_202_r1]
    JUNOS Extension Toolkit [20200625.123713_builder_junos_202_r1]
    JUNOS Phone-home [20200625.123713_builder_junos_202_r1]
    JUNOS Packet Forwarding Engine Support (EX34XX) [20200625.123713_builder_junos_202_r1]
    JUNOS jail runtime [20200608.0016468_builder_stable_11]
    JUNOS FIPS mode utilities [20200625.123713_builder_junos_202_r1]
    
    fpc2:
    --------------------------------------------------------------------------
    Hostname: volvic-01
    Model: ex2300-24p
    Junos: 20.2R2.11
    JUNOS OS Kernel 32-bit  [20200922.4042921_builder_stable_11]
    JUNOS OS libs [20200922.4042921_builder_stable_11]
    JUNOS OS runtime [20200922.4042921_builder_stable_11]
    JUNOS OS time zone information [20200922.4042921_builder_stable_11]
    JUNOS py extensions2 [20201028.081005_builder_junos_202_r2]
    JUNOS py extensions [20201028.081005_builder_junos_202_r2]
    JUNOS py base2 [20201028.081005_builder_junos_202_r2]
    JUNOS py base [20201028.081005_builder_junos_202_r2]
    JUNOS OS crypto [20200922.4042921_builder_stable_11]
    JUNOS OS boot-ve files [20200922.4042921_builder_stable_11]
    JUNOS network stack and utilities [20201028.081005_builder_junos_202_r2]
    JUNOS libs [20201028.081005_builder_junos_202_r2]
    JUNOS runtime [20201028.081005_builder_junos_202_r2]
    JUNOS na telemetry [20.2R2.11]
    JUNOS Web Management Platform Package [20201028.081005_builder_junos_202_r2]
    JUNOS Web Management Application package [20.2A1.2]
    JUNOS ex libs [20201028.081005_builder_junos_202_r2]
    JUNOS ex runtime [20201028.081005_builder_junos_202_r2]
    JUNOS ex platform support [20201028.081005_builder_junos_202_r2]
    JUNOS Openconfig [20.2R2.11]
    JUNOS dcp network modules [20201028.081005_builder_junos_202_r2]
    JUNOS modules [20201028.081005_builder_junos_202_r2]
    JUNOS ex modules [20201028.081005_builder_junos_202_r2]
    JUNOS ex Data Plane Crypto Support [20201028.081005_builder_junos_202_r2]
    JUNOS daemons [20201028.081005_builder_junos_202_r2]
    JUNOS SDN Software Suite [20201028.081005_builder_junos_202_r2]
    JUNOS Extension Toolkit [20201028.081005_builder_junos_202_r2]
    JUNOS Phone-home [20201028.081005_builder_junos_202_r2]
    JUNOS Packet Forwarding Engine Support (EX34XX) [20201028.081005_builder_junos_202_r2]
    JUNOS jdocs ex [20201028.081005_builder_junos_202_r2]
    JUNOS jail runtime [20200922.4042921_builder_stable_11]
    JUNOS FIPS mode utilities [20201028.081005_builder_junos_202_r2]
    
    fpc3:
    --------------------------------------------------------------------------
    Hostname: volvic-01
    Model: ex2300-24t
    Junos: 20.2R2.11
    JUNOS OS Kernel 32-bit  [20200922.4042921_builder_stable_11]
    JUNOS OS libs [20200922.4042921_builder_stable_11]
    JUNOS OS runtime [20200922.4042921_builder_stable_11]
    JUNOS OS time zone information [20200922.4042921_builder_stable_11]
    JUNOS py extensions2 [20201028.081005_builder_junos_202_r2]
    JUNOS py extensions [20201028.081005_builder_junos_202_r2]
    JUNOS py base2 [20201028.081005_builder_junos_202_r2]
    JUNOS py base [20201028.081005_builder_junos_202_r2]
    JUNOS OS crypto [20200922.4042921_builder_stable_11]
    JUNOS OS boot-ve files [20200922.4042921_builder_stable_11]
    JUNOS network stack and utilities [20201028.081005_builder_junos_202_r2]
    JUNOS libs [20201028.081005_builder_junos_202_r2]
    JUNOS runtime [20201028.081005_builder_junos_202_r2]
    JUNOS na telemetry [20.2R2.11]
    JUNOS Web Management Platform Package [20201028.081005_builder_junos_202_r2]
    JUNOS ex libs [20201028.081005_builder_junos_202_r2]
    JUNOS ex runtime [20201028.081005_builder_junos_202_r2]
    JUNOS ex platform support [20201028.081005_builder_junos_202_r2]
    JUNOS Openconfig [20.2R2.11]
    JUNOS dcp network modules [20201028.081005_builder_junos_202_r2]
    JUNOS modules [20201028.081005_builder_junos_202_r2]
    JUNOS ex modules [20201028.081005_builder_junos_202_r2]
    JUNOS ex Data Plane Crypto Support [20201028.081005_builder_junos_202_r2]
    JUNOS daemons [20201028.081005_builder_junos_202_r2]
    JUNOS SDN Software Suite [20201028.081005_builder_junos_202_r2]
    JUNOS Extension Toolkit [20201028.081005_builder_junos_202_r2]
    JUNOS Phone-home [20201028.081005_builder_junos_202_r2]
    JUNOS Packet Forwarding Engine Support (EX34XX) [20201028.081005_builder_junos_202_r2]
    JUNOS jdocs ex [20201028.081005_builder_junos_202_r2]
    JUNOS jail runtime [20200922.4042921_builder_stable_11]
    JUNOS FIPS mode utilities [20201028.081005_builder_junos_202_r2]
    
    {master:0}


    There must be an error somewhere, but i do not see where ....

    root@volvic-01> start shell
    root@volvic-01:RE:0% vty fpc0
    
    
    BSD platform (1250 Mhz ARM Cortex-A9 processor, 255MB memory, 0KB flash)
    
    TFXPC0(volvic-01 vty)# show syslog messages
    [Wed Jan 27 18:39:04.121 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 19:06:45.689 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 19:12:54.162 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 19:14:51.882 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 19:28:49.151 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 19:44:47.849 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 19:48:45.519 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 20:02:44.260 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 20:22:55.217 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 20:26:50.948 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Wed Jan 27 20:28:57.746 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Thu Jan 28 00:30:16.049 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Thu Jan 28 08:50:25.667 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Thu Jan 28 10:04:08.567 LOG: Err] optic_set_activity_led:[FPC:0 PIC:0 Port:13 Chan:0 - Ifd Speed:0] Failed setting activity led to ON[Thu Jan 28 11:06:18.158 LOG: Info] ifp ge-0/0/5 ifd_mdown: 5700894208 ms
    [Thu Jan 28 11:06:18.206 LOG: Info] Setting Port Status LED for pic_slot 0, port 5, ifd_channel 0, led_state Off
    [Thu Jan 28 11:06:18.207 LOG: Info] Setting Port Activity LED for pic_slot 0, port 5, ifd_channel 0, led_state Off
    [Thu Jan 28 11:06:29.321 LOG: Info] Setting Port Status LED for pic_slot 0, port 5, ifd_channel 0, led_state Green_Blink
    [Thu Jan 28 11:06:29.322 LOG: Info] Setting Port Activity LED for pic_slot 0, port 5, ifd_channel 0, led_state Green
    [Thu Jan 28 11:06:37.143 LOG: Info] ifp ge-0/0/5 ifd_mdown: 5700913193 ms
    [Thu Jan 28 11:06:37.331 LOG: Info] Setting Port Status LED for pic_slot 0, port 5, ifd_channel 0, led_state Off
    [Thu Jan 28 11:06:37.332 LOG: Info] Setting Port Activity LED for pic_slot 0, port 5, ifd_channel 0, led_state Off
    [Thu Jan 28 11:06:39.375 LOG: Info] Setting Port Status LED for pic_slot 0, port 5, ifd_channel 0, led_state Green_Blink
    [Thu Jan 28 11:06:39.376 LOG: Info] Setting Port Activity LED for pic_slot 0, port 5, ifd_channel 0, led_state Green
    [Thu Jan 28 16:01:01.192 LOG: Info] ifp ge-0/0/43 ifd_mdown: 5718577242 ms
    [Thu Jan 28 16:01:01.567 LOG: Info] Setting Port Status LED for pic_slot 0, port 43, ifd_channel 0, led_state Off
    [Thu Jan 28 16:01:01.568 LOG: Info] Setting Port Activity LED for pic_slot 0, port 43, ifd_channel 0, led_state Off
    [Thu Jan 28 16:01:07.730 LOG: Info] Setting Port Status LED for pic_slot 0, port 43, ifd_channel 0, led_state Green_Blink
    [Thu Jan 28 16:01:07.731 LOG: Info] Setting Port Activity LED for pic_slot 0, port 43, ifd_channel 0, led_state Green
    [Thu Jan 28 16:01:15.675 LOG: Info] ifp ge-0/0/43 ifd_mdown: 5718591724 ms
    [Thu Jan 28 16:01:15.822 LOG: Info] Setting Port Status LED for pic_slot 0, port 43, ifd_channel 0, led_state Off
    [Thu Jan 28 16:01:15.823 LOG: Info] Setting Port Activity LED for pic_slot 0, port 43, ifd_channel 0, led_state Off
    [Thu Jan 28 16:01:17.829 LOG: Info] Setting Port Status LED for pic_slot 0, port 43, ifd_channel 0, led_state Green_Blink
    [Thu Jan 28 16:01:17.830 LOG: Info] Setting Port Activity LED for pic_slot 0, port 43, ifd_channel 0, led_state Green
    [Thu Jan 28 16:11:20.752 LOG: Err] BRCM_NH-,brcm_nh_l3_hw_uninstall(),1195:ucst nh:2040 uninstall failed for the hw idx:100075 Operation still running
    
    [Thu Jan 28 16:11:20.753 LOG: Err] BRCM_NH-,brcm_nh_bdvlan_ucast_uninstall(),141:l3 nh 2040 unintsall failed in h/w
    [Sat Jan 30 18:03:13.648 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Sun Jan 31 15:17:11.433 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Mon Feb  1 09:23:44.210 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Mon Feb  1 09:30:53.096 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/0 AN spd = 1000000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.096 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/0, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.097 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/1 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.097 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/1, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.117 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/2 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.117 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/2, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.118 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/3 AN spd = 1000000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.118 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/3, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.148 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/4 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.148 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/4, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.149 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/5 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.149 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/5, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.185 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/6 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.185 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/6, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.186 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/7 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.186 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/7, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.187 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/8 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.187 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/8, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.198 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/9 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.198 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/9, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.228 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/10 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.228 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/10, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.246 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/11 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.246 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/11, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.247 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/12 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.248 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/12, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.253 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/13 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.253 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/13, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.254 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/14 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.254 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/14, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.478 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/15 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.479 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/15, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.485 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/36 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.486 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/36, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.497 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/37 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.498 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/37, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.504 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/38 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.505 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/38, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.513 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/39 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.514 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/39, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.519 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/40 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.520 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/40, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.529 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/41 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.530 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/41, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.538 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/42 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.539 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/42, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.549 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/43 AN spd = 100000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.550 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/43, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.561 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/44 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.562 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/44, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.572 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/46 AN spd = 0, dpx = 0, an = 2, fc = 1
    [Mon Feb  1 09:30:53.573 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/46, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 09:30:53.584 LOG: Info] [DCBCM] dcbcm_eth_an_config: ifd - ge-0/0/47 AN spd = 1000000000, dpx = 2, an = 2, fc = 1
    [Mon Feb  1 09:30:53.585 LOG: Info] [DCBCM] dcbcm_check_an_config_change: ifd - ge-0/0/47, OLD CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 NEW CFG spd = 0, dpx = 0, an = 1, fc = 1 auto_speed:0 auto_mdix = 1 ifd->ifd_media.ifm_speed = 1752458591
    [Mon Feb  1 15:30:30.692 LOG: Info] ifp ge-0/0/13 ifd_mdown: 6062346743 ms
    [Mon Feb  1 15:30:30.838 LOG: Info] Setting Port Status LED for pic_slot 0, port 13, ifd_channel 0, led_state Off
    [Mon Feb  1 15:30:30.839 LOG: Info] Setting Port Activity LED for pic_slot 0, port 13, ifd_channel 0, led_state Off
    [Mon Feb  1 15:30:46.984 LOG: Info] Setting Port Status LED for pic_slot 0, port 13, ifd_channel 0, led_state Green_Blink
    [Mon Feb  1 15:30:46.985 LOG: Info] Setting Port Activity LED for pic_slot 0, port 13, ifd_channel 0, led_state Green
    [Mon Feb  1 22:28:15.384 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    [Tue Feb  2 03:34:54.972 LOG: Info] Version 20.2R1.10 by builder on 2020-06-25 13:17:23 UTC
    
    TFXPC0(volvic-01 vty)# show threads verbose
    CPU hog check enabled
    Max run time 2500
    PID PR State     Name                   Stack Use        Started@ Time (Last/Max/Total) cpu
    --- -- -------   ---------------------  ---------     -------- ------------------------
      1 H  asleep    Maintenance            512/43112           52 ms 0/1/2 ms  0%
      2 L  running   Idle                  5344/43104           53 ms 8/2289/3590080900 ms 58%
      3 H  asleep    Timer Services        5068/43104           62 ms 0/1067/3664999 ms  0%
      5 L  asleep    Ukern Syslog           432/45152           73 ms 0/3/3 ms  0%
      6 L  asleep    Sheaf Background       496/43104           98 ms 0/131/22119 ms  0%
      7 M  asleep    SFP                   5292/45152          194 ms 0/1075/20114465 ms  0%
      8 M  asleep    QSFP                   688/45152          200 ms 0/408/207302 ms  0%
      9 M  asleep    CXP                    552/45152          201 ms 0/326/97961 ms  0%
     10 M  asleep    Ethernet              6660/45152          309 ms 0/2369/502298231 ms  8%
     11 L  asleep    Syslog                5044/45152          355 ms 0/370/19307 ms  0%
     12 M  asleep    mac_db                 432/49256          468 ms 3/3/3 ms  0%
     13 M  asleep    Periodic              1816/49256          557 ms 0/623/297364 ms  0%
     14 M  asleep    Host Loopback Periodic   472/49256          599 ms 0/345/98584 ms  0%
     15 H  asleep    TTP Receive           5076/45152          620 ms 0/1055/5143872 ms  0%
     16 H  asleep    TTP Transmit           432/45160          628 ms 0/0/0 ms  0%
     17 L  asleep    Console               4908/57448          778 ms 27/27/27 ms  0%
     18 M  asleep    RPM Msg thread         432/49256          836 ms 1/1/1 ms  0%
     19 H  asleep    Pfesvcsor             4972/49248          840 ms 0/542/84286 ms  0%
     20 M  asleep    Button Periodic       5092/45160          913 ms 1/1133/33572847 ms  0%
     21 M  asleep    PIC Periodic          5424/49256         3013 ms 0/1524/29038705 ms  0%
     22 M  asleep    PIC                    432/45152         3013 ms 0/0/0 ms  0%
     23 M  asleep    PoE Periodic          5388/45160         3274 ms 3/2194/501608507 ms  8%
     24 M  asleep    CMVC                  5924/57440         3374 ms 0/355/378945 ms  0%
     25 M  asleep    CMQFX                 8548/57448         3389 ms 1/1774/1489535 ms  0%
     26 L  asleep    DFW Alert              824/45152         3887 ms 0/957/102002 ms  0%
     28 M  asleep    bcmPOLL                576/57448         4167 ms 1/1/1 ms  0%
     29 M  asleep    socdmadesc.0          5388/57448         5972 ms 0/1073/5951990 ms  0%
     31 L  asleep    ICMP6 Input            648/45160         6314 ms 0/0/0 ms  0%
     32 L  asleep    IP6 Option Input      4956/45152         6314 ms 7/7/7 ms  0%
     33 L  asleep    ICMP Input             512/45160         6342 ms 3/3/3 ms  0%
     34 L  asleep    IP Option Input       4956/45152         6349 ms 4/4/4 ms  0%
     35 M  asleep    IGMP Input            4956/45160         6349 ms 3/3/3 ms  0%
     36 L  asleep    NH Probe Service       440/45152         6540 ms 5/5/5 ms  0%
     38 M  asleep    PRIVATE PFE Manager   5188/57448         6770 ms 0/1258/19048 ms  0%
     39 M  asleep    PPM Manager           4712/49248         6778 ms 0/70/616 ms  0%
     40 M  asleep    PPM Data thread        496/57440         6811 ms 0/7/7 ms  0%
     41 M  asleep    VRRP Manager          5052/49256         6916 ms 19/19/19 ms  0%
     42 M  asleep    PFE Manager          42072/57440         6947 ms 0/1315/9370837 ms  0%
     43 L  asleep    SFlow sample deamon   5076/49256         6953 ms 0/1034/401638 ms  0%
     46 M  asleep    L2ALM Manager         6480/49256         7095 ms 0/772/2281831 ms  0%
     47 M  asleep    ARP Proxy             5244/49248         7098 ms 0/1009/1096586 ms  0%
     48 M  asleep    CEIP Ping              848/49256         7104 ms 3/3/3 ms  0%
     49 M  asleep    Agent Daemon          1504/43112         7245 ms 0/348/11324 ms  0%
     50 M  asleep    PFE Statistics       11232/57440         7294 ms 0/1539/30913388 ms  0%
     51 H  asleep    brcm opus cos stats daemon  6696/45160         7368 ms 13/1829/36044044 ms  0%
     52 M  asleep    bcmCNTR.0             6588/57440        11535 ms 0/2476/30548344 ms  0%
     53 M  asleep    bcmLINK.0            10720/73832        12227 ms 11/2468/136592135 ms  2%
     54 L  asleep    BCM SDK periodic       488/49248        12238 ms 0/330/141871 ms  0%
     55 L  asleep    BRCM SALM Aging       6188/49248        17023 ms 0/1042/4330806 ms  0%
     56 L  asleep    BRCM SALM Pending Cleanup  5852/49256        17023 ms 0/1071/40663541 ms  0%
     57 M  asleep    bcmL2MOD.0            4704/57440        17044 ms 0/150/44409 ms  0%
     58 M  asleep    socdmadesc.1          5388/57448        17174 ms 0/1050/6230756 ms  0%
     59 M  asleep    bcmDPC                 648/57448        17470 ms 0/0/0 ms  0%
     60 M  ready     bcmCNTR.1             6588/57440        20211 ms 1/1078/32568285 ms  0%
     61 M  asleep    bcmLINK.1            10720/73832        20401 ms 11/2479/134906005 ms  2%
     62 M  asleep    bcmL2MOD.1            4704/57448        21868 ms 0/394/70649 ms  0%
     63 L  asleep    Rate Limit             492/45160        31133 ms 0/732/52567 ms  0%
     64 L  asleep    AS Packet Process     5092/49248       149159 ms 41/41/41 ms  0%
     65 M  asleep    bulkget Manager       8540/49248       152784 ms 7/1436/6826032 ms  0%
     66 M  asleep    brcm ifl stats daemon  5172/45152       152929 ms 1/1070/3218268 ms  0%
     88 L  running   Virtual Console       3320/57440   6126045518 ms 1/36/140 ms  0%
     89 L  asleep    Cattle-Prod Daemon    2520/57448   6127138410 ms 1/1/1 ms  0%
     90 L  asleep    Virtual Console       1344/57448   6128775256 ms 0/0/0 ms  0%
    
    TFXPC0(volvic-01 vty)#​


    there is not so much traffic load, I think CPU usage should be low, no ?

    Can you help me finding my configuration troubles please ?

    Thank you.

    ------------------------------
    NICOLAS
    ------------------------------


  • 2.  RE: [EX] fxpc cpu usage is high

     
    Posted 02-02-2021 23:06
    Hi Nicolas

    From the initial look it seems like you are running 2 different version on this VC. You have FPC2 and FPC3 running 20.2R2.11 and FPC0 and FPC1 running20.2R1.10.
    Ideally you should have all the members on the same code.

    Hope this helps


  • 3.  RE: [EX] fxpc cpu usage is high

    Posted 02-03-2021 03:43
    Hi,
    yes you are right. I will do an upgrade tonight, and see if it solves the problem.

    ------------------------------
    Nicolas
    ------------------------------



  • 4.  RE: [EX] fxpc cpu usage is high

    Posted 02-03-2021 18:06
    So ive seen stuff go HIGH but never make it your Junos logs..
    before your upgrade can you do
    start shell
    % vty fpc0
    and just see if stuff trashes your terminal sesssion.. if not its all good..

    if you see tty logg
    https://community.juniper.net/answers/communities/community-home/digestviewer/viewthread?GroupId=121&MID=127138&CommunityKey=3f850801-038e-4123-b639-82ed4eb777ec&tab=digestviewer


  • 5.  RE: [EX] fxpc cpu usage is high

    Posted 02-05-2021 05:30
    Hello,

    I have some packet loss and network latency in LAN. I suspect a configuration error, but ...

    Well, i tried vty, but it is running correctly for 1 h now:

    TFXPC0(volvic-01 vty)# show version
    
    Juniper Embedded Microkernel Version 20.2R1.10
    Built by builder on 2020-06-25 13:17:23 UTC
    Copyright (C) 1998-2020, Juniper Networks, Inc.
    All rights reserved.
    
    
    BSD platform (1250 Mhz ARM Cortex-A9 processor, 255MB memory, 0KB flash)
    Current time   : Fri Feb  5 09:45:13 2021
    
    Elapsed time   :      73+22:13:49
    
    TFXPC0(volvic-01 vty)# show version
    
    Juniper Embedded Microkernel Version 20.2R1.10
    Built by builder on 2020-06-25 13:17:23 UTC
    Copyright (C) 1998-2020, Juniper Networks, Inc.
    All rights reserved.
    
    
    BSD platform (1250 Mhz ARM Cortex-A9 processor, 255MB memory, 0KB flash)
    Current time   : Fri Feb  5 10:29:01 2021
    
    Elapsed time   :      73+22:57:37
    
    TFXPC0(volvic-01 vty)#​


    I am trying to update the VC, but I have the problem about "no space left on device". I am fixing it before update ;)



    ------------------------------
    Nicolas
    ------------------------------



  • 6.  RE: [EX] fxpc cpu usage is high

    Posted 02-05-2021 06:44
    Hope it all goes well for you.. Thanks for showing vty


  • 7.  RE: [EX] fxpc cpu usage is high

    Posted 02-19-2021 17:30
    Hello,

    reply to myself :)

    After plugin USB keys to allow upgrade to latest release, this is better.


    Since the upgrade reboot, the CPU usage is better




    The RE utilization is now better too ...

    So, I do not know if the previous behavior was due to inconsistent versions, or a fix on the latest version (JUNOS 20.4R1.12) ...



    ------------------------------
    Nicolas
    ------------------------------



  • 8.  RE: [EX] fxpc cpu usage is high

    Posted 02-19-2021 17:43
    last year i face similar issue.. and we dongrade using junos 15.something recommended from jtec..
    i am not sure actually why..
    i recommended to follow the jtec recommended version.. right now is around version 18.2. something..
    thanks