SRX

 View Only
last person joined: 11 hours ago 

Ask questions and share experiences about the SRX Series.
  • 1.  Data plane CPU usage is High

    Posted 09-01-2015 14:12

    Hi Team,

    we have srx firewall in cluster with below details:

    Model: srx240h
    JUNOS Software Release [12.1X44-D35.5]

    Last 4-5 days I am noticing the high cpu usage on firewall with below details, dont know why ?

    sri@f1> show security monitoring fpc 0
    node0:
    --------------------------------------------------------------------------
    FPC 0
      PIC 0
        CPU utilization          :   99 %
        Memory utilization       :   69 %
        Current flow session     : 1050
        Current flow session IPv4: 1050
        Current flow session IPv6:    0
        Max flow session         : 131072
    Total Session Creation Per Second (for last 96 seconds on average):   21
    IPv4  Session Creation Per Second (for last 96 seconds on average):   21
    IPv6  Session Creation Per Second (for last 96 seconds on average):    0

    node1:
    --------------------------------------------------------------------------
    FPC 0
      PIC 0
        CPU utilization          :    0 %
        Memory utilization       :   69 %
        Current flow session     : 1079
        Current flow session IPv4: 1079
        Current flow session IPv6:    0
        Max flow session         : 131072
    Total Session Creation Per Second (for last 96 seconds on average):   15
    IPv4  Session Creation Per Second (for last 96 seconds on average):   15
    IPv6  Session Creation Per Second (for last 96 seconds on average):    0

    {primary:node0}

    ----

    sri@f1> show security monitoring performance spu
    node0:
    --------------------------------------------------------------------------
    fpc  0  pic  0
    Last 60 seconds:
     0:  99   1:  99   2:  99   3:  99   4:  99   5:  99
     6:  99   7:  99   8:  99   9:  99  10:  99  11:  99
    12:  99  13:  99  14:  99  15:  99  16:  99  17:  99
    18:  99  19:  99  20:  99  21:  99  22:  99  23:  99
    24:  99  25:  99  26:  99  27:  99  28:  99  29:  99
    30:  99  31:  99  32:  99  33:  99  34:  99  35:  99
    36:  99  37:  99  38:  99  39:  99  40:  99  41:  99
    42:  99  43:  99  44:  99  45:  99  46:  99  47:  99
    48:  99  49:  99  50:  99  51:  99  52:  99  53:  96
    54:  88  55:  99  56:  99  57:  99  58:  99  59:  99

    node1:
    --------------------------------------------------------------------------
    fpc  0  pic  0
    Last 60 seconds:
     0:   0   1:   0   2:   0   3:   0   4:   0   5:   0
     6:   0   7:   0   8:   0   9:   0  10:   0  11:   0
    12:   0  13:   0  14:   0  15:   0  16:   0  17:   0
    18:   0  19:   0  20:   0  21:   0  22:   0  23:   0
    24:   0  25:   0  26:   0  27:   0  28:   0  29:   0
    30:   0  31:   0  32:   0  33:   0  34:   0  35:   0
    36:   0  37:   0  38:   0  39:   0  40:   0  41:   0
    42:   0  43:   0  44:   0  45:   0  46:   0  47:   0
    48:   0  49:   0  50:   0  51:   0  52:   0  53:   0
    54:   0  55:   0  56:   0  57:   0  58:   0  59:   0

    --------

    Where as control plane utilization is normal:

    sri@f1> show chassis routing-engine
    node0:
    --------------------------------------------------------------------------
    Routing Engine status:
        Temperature                 38 degrees C / 100 degrees F
        CPU temperature             37 degrees C / 98 degrees F
        Total memory              1024 MB Max   788 MB used ( 77 percent)
          Control plane memory     560 MB Max   470 MB used ( 84 percent)
          Data plane memory        464 MB Max   320 MB used ( 69 percent)
        CPU utilization:
          User                       7 percent
          Background                 0 percent
          Kernel                     8 percent
          Interrupt                  0 percent
          Idle                      85 percent
        Model                          RE-SRX240H
        Serial ID                      AAEP0532
        Start time                     2014-09-28 03:56:31 CDT
        Uptime                         338 days, 12 hours, 7 minutes, 1 second
        Last reboot reason             0x200:normal shutdown
        Load averages:                 1 minute   5 minute  15 minute
                                           0.28       0.19       0.12

    node1:
    --------------------------------------------------------------------------
    Routing Engine status:
        Temperature                 38 degrees C / 100 degrees F
        CPU temperature             37 degrees C / 98 degrees F
        Total memory              1024 MB Max   748 MB used ( 73 percent)
          Control plane memory     560 MB Max   431 MB used ( 77 percent)
          Data plane memory        464 MB Max   320 MB used ( 69 percent)
        CPU utilization:
          User                       5 percent
          Background                 0 percent
          Kernel                     2 percent
          Interrupt                  0 percent
          Idle                      92 percent
        Model                          RE-SRX240H
        Serial ID                      AAEN9595
        Start time                     2014-09-27 23:14:59 CDT
        Uptime                         338 days, 17 hours, 16 minutes, 36 seconds
        Last reboot reason             0x1000:reboot due to panic
        Load averages:                 1 minute   5 minute  15 minute
                                           0.17       0.08       0.04

    {primary:node0}

    -----------

    sri@f1> show system processes extensive
    node0:
    --------------------------------------------------------------------------
    last pid:  4025;  load averages:  0.47,  0.28,  0.15  up 338+12:08:47    16:04:47
    138 processes: 17 running, 109 sleeping, 1 zombie, 11 waiting

    Mem: 221M Active, 91M Inact, 567M Wired, 17M Cache, 112M Buf, 74M Free
    Swap:


      PID USERNAME      THR PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND
     1337 root            7  76    0   514M 49252K select 0    ??? 287.94% flowd_octeon_hm
       22 root            1 171   52     0K    16K RUN    0 6600.7 77.44% idle: cpu0
       24 root            1 -20 -139     0K    16K RUN    0  69.6H  0.00% swi7: clock
       23 root            1 -40 -159     0K    16K WAIT   0  36.1H  0.00% swi2: netisr 0
     1498 root            1  76    0 10564K  2380K select 0  32.5H  0.00% nstraced
        5 root            1 -16    0     0K    16K rtfifo 0  30.7H  0.00% rtfifo_kern_recv
     1348 root            1  76    0 12480K  2648K select 0  25.5H  0.00% license-check
     1502 root            1   4    0 22832K  4840K kqread 0  23.4H  0.00% eswd
     1376 root            1  76    0 10180K  1900K select 0  19.2H  0.00% ppmd
     1505 root            1  76    0 27688K  6356K select 0  17.5H  0.00% mib2d
     1345 root            1  76    0 19504K  4196K select 0 788:12  0.00% utmd
     1343 root            1  76    0 13712K  3000K select 0 787:17  0.00% rtlogd
     1486 root            1  76    0 20280K  3360K select 0 735:09  0.00% l2ald
     1504 root            1  76    0 21868K 11444K select 0 655:39  0.00% snmpd
     1524 root            1  76    0     0K    16K select 0 642:50  0.00% peerproxy02100001
     1509 root            1  76    0 27076K  8260K select 0 626:58  0.00% nsd
     1339 root            1  76    0 15736K  1540K select 0 568:42  0.00% shm-rtsdbd
     1340 root            1  76    0 13996K  4056K select 0 491:26  0.00% jsrpd
     1328 root            1  76    0 12712K  1908K select 0 429:05  0.00% alarmd
     1491 root            1  76    0 46608K  4852K select 0 428:54  0.00% authd
     1513 root            1  76    0   115M  8172K select 0 415:23  0.00% chassisd
     1512 root            1  76    0 27252K  6516K select 0 365:53  0.00% kmd
     1506 root            2  76    0 23404K  3352K select 0 340:46  0.00% pfed
       26 root            1 -16    0     0K    16K -      0 271:14  0.00% yarrow
     1324 root            1  76    0  3304K   316K select 0 236:16  0.00% bslockd
       51 root            1 -16    0     0K    16K psleep 0 220:54  0.00% vmkmemdaemon
     1496 root            1  76    0 13552K  3384K select 0 168:08  0.00% httpd-gk
     1485 root            1   4    0 51504K 12336K kqread 0 125:33  0.00% rpd
     1347 root            3  76    0 13844K  2568K select 0 121:43  0.00% wland
     1410 root            1  76    0     0K    16K select 0 105:06  0.00% peerproxy01100001
        2 root            1  -8    0     0K    16K -      0  85:50  0.00% g_event
     1409 root            1  76    0     0K    16K select 0  82:11  0.00% peerproxy02100001
     1508 root            1  76    0  7940K  1284K select 0  81:35  0.00% irsd
        4 root            1  -8    0     0K    16K -      0  76:10  0.00% g_down
        3 root            1  -8    0     0K    16K -      0  75:38  0.00% g_up
     1005 root            1  76    0 17076K  5844K select 0  75:03  0.00% eventd
       43 root            1  20    0     0K    16K vnlrum 0  69:45  0.00% vnlru_mem
     1503 root            1  76    0 34712K  3832K select 0  60:51  0.00% dcd
     1495 root            1  76    0 14312K  1684K select 0  56:17  0.00% pkid
       41 root            1  20    0     0K    16K syncer 0  52:33  0.00% syncer
     1511 root            1  76    0 16976K  1856K select 0  48:18  0.00% smid
     1484 root            1  76    0  3188K  2804K select 0  39:52  0.00% ntpd
     1323 root            1  76    0  2276K   216K select 0  39:09  0.00% watchdog
     1501 root            1   4    0  9876K  2856K kqread 0  31:56  0.00% mcsnoopd
     1342 root            1  76    0 30492K  3548K select 0  30:49  0.00% idpd
     1499 root            1  76    0 14160K  2008K select 0  28:21  0.00% fwauthd
     1379 root            1  76    0 15388K  2416K select 0  27:04  0.00% lacpd
     1378 root            1  76    0 13104K  1720K select 0  23:34  0.00% bfdd
     1487 root            1  76    0 13780K  2972K select 0  17:46  0.00% rmopd
     1329 root            1  76    0 13288K  1240K select 0  16:54  0.00% craftd
     1497 root            1  76    0 20092K  1732K select 0  16:21  0.00% smihelperd
     1488 root            1  76    0 19236K  4356K select 0  15:52  0.00% cosd
       40 root            1 -16    0     0K    16K psleep 0  10:02  0.00% bufdaemon
       32 root            1   8    0     0K    16K dwcint 0   9:35  0.00% dwc0
       44 root            1 -16    0     0K    16K sdflus 0   9:33  0.00% softdepflush
       42 root            1  -4    0     0K    16K vlruwt 0   7:40  0.00% vnlru
       19 root            1 171   52     0K    16K RUN    3   7:18  0.00% idle: cpu3
       20 root            1 171   52     0K    16K RUN    2   7:08  0.00% idle: cpu2
       48 root            1 -16    0     0K    16K psleep 0   6:33  0.00% vmuncachedaemon
    95719 nobody          6 139    0  9776K  4336K ucondt 0   5:51  0.00% httpd
     1079 root            1   8    0  2672K   856K nanslp 0   4:46  0.00% cron
     1330 root            1  76    0 38616K  4240K select 0   3:52  0.00% mgd
     1500 root            1  76    0  8184K  1004K select 0   3:39  0.00% smtpd
        9 root            1 171   52     0K    16K pgzero 0   3:19  0.00% pagezero
     1507 root            1  76    0 23208K  2960K select 0   3:02  0.00% dfwd
       27 root            1 -28 -147     0K    16K WAIT   0   2:59  0.00% swi5: cambio
        6 root            1   8    0     0K    16K -      0   2:08  0.00% kqueue taskq
       21 root            1 171   52     0K    16K RUN    1   1:50  0.00% idle: cpu1
        8 root            1 -16    0     0K    16K psleep 0   1:42  0.00% pagedaemon
        1 root            1   8    0  1696K   680K wait   0   1:14  0.00% init
      978 root            1  76    0  2392K   140K select 0   1:11  0.00% usbd
       49 root            1   4    0     0K    16K pfeacc 0   0:45  0.00% if_pic_listen0
       46 root            1   4    0     0K    16K pfeacc 0   0:45  0.00% if_pfe_listen
       56 root            1  -8    0     0K    16K mdwait 0   0:21  0.00% md0
      230 root            1  -8    0     0K    16K mdwait 0   0:14  0.00% md1
       36 root            1   8    0     0K    16K usbevt 0   0:07  0.00% usb1
       33 root            1   8    0     0K    16K usbevt 0   0:05  0.00% usb0
     1333 root            1  76    0  6076K  1044K select 0   0:02  0.00% inetd
     3943 remote          1  76    0 49204K 16684K select 0   0:02  0.00% cli
     3940 root            1  76    0  9844K  3192K select 0   0:01  0.00% sshd
        7 root            1   8    0     0K    16K -      0   0:01  0.00% thread taskq
     3944 root            1  76    0 38684K  7960K select 0   0:01  0.00% mgd
     1338 root            1  76    0  5556K  1724K select 0   0:01  0.00% auditd
     1341 root            1  76    0 18544K  2112K select 0   0:01  0.00% appidd
     1349 root            1  76    0  9804K  1680K select 0   0:00  0.00% sdxd
     1489 root            1  76    0  8796K  1424K select 0   0:00  0.00% pppd
     1494 root            1  76    0 14820K  1084K select 0   0:00  0.00% wwand
     1493 root            1  85    0 10584K    92K select 0   0:00  0.00% sendd
     1182 root            1  -8    0     0K    16K mdwait 0   0:00  0.00% md3
     1492 root            1  76    0 10516K   984K select 0   0:00  0.00% mplsoamd
     1510 root            1  76    0  8068K  1028K select 0   0:00  0.00% relayd
       31 root            1 -48 -167     0K    16K WAIT   0   0:00  0.00% swi0: uart
     1325 root            1  76    0  2712K   368K select 0   0:00  0.00% tnetd
     1715 root            1   5    0  2832K    48K ttyin  0   0:00  0.00% getty
     4024 root            1  78    0 38648K  4196K select 0   0:00  0.00% mgd
     4025 root            1  78    0 24284K  1984K CPU0   0   0:00  0.00% top
     1172 root            1  -8    0     0K    16K mdwait 0   0:00  0.00% md2
        0 root            1  -8    0     0K     0K WAIT   0   0:00  0.00% swapper
       47 root            1   4    0     0K    16K dump_r 0   0:00  0.00% kern_dump_proc
       50 root            1   4    0     0K    16K purge_ 0   0:00  0.00% kern_pir_proc
       55 root            1   8    0     0K    16K -      0   0:00  0.00% nfsiod 3
       52 root            1   8    0     0K    16K -      0   0:00  0.00% nfsiod 0
       53 root            1   8    0     0K    16K -      0   0:00  0.00% nfsiod 1
       45 root            1  76    0     0K    16K sleep  0   0:00  0.00% netdaemon
       54 root            1   8    0     0K    16K -      0   0:00  0.00% nfsiod 2
       35 root            1   8    0     0K    16K dwcint 0   0:00  0.00% dwc1
       34 root            1   8    0     0K    16K usbtsk 0   0:00  0.00% usbtask
       10 root            1 -16    0     0K    16K ktrace 0   0:00  0.00% ktrace
       28 root            1 -12 -131     0K    16K WAIT   0   0:00  0.00% swi9: task queue
       29 root            1 -12 -131     0K    16K WAIT   0   0:00  0.00% swi9: +
       30 root            1 -16 -135     0K    16K WAIT   0   0:00  0.00% swi8: +
       25 root            1 -24 -143     0K    16K WAIT   0   0:00  0.00% swi6: vm
       38 root            1 -32 -151     0K    16K WAIT   0   0:00  0.00% swi4: ip6mismatch+
       37 root            1 -36 -155     0K    16K WAIT   0   0:00  0.00% swi3: ip6opt ipopt
       39 root            1 -44 -163     0K    16K WAIT   0   0:00  0.00% swi1: ipfwd
       18 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu4
       14 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu8
       13 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu9
       12 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu10
       11 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu11
       16 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu6
       17 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu5
       15 root            1 171   52     0K    16K CPU0   0   0:00  0.00% idle: cpu7

    --------------
    only 900 + sessions on firewall:

    sri@f1> show security flow session summary
    node0:
    --------------------------------------------------------------------------
    Unicast-sessions: 915
    Multicast-sessions: 0
    Failed-sessions: 0
    Sessions-in-use: 973
      Valid sessions: 915
      Pending sessions: 0
      Invalidated sessions: 58
      Sessions in other states: 0
    Maximum-sessions: 131072

    node1:
    --------------------------------------------------------------------------
    Unicast-sessions: 924
    Multicast-sessions: 0
    Failed-sessions: 0
    Sessions-in-use: 978
      Valid sessions: 924
      Pending sessions: 0
      Invalidated sessions: 54
      Sessions in other states: 0
    Maximum-sessions: 131072

    {primary:node0}

    ----------------------

    Output of show log message:

    Sep  1 15:57:58  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=94
    Sep  1 15:58:03  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=99
    Sep  1 15:58:08  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=90
    Sep  1 15:58:14  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=97
    Sep  1 15:58:16  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=86
    Sep  1 15:58:22  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=98
    Sep  1 15:58:24  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=99
    Sep  1 15:58:46  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=99
    Sep  1 15:58:48  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=96
    Sep  1 15:58:53  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=96
    Sep  1 15:58:55  f1 PERF_MON: RTPERF_CPU_THRESHOLD_EXCEEDED: FPC 0 PIC 0 CPU utilization exceeds threshold, current value=99

    -------------------

    pl help !

     

    thanks



  • 2.  RE: Data plane CPU usage is High

     
    Posted 09-01-2015 15:57

    Hi,

     

    Can you provide a list of the features that you have enabled or attach your configuration.

     

    Also you can enable accounting for the system processes;

     

    >set task accounting on
    >show task accounting

    The first command is hidden so type it in full. 

     

    Even though there are only 1000 sessions what are the pps of the interfaces? Perhaps there is high pps.

     

    Tim



  • 3.  RE: Data plane CPU usage is High

    Posted 09-02-2015 06:53

    Hi Tim,

     

    Thanks for looking my issue.

     

    Enabling accounting will not cause any impact, as this is in production ? Also let me know how to disable it?

     

    this is interface output:

     

    Interface    Link  Input packets        (pps)     Output packets        (pps)
     ge-0/0/0      Up              0          (0)                0          (0)
     gr-0/0/0      Up              0          (0)                0          (0)
     ip-0/0/0      Up              0          (0)                0          (0)
     ge-0/0/1      Up              0          (0)                0          (0)
     ge-0/0/2      Up      210185072          (1)        351222053         (12)
     ge-0/0/3    Down              0          (0)                0          (0)
     ge-0/0/4      Up     6520641414        (184)       5141510236        (186)
     ge-0/0/5      Up   647309567479        (192)     154052858735        (173)
     ge-0/0/6      Up      764059381         (10)       1251431971         (25)
     ge-0/0/7      Up       29462998          (0)         12832620          (0)
     ge-0/0/8      Up   112672479775          (1)     463733917584          (0)
     ge-0/0/9    Down              0          (0)                0          (0)
     ge-0/0/10     Up    38937233992        (160)     182040029084        (166)
     ge-0/0/11   Down              0          (0)                0          (0)
     ge-0/0/12   Down              0          (0)                0          (0)
     ge-0/0/13   Down              0          (0)                0          (0)
     ge-0/0/14   Down              0          (0)                0          (0)
     ge-0/0/15   Down              0          (0)                0          (0)
     ge-5/0/0      Up              0          (0)                0          (0)
     ge-5/0/1      Up              0          (0)                0          (0)
     ge-5/0/2      Up      351313904         (17)        210312678          (1)
     ge-5/0/3    Down              0          (0)                0          (0)
     ge-5/0/4      Up     3284202968          (0)       2698838854          (0)
     ge-5/0/5      Up   160333447670          (1)      48652968437          (0)
     ge-5/0/6      Up      384350346          (0)        628932520          (0)
     ge-5/0/7      Up       24945941          (0)          6042511          (0)
     ge-5/0/8      Up    48694405790          (1)     161037039344          (0)
     ge-5/0/9    Down              0          (0)                0          (0)
     ge-5/0/10     Up       36561257          (0)            49334          (0)
     ge-5/0/11   Down              0          (0)                0          (0)
     ge-5/0/12   Down              0          (0)                0          (0)
     ge-5/0/13   Down              0          (0)                0          (0)
     ge-5/0/14   Down              0          (0)                0          (0)
     ge-5/0/15   Down              0          (0)                0          (0)
     ae0         Down              0          (0)                0          (0)
     fab0          Up      210185072          (1)        351222053         (12)
     fab1          Up      351313904         (17)        210312678          (1)
     fxp0          Up       24955525                        125834
     fxp1          Up     1456435679                    1860878415

     

    and currently usage is around 3 % I am sure after sometime it will again reach to more than 80 %

     

    show security monitoring fpc 0
    node0:
    --------------------------------------------------------------------------
    FPC 0
      PIC 0
        CPU utilization          :    3 %
        Memory utilization       :   69 %
        Current flow session     :  894
        Current flow session IPv4:  894
        Current flow session IPv6:    0
        Max flow session         : 131072
    Total Session Creation Per Second (for last 96 seconds on average):   24
    IPv4  Session Creation Per Second (for last 96 seconds on average):   24
    IPv6  Session Creation Per Second (for last 96 seconds on average):    0



  • 4.  RE: Data plane CPU usage is High

     
    Posted 09-01-2015 18:02

    Hello,

     

    Can you provide the configuration of the cluster here?

    Can you also get the output of following commands?

     

    1) show chassis forwarding

    2) start shell

         top -H

     

    Regards,

     

    Rushi



  • 5.  RE: Data plane CPU usage is High

    Posted 09-02-2015 06:56

    Hi Rushi,

     

    Below is the outuput as you asked:

     

    show chassis forwarding
    node0:
    --------------------------------------------------------------------------
    FWDD status:
      State                                 Online
      Microkernel CPU utilization         9 percent
      Real-time threads CPU utilization   0 percent
      Heap utilization                   69 percent
      Buffer utilization                  1 percent
      Uptime:                               339 days, 4 hours, 55 minutes, 9 seconds

    node1:
    --------------------------------------------------------------------------
    FWDD status:
      State                                 Online
      Microkernel CPU utilization         6 percent
      Real-time threads CPU utilization   0 percent
      Heap utilization                   69 percent
      Buffer utilization                  1 percent
      Uptime:                               339 days, 9 hours, 34 minutes, 53 seconds

     

    % top -H
    last pid:  4898;  load averages:  0.17,  0.18,  0.12                                                                                           up 339+04:59:08 08:55:08
    76 processes:  4 running, 71 sleeping, 1 zombie
    CPU states: 77.2% user,  0.0% nice,  1.8% system,  0.0% interrupt, 21.0% idle
    Mem: 223M Active, 91M Inact, 567M Wired, 17M Cache, 112M Buf, 72M Free
    Swap:

      PID USERNAME     PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND
     1337 root         139    0   514M 49252K CPU1   1    ??? 90.97% flowd_octeon_hm
     1337 root         139    0   514M 49252K CPU3   3    ??? 90.97% flowd_octeon_hm
     1337 root         139    0   514M 49252K CPU2   2    ??? 90.19% flowd_octeon_hm
     1337 root          78    0   514M 49252K select 0    ???  6.01% flowd_octeon_hm
     1337 root          76    0   514M 49252K select 0    ???  0.00% flowd_octeon_hm
     1337 root          76    0   514M 49252K select 0    ???  0.00% flowd_octeon_hm
     1337 root           8    0   514M 49252K nanslp 0    ???  0.00% flowd_octeon_hm
     1498 root         139    0 10564K  2380K select 0  32.5H  0.00% nstraced
     1348 root          76    0 12480K  2648K select 0  25.6H  0.00% license-check
     1502 root           4    0 22832K  4840K kqread 0  23.4H  0.00% eswd
     1376 root          76    0 10180K  1900K select 0  19.2H  0.00% ppmd
     1505 root          76    0 27688K  6356K select 0  17.6H  0.00% mib2d
     1345 root          76    0 19504K  4196K select 0 789:53  0.00% utmd
     1343 root          76    0 13712K  3000K select 0 789:50  0.00% rtlogd
     1486 root          76    0 20280K  3360K select 0 736:56  0.00% l2ald
     1504 root          76    0 21868K 11444K select 0 657:10  0.00% snmpd
     1509 root          76    0 27076K  8260K select 0 628:17  0.00% nsd
     1339 root          76    0 15736K  1540K select 0 570:06  0.00% shm-rtsdbd
     1340 root          76    0 13996K  4056K select 0 492:25  0.00% jsrpd
     1328 root          76    0 12712K  1908K select 0 430:03  0.00% alarmd
     1491 root          76    0 46608K  4852K select 0 429:57  0.00% authd
     1513 root          76    0   115M  8172K select 0 416:22  0.00% chassisd
     1512 root          76    0 27268K  6532K select 0 366:41  0.00% kmd
     1506 root          76    0 23404K  3352K select 0 341:36  0.00% pfed
     1506 root          76    0 23404K  3352K select 0 341:36  0.00% pfed
     1324 root          76    0  3304K   316K select 0 236:52  0.00% bslockd
     1496 root          76    0 13552K  3384K select 0 168:29  0.00% httpd-gk
     1485 root           4    0 51504K 12336K kqread 0 125:50  0.00% rpd
     1347 root          76    0 13844K  2568K select 0 122:01  0.00% wland
     1347 root          76    0 13844K  2568K select 0 122:01  0.00% wland
     1347 root          76    0 13844K  2568K select 0 122:01  0.00% wland
     1508 root          76    0  7940K  1284K select 0  81:48  0.00% irsd
     1005 root          76    0 17076K  5844K select 0  75:05  0.00% eventd
     1503 root          76    0 34712K  3832K select 0  61:00  0.00% dcd
     1495 root          76    0 14312K  1684K select 0  56:25  0.00% pkid
     1511 root          76    0 16976K  1856K select 0  48:25  0.00% smid
     1484 root          76    0  3188K  2804K select 0  39:58  0.00% ntpd

     

    thanks



  • 6.  RE: Data plane CPU usage is High

     
    Posted 09-02-2015 11:29

    Hello,

     

    Output looks clean & nothing to worry about at least when the commands were executed.

     

    Is it possible for you to execute those commands at the time of the issue?

    Is it possible for you to attach the 'rsi' or 'configuration' here?

     

    Regards,

     

    Rushi



  • 7.  RE: Data plane CPU usage is High

    Posted 09-02-2015 11:43

    Hi Rushi,

     

    Yes, currently it is normal, I am sure it will happen again.

     

    Due to company restriction will not able to put the complete config here, if you need any specific config pl let me know I will share to you.

     

    Thanks



  • 8.  RE: Data plane CPU usage is High

     
    Posted 09-02-2015 12:06

    Hello,

     

    Can ypu take the output of same commands at the time of the issue?

     

    1) show chassis forwarding

    2) start shell

         top -H

     

    Regards,

     

    Rushi



  • 9.  RE: Data plane CPU usage is High

    Posted 09-16-2015 10:30

    Again same:

     

    f2> show chassis forwarding
    node0:
    --------------------------------------------------------------------------
    FWDD status:
      State                                 Online
      Microkernel CPU utilization         7 percent
      Real-time threads CPU utilization   0 percent
      Heap utilization                   69 percent
      Buffer utilization                  1 percent
      Uptime:                               289 days, 9 hours, 26 minutes, 5 seconds

    node1:
    --------------------------------------------------------------------------
    FWDD status:
      State                                 Online
      Microkernel CPU utilization        10 percent
      Real-time threads CPU utilization  40 percent
      Heap utilization                   69 percent
      Buffer utilization                  1 percent
      Uptime:                               289 days, 8 hours, 47 minutes, 35 seconds

     

    ===============

     

    % top -H
    last pid: 60991;  load averages:  0.09,  0.12,  0.08   up 289+08:51:25 12:25:36
    53 processes:  5 running, 47 sleeping, 1 zombie
    CPU states: 76.3% user,  0.0% nice,  1.3% system,  0.0% interrupt, 22.4% idle
    Mem: 131M Active, 128M Inact, 545M Wired, 116M Cache, 112M Buf, 50M Free
    Swap:

      PID USERNAME     PRI NICE   SIZE    RES STATE  C   TIME   WCPU COMMAND
     1340 root         139    0   514M 62416K CPU1   1    ??? 93.21% flowd_octeon_h
     1340 root         139    0   514M 62416K CPU2   2    ??? 93.21% flowd_octeon_h
     1340 root         139    0   514M 62416K CPU3   3    ??? 93.21% flowd_octeon_h
     1340 root          78    0   514M 62416K RUN    0    ???  5.22% flowd_octeon_h
     1340 root          76    0   514M 62416K select 0    ???  0.00% flowd_octeon_h
     1340 root          76    0   514M 62416K select 0    ???  0.00% flowd_octeon_h
     1340 root           8    0   514M 62416K nanslp 0    ???  0.00% flowd_octeon_h
     1351 root          76    0 12484K  6336K select 0  21.7H  0.00% license-check
     1391 root          76    0 29652K 12736K select 0 768:25  0.00% mib2d
     1330 root          76    0   114M 17372K select 0 507:03  0.00% chassisd
     1346 root          76    0 13716K  6200K select 0 494:27  0.00% rtlogd
     1342 root          76    0 15736K  3608K select 0 419:20  0.00% shm-rtsdbd
     1331 root          76    0 12716K  5780K select 0 358:23  0.00% alarmd
     1343 root          76    0 13844K  6756K select 0 268:11  0.00% jsrpd
     1390 root          76    0 23408K  9104K select 0 259:03  0.00% pfed
     1390 root          76    0 23408K  9104K select 0 259:03  0.00% pfed
    %

     

    ==============

     

    f2> show chassis cluster status
    Cluster ID: 1
    Node                  Priority          Status    Preempt  Manual failover

    Redundancy group: 0 , Failover count: 0
        node0                   100         primary        no       no
        node1                   1           secondary      no       no

    Redundancy group: 1 , Failover count: 1
        node0                   100         secondary      no       no
        node1                   1           primary        no       no

     

    ================

     

    f2> show security monitoring fpc 0
    node0:
    --------------------------------------------------------------------------
    FPC 0
      PIC 0
        CPU utilization          :    0 %
        Memory utilization       :   69 %
        Current flow session     : 3163
        Current flow session IPv4: 3163
        Current flow session IPv6:    0
        Max flow session         : 131072
    Total Session Creation Per Second (for last 96 seconds on average):   35
    IPv4  Session Creation Per Second (for last 96 seconds on average):   35
    IPv6  Session Creation Per Second (for last 96 seconds on average):    0

    node1:
    --------------------------------------------------------------------------
    FPC 0
      PIC 0
        CPU utilization          :   81 %
        Memory utilization       :   69 %
        Current flow session     : 3102
        Current flow session IPv4: 3102
        Current flow session IPv6:    0
        Max flow session         : 131072
    Total Session Creation Per Second (for last 96 seconds on average):   52
    IPv4  Session Creation Per Second (for last 96 seconds on average):   52
    IPv6  Session Creation Per Second (for last 96 seconds on average):    0

    {secondary:node1}

     

    ==================



  • 10.  RE: Data plane CPU usage is High

    Posted 08-01-2022 06:32
    Hi Erdem,

    Did you get any resolution here for CPU high, why I am asking because I am facing the same issue here? If you got any solution please let me know.

    ------------------------------
    AJEET SINGH
    ------------------------------