Switching

 View Only
last person joined: 2 days ago 

Ask questions and share experiences about EX and QFX portfolios and all switching solutions across your data center, campus, and branch locations.
  • 1.  Odd messages with in Syslog entries

    Posted 07-14-2022 10:59
    We have been slowly replacing some Cisco Switches with Juniper EX2300 across our campus. Over the past two months we have replaced 18 and out of those 18 we had three all of sudden report some critical errors.  These errors were reported to our Solarwinds/Orion system. 

    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: NIST_FAIL_IRQ: 0
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: dev.bcmrng.#.underflow_maxcycle: 2
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: FIFO_UNDER_RUN_IRQ: 0
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: dev.bcmrng.#.rounds: 115435374
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: 512 bit FIFO configured
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: MASTER_FAIL_LOCKOUT_IRQ: 2147483648
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: dev.bcmrng.#.underflow: 31156042
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: TOTAL_BITS_MAX_IRQ: 2
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: FIFO_FULL_IRQ: 0
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: RBG_DIV_CTRL: 03
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: RBG RESET! (1x)
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: RNG rev 2, RBG rev 1
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: TOTAL_BITS_COUNT_IRQ: 1
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: TOTAL_BIT_COUNT_THRESHOLD: 36864
    7/4/2022 9:56:46 PM Critical kernel: bcmrng0: RNG_TOTAL_BIT_COUNT: 4294967295


    All of the switches are:  Model: ex2300-48p / Junos: 20.4R3-S3.4


    I have searched as far as I could trying to find out what could cause this and if its an issue or just a fluke instance. During the time the switches reported these errors there was no usage on them.

    Any information or help or ideas will be greatly appreciated.

    ------------------------------
    david brown
    ------------------------------


  • 2.  RE: Odd messages with in Syslog entries

    This message was posted by a user wishing to remain anonymous
    Posted 10-05-2023 09:45
    This message was posted by a user wishing to remain anonymous

    Hello David,

    The same logs have recently been observed on 5 ACXs. Were you able to resolve this please?
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: RNG_TOTAL_BIT_COUNT: 4294967295
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: TOTAL_BIT_COUNT_THRESHOLD: 36864
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: TOTAL_BITS_COUNT_IRQ: 1
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: TOTAL_BITS_MAX_IRQ: 2
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: FIFO_FULL_IRQ: 0
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: FIFO_OVER_RUN_IRQ: 0
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: FIFO_UNDER_RUN_IRQ: 0
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: NIST_FAIL_IRQ: 0
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: MASTER_FAIL_LOCKOUT_IRQ: 2147483648
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: RBG_DIV_CTRL: 03
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: dev.bcmrng.#.rounds: 78733187
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: dev.bcmrng.#.underflow: 1
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: dev.bcmrng.#.underflow_maxcycle: 0
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: 512 bit FIFO configured
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: RNG rev 2, RBG rev 1
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: RBG RESET! (1x)
    Jul 5 04:57:02 PE-01 kernel: bcmrng0: Internal Shutdown

    And is ongoing:

    Oct 4 03:49:59 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 04:04:59 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 04:19:59 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 04:34:59 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 04:49:59 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 05:05:00 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 05:20:00 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 05:35:00 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 05:50:00 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 06:05:00 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 06:20:00 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 06:35:00 PE-01 kernel: bcmrng0: Internal Shutdown
    Oct 4 06:50:00 PE-01 kernel: bcmrng0: Internal Shutdown

    Kind regards,
    Kritika.




  • 3.  RE: Odd messages with in Syslog entries

    This message was posted by a user wishing to remain anonymous
    Posted 18 days ago
    This message was posted by a user wishing to remain anonymous

    - see below from Jtac

    'this behavior is matching an internal confidential PR which does not have a specific release fixreported.


    Strange log messages are been noticed on ACX710 routers. It appears a BCMRNG process crashes every 15 minutes.

    Jan 15 22:20:35 BND9 kernel: bcmrng0: 512 bit FIFO configured
    Jan 15 22:20:35 BND9 kernel: bcmrng0: RNG rev 2, RBG rev 1
    Jan 15 22:20:35 BND9 kernel: bcmrng0: RBG RESET! (1x)
    Jan 15 22:20:35 BND9 kernel: bcmrng0: Internal Shutdown

    The above logs indicate that the BCM RBG on the device has detected failure and it does not generate random bits. If it is warming up beyond 30ms, it is assumed to have failed and it logs the "kernel: bcmrng0: Internal Shutdown" and therefore needs a reset.

    Random bit generator(RBG) is a block in the Broadcom chip(BCM) used in multiple Juniper devices such as ACX routers and EX series switches to generate random bits used in various functions.

    - reboot the device under MW to recover it


    Workaround -
    The log "kernel: bcmrng0: Internal Shutdown" will be mitigated if we manually do the following changes:


    > start shell user root
    sysctl dev.bcmrng.0.internal_shutdown=0

    Please check for similar logs and if the 'dev.bcmrng.0.internal_shutdown' is set again, try power cycling the device.'