Original Message:
Sent: 2/11/2023 11:19:00 AM
From: Olivier Benghozi
Subject: RE: Junos reports powersupply problem but (show chassis environment) says all ok !!!
The show commands say that on the 3 switches, Power Supply 0 is «OK» whereas Power Supply 1 is «Present», and there's no power delivered by the three PEM 1.
Seems like one power source is on (with all the PEM0 plugged on it) and the other one is off (with all the PEM1) in your rack.
------------------------------
Olivier Benghozi
------------------------------
Original Message:
Sent: 02-10-2023 06:04
From: David Rad
Subject: Junos reports powersupply problem but (show chassis environment) says all ok !!!
Dear Juniper Experts ,
We see a very strange alaram from our qfx5110-48s-4c ( 3 chassis - VC ) switches .
At the same time two PSUs from diffrent chassis are not powered on .
After checking the logs we see no problem with the PSUs or the hardware al temperatures looks good based on the output , Can it be a bug or maybe we are missing something ?
I would really approcite your help on this one .
Many thanks
Dave
#show log chassisd
Feb 10 18:02:20 [Alarm SET] Object 75 reason 24 Device FRU PEM 1, reason PEM 1 No Power(FPC0: PEM 1 Not Powered), color 1, slot 1 Alarm id 1258356760
Feb 10 18:02:20 send: red alarm set, device FRU PEM 1, reason FPC0: PEM 1 Not Powered
Feb 10 18:02:22 ch_tvp_mcontrol_ipc_handler: got alarm status from member: 2
Feb 10 18:02:22 ch_tvp_save_alarm_info ob=75, slot=2, reason=24
Feb 10 18:02:22 send: red alarm set, device FRU PEM 1, reason FPC2: PEM 1 Not Powered
Feb 10 18:02:25 CHASSISD_SNMP_TRAP10: SNMP trap generated: FRU power off (jnxFruContentsIndex 2, jnxFruL1Index 1, jnxFruL2Index 2, jnxFruL3Index 0, jnxFruName Power Supply 1 @ 0/1/*, jnxFruType 7, jnxFruSlot 1, jnxFruOfflineReason 2, jnxFruLastPowerOff 0, jnxFruLastPowerOn 0)
Feb 10 18:02:25 pem_tvp_periodic cbd=950d580 slot=1, state=1
Feb 10 18:02:25 pem_tvp_periodic cbd=950d580 slot=1, state=1
Feb 10 18:02:25 pem_tvp_periodic cbd=951d780 slot=2, state=1
Feb 10 18:02:25 pem_tvp_periodic cbd=951d780 slot=2, state=1
Feb 10 18:02:25 ch_tvp_mcontrol_ipc_handler: got alarm status from member: 1
Feb 10 18:02:25 ch_tvp_save_alarm_info ob=75, slot=1, reason=24
Feb 10 18:02:25 send: red alarm set, device FRU PEM 1, reason FPC1: PEM 1 Not Powered
Feb 10 18:02:26 CHASSISD_SNMP_TRAP10: SNMP trap generated: Fru Offline (jnxFruContentsIndex 2, jnxFruL1Index 3, jnxFruL2Index 2, jnxFruL3Index 0, jnxFruName Power Supply 1 @ 2/1/*, jnxFruType 7, jnxFruSlot 5, jnxFruOfflineReason 2, jnxFruLastPowerOff -1800567876, jnxFruLastPowerOn 1935977028)
Feb 10 18:02:30 pem_tvp_periodic cbd=950d580 slot=1, state=1
Feb 10 18:02:30 pem_tvp_periodic cbd=950d580 slot=1, state=1
Feb 10 18:02:30 pem_tvp_periodic cbd=951d780 slot=2, state=1
Feb 10 18:02:30 pem_tvp_periodic cbd=951d780 slot=2, state=1
Feb 10 18:02:30 CHASSISD_SNMP_TRAP10: SNMP trap generated: Fru Offline (jnxFruContentsIndex 2, jnxFruL1Index 2, jnxFruL2Index 2, jnxFruL3Index 0, jnxFruName Power Supply 1 @ 1/1/*, jnxFruType 7, jnxFruSlot 3, jnxFruOfflineReason 2, jnxFruLastPowerOff -1800567538, jnxFruLastPowerOn 1935977516)
Feb 10 18:02:31 CHASSISD_SNMP_TRAP6: SNMP trap generated: Power Supply failed (jnxContentsContainerIndex 2, jnxContentsL1Index 1, jnxContentsL2Index 2, jnxContentsL3Index 0, jnxContentsDescr Power Supply 1 @ 0/1/*, jnxOperatingState 6)
Feb 10 18:02:31 CHASSISD_SNMP_TRAP6: SNMP trap generated: Power Supply failed (jnxContentsContainerIndex 2, jnxContentsL1Index 2, jnxContentsL2Index 2, jnxContentsL3Index 0, jnxContentsDescr Power Supply 1 @ 1/1/*, jnxOperatingState 6)
Feb 10 18:02:31 CHASSISD_SNMP_TRAP6: SNMP trap generated: Power Supply failed (jnxContentsContainerIndex 2, jnxContentsL1Index 3, jnxContentsL2Index 2, jnxContentsL3Index 0, jnxContentsDescr Power Supply 1 @ 2/1/*, jnxOperatingState 6)
#show system alarms
2 alarms currently active
Alarm time Class Description
2023-02-10 18:02:22 UTC Major FPC2: PEM 1 Not Powered
2023-02-10 18:02:20 UTC Major FPC0: PEM 1 Not Powered
root@qfx01> show chassis environment
Class Item Status Measurement
Power FPC 0 Power Supply 0 OK 53 degrees C / 127 degrees F
FPC 0 Power Supply 1 Present
FPC 1 Power Supply 0 OK
FPC 1 Power Supply 1 Present
FPC 2 Power Supply 0 OK
FPC 2 Power Supply 1 Present
Temp FPC 0 Sensor TopLeft I OK 44 degrees C / 111 degrees F
FPC 0 Sensor TopLeft E2 OK 37 degrees C / 98 degrees F
FPC 0 Sensor TopCenter E2 OK 39 degrees C / 102 degrees F
FPC 0 Sensor TopLeft E1 OK 41 degrees C / 105 degrees F
FPC 0 Sensor CPULeft I OK 40 degrees C / 104 degrees F
FPC 0 Sensor CPURight I OK 39 degrees C / 102 degrees F
FPC 0 Sensor CPU Die Temp OK 49 degrees C / 120 degrees F
FPC 0 Sensor TopRight OCXO OK 39 degrees C / 102 degrees F
FPC 0 Sensor TopRight E OK 41 degrees C / 105 degrees F
FPC 0 Sensor BottomLeft E OK 42 degrees C / 107 degrees F
FPC 0 Sensor TopRight I OK 34 degrees C / 93 degrees F
FPC 0 Sensor TopCenter E1 OK 39 degrees C / 102 degrees F
FPC 1 Sensor TopLeft I OK 42 degrees C / 107 degrees F
FPC 1 Sensor TopLeft E2 OK 35 degrees C / 95 degrees F
FPC 1 Sensor TopCenter E2 OK 37 degrees C / 98 degrees F
FPC 1 Sensor TopLeft E1 OK 40 degrees C / 104 degrees F
FPC 1 Sensor CPULeft I OK 38 degrees C / 100 degrees F
FPC 1 Sensor CPURight I OK 38 degrees C / 100 degrees F
FPC 1 Sensor CPU Die Temp OK 48 degrees C / 118 degrees F
FPC 1 Sensor TopRight OCXO OK 38 degrees C / 100 degrees F
FPC 1 Sensor TopRight E OK 40 degrees C / 104 degrees F
FPC 1 Sensor BottomLeft E OK 40 degrees C / 104 degrees F
FPC 1 Sensor TopRight I OK 32 degrees C / 89 degrees F
FPC 1 Sensor TopCenter E1 OK 37 degrees C / 98 degrees F
FPC 2 Sensor TopLeft I OK 40 degrees C / 104 degrees F
FPC 2 Sensor TopLeft E2 OK 35 degrees C / 95 degrees F
FPC 2 Sensor TopCenter E2 OK 34 degrees C / 93 degrees F
FPC 2 Sensor TopLeft E1 OK 38 degrees C / 100 degrees F
FPC 2 Sensor CPULeft I OK 36 degrees C / 96 degrees F
FPC 2 Sensor CPURight I OK 36 degrees C / 96 degrees F
FPC 2 Sensor CPU Die Temp OK 49 degrees C / 120 degrees F
FPC 2 Sensor TopRight OCXO OK 37 degrees C / 98 degrees F
FPC 2 Sensor TopRight E OK 37 degrees C / 98 degrees F
FPC 2 Sensor BottomLeft E OK 37 degrees C / 98 degrees F
FPC 2 Sensor TopRight I OK 30 degrees C / 86 degrees F
FPC 2 Sensor TopCenter E1 OK 34 degrees C / 93 degrees F
Fans FPC 0 Fan Tray 0 OK Spinning at normal speed
FPC 0 Fan Tray 1 OK Spinning at normal speed
FPC 0 Fan Tray 2 OK Spinning at normal speed
FPC 0 Fan Tray 3 OK Spinning at normal speed
FPC 0 Fan Tray 4 OK Spinning at normal speed
FPC 1 Fan Tray 0 OK Spinning at normal speed
FPC 1 Fan Tray 1 OK Spinning at normal speed
FPC 1 Fan Tray 2 OK Spinning at normal speed
FPC 1 Fan Tray 3 OK Spinning at normal speed
FPC 1 Fan Tray 4 OK Spinning at normal speed
FPC 2 Fan Tray 0 OK Spinning at normal speed
FPC 2 Fan Tray 1 OK Spinning at normal speed
FPC 2 Fan Tray 2 OK Spinning at normal speed
FPC 2 Fan Tray 3 OK Spinning at normal speed
FPC 2 Fan Tray 4 OK Spinning at normal speed
{master:0}
# root@qfx01> show chassis environment pem
localre:
--------------------------------------------------------------------------
FPC 0 PEM 0 status:
State Online
Airflow Front to Back
Temp Sensor 0 OK 53 degrees C / 127 degrees F
Temp Sensor 1 OK 29 degrees C / 84 degrees F
Temp Sensor 2 OK 23 degrees C / 73 degrees F
Fan 0 4680 RPM
Fan 1 4680 RPM
DC Output Voltage(V) Current(A) Power(W) Load(%)
12 10 120 18
FPC 1 PEM 0 status:
State Online
Airflow Front to Back
Temperature OK
DC Output Voltage(V) Current(A) Power(W) Load(%)
12 10 120 18
FPC 2 PEM 0 status:
State Online
Airflow Front to Back
Temperature OK
DC Output Voltage(V) Current(A) Power(W) Load(%)
12 9 108 16
fpc1:
--------------------------------------------------------------------------
FPC 1 PEM 0 status:
State Online
Airflow Front to Back
Temp Sensor 0 OK 46 degrees C / 114 degrees F
Temp Sensor 1 OK 38 degrees C / 100 degrees F
Temp Sensor 2 OK 30 degrees C / 86 degrees F
Fan 0 4140 RPM
Fan 1 3960 RPM
DC Output Voltage(V) Current(A) Power(W) Load(%)
12 10 120 18
fpc2:
--------------------------------------------------------------------------
FPC 2 PEM 0 status:
State Online
Airflow Front to Back
Temp Sensor 0 OK 52 degrees C / 125 degrees F
Temp Sensor 1 OK 29 degrees C / 84 degrees F
Temp Sensor 2 OK 22 degrees C / 71 degrees F
Fan 0 4140 RPM
Fan 1 3900 RPM
DC Output Voltage(V) Current(A) Power(W) Load(%)
12 10 120 18
------------------------------
David Rad
------------------------------