SRX

Hi!

We're getting  occasional panics and are out of thoughts. It started suddenly and we opened RMA and got replacement 340. Let me shed some lights - before it was running half a year without problem. None. It is weird that even replacement hardware panics every hour. It doesn't matter if i rack it or running on my desk. Finally it will panic.  If more debugging are needed then we're happy to provide it.

Thanks in advance,

A.

JUNOS 15.1X49-D130.6 #0: 2018-03-04 17:25:09 UTC
builder@ralenth.juniper.net:/volume/build/junos/15.1/service/15.1X49-D130.6/obj/octeon/junos/bsd/kernels/JSRXNLE/kernel
real memory = 4294967296 (4194304K bytes)
avail memory = 2621882368 (2500MB)
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
Security policy loaded: JUNOS MAC/runasnonroot (mac_runasnonroot)
Security policy loaded: Junos MAC/veriexec (mac_veriexec)
Security policy loaded: JUNOS MAC/pcap (mac_pcap)
MAC/veriexec fingerprint module loaded: SHA1
MAC/veriexec fingerprint module loaded: SHA256
netisr_init: !debug_mpsafenet, forcing maxthreads from 4 to 1
cpu0 on motherboard
: CAVIUM's OCTEON 70XX/71XX CPU Rev. 0.2 with no FPU implemented
L1 Cache: I size 78kb(128 line), D size 32kb(128 line), thirty two way.
L2 Cache: Size 512kb, 4 way
obio0 on motherboard
uart0: <Octeon-16550 channel 0> on obio0
uart0: console (9600,n,8,1)
twsi0 on obio0
set clock 0x58
xhci0: <Cavium Octeon 7xxx xHCI Host Driver> on obio0
usb0: <USB bus for xHCI Controller> on xhci0
usb0: USB revision 3.0
uhub0: vendor 0x0000 XHCI root hub, class 9/0, rev 3.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
xhci1: <Cavium Octeon 7xxx xHCI Host Driver> on obio0
usb1: <USB bus for xHCI Controller> on xhci1
usb1: USB revision 3.0
uhub1: vendor 0x0000 XHCI root hub, class 9/0, rev 3.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
cpld0 on obio0
pcib0: <Cavium on-chip PCIe HOST bridge> on obio0
Disabling Octeon big bar support
pcib0: Initialized controller
pci0: <PCI bus> on pcib0
pci0: <network, ethernet> at device 0.0 (no driver attached)
pci0: <network, ethernet> at device 0.1 (no driver attached)
ahci0: <Cavium Octeon AHCI> on obio0
ahci0: AHCI v1.30 controller with 2 6Gbps ports, PM supported
ata0: <Cavium Octeon AHCI Channel> on ahci0
ata1: <Cavium Octeon AHCI Channel> on ahci0
gblmem0 on obio0
octpkt0: <Octeon RGMII> on obio0
cfi0: <Macronix MX25L64 - 8MB> on obio0
cfi1: <Macronix MX25L64 - 8MB> on obio0
octagl0: <Octeon AGL> on obio0
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
miibus0: <MII bus> on octagl0
brgphy0: <BCM54616S 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
Timecounter "mips" frequency 1600000000 Hz quality 0
Registered AMT tunnel Encap with UDP Tunnel!
Loading Redundant LT driver
###PCB Group initialized for udppcbgroup
###PCB Group initialized for tcppcbgroup
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
Kernel thread "wkupdaemon" (pid 53) exited prematurely.
Trying to mount root from ufs:/dev/da0s2a
MFSINIT: Initialising MFSROOT
Process-1 beginning MFSROOT initialization...
Creating MFSROOT...
/dev/md0: 20.0MB (40956 sectors) block size 16384, fragment size 2048
using 4 cylinder groups of 5.00MB, 320 blks, 640 inodes.
super-block backups (for fsck -b #) at:
32, 10272, 20512, 30752
Populating MFSROOT...
Creating symlinks...
Setting up mounts...
Continuing boot from MFSROOT...
Attaching /cf/packages/junos via /dev/mdctl...
Mounted junos package on /dev/md1...
M
WARNING: R/W mount of /cf/var denied. Filesystem is not clean - run fsck
mount: /dev/bo0s3f : Operation not permitted
** /dev/bo0s3f
** Last Mounted on /cf/var
** Phase 1 - Check Blocks and Sizes
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Time and ticks drifted too much, resetting synchronization...
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
panic: Hardware watchdog timeout
cpuid = 0
KDB: stack backtrace:
SP 0: not in kernel
uart_sab82532_class+0x0 (0,0,0,0) ra 0 sz 0
pid 30, process: swi5: cambio
Uptime: 8m14s
Cannot dump. No dump device defined.
Automatic reboot in 15 seconds - press a key on the console to abort

NMI Exception on core:0
Watchdog status, core 0: 0xfffecbffffb
FPA INT Summery: 0x2000000000000
Err EPC: 0x80a6d7dc
Trapframe Register Dump:
zero: 0000000000000000 at: fffffffffffffffe v0: 0000000050c808e5 v1: 0000000022bd85ae
a0: 00000000000186a0 a1: ffffffff80dc06b0 a2: 00000000ffff8010 a3: 0000000000000067
t0: 00000000508008a1 t1: 0000000000000000 t2: ffffffff80011800 t3: 0000000000000800
ta0: 0000000000000000 ta1: 0000000000000001 ta2: 0000000000000000 ta3: 0000000000000000
t8: 0000000023c34600 t9: 000000006f35bed1 s0: 000000000537dace s1: 0000000009896800
s2: 000000001d85aaec s3: ffffffffc6e3a14c s4: ffffffff80a90000 s5: 0000000000000100
s6: 0000000000000001 s7: ffffffffc6ee3000 k0: 00bb3f24808b1101 k1: 0034002000040028
gp: ffffffff80ca2a80 sp: ffffffffeafab5d8 s8: ffffffff80b423cc ra: ffffffff8079a9cc
sr: 0000000050c808e5 mullo: 000000000f023000 mulhi: 0000000019000000
pc: ffffffff8015f7bc cause: 0000000040008408 badvaddr: ffffffffc6efa0dc
ErrPC: 0000000000000840
Current ticks/softticks 492920/10854, curproc [30] swi5: cambio
Core0: CacheErr(I/D: current: 0x2000000000000000/0xffffffffffff0000)

PCPU dump:
cpuid = 0
curthread = 0xc6ee3000: pid 30 "swi5: cambio"
ipis = 0x0
cpuid = 1
curthread = 0xc6e61000: pid 20 "idle: cpu1"
ipis = 0x0
cpuid = 2
curthread = 0xc6e5dc60: pid 19 "idle: cpu2"
ipis = 0x0
cpuid = 3
curthread = 0xc6e5da50: pid 18 "idle: cpu3"
ipis = 0x0
cpuid = 4
curthread = none
ipis = 0x0
cpuid = 5
curthread = none
ipis = 0x0
cpuid = 6
curthread = none
ipis = 0x0
cpuid = 7
curthread = none
ipis = 0x0
cpuid = 8
curthread = none
ipis = 0x0
cpuid = 9
curthread = none
ipis = 0x0
cpuid = 10
curthread = none
ipis = 0x0
cpuid = 11
curthread = none
ipis = 0x0
Memory dump of 1024 words starting at 0x80000000
0x80000000: 0829b8e3 401a4000 00000000 00000000
0x80000010: 00100000 00000000 00000000 00000000
0x80000020: 00000000 00000000 00000000 00000000
0x80000030: 00000000 00000000 00000000 00000000
0x80000040: 00000000 00000000 00000000 00000000
0x80000050: 00000000 00000000 00000000 00000000
0x80000060: 00000000 00000000 00000000 00000000
0x80000070: 00000000 00000000 00000000 00000000
0x80000080: 0829b8e3 401a4000 00000000 00000000
0x80000090: 00000000 00000000 00000000 00000000
0x800000a0: 00000000 00000000 00000000 00000000
0x800000b0: 00000000 00000000 00000000 00000000
0x800000c0: 00000000 00000000 00000000 00000000
0x800000d0: 00000000 00000000 00000000 00000000
0x800000e0: 00000000 00000000 00000000 00000000
0x800000f0: 00000000 00000000 00000000 00000000
0x80000100: 3c1b80df 277b2910 7c1a003b 001ad0c0
0x80000110: 035bd821 403ad801 ff7a0000 401a6000
0x80000120: 335a0002 17400005 00000000 3c1a80a7
0x80000130: 275af740 03400008 00000000 3c1a807c
0x80000140: 275aa92c 03400008 00000000 1000ffff
0x80000150: 00000000 42000018 00000000 00000000
0x80000160: 00000000 00000000 00000000 00000000
0x80000170: 00000000 00000000 00000000 00000000
0x80000180: 401a6000 401b6800 335a0010 001ad0c0
0x80000190: 337b007c 037ad825 3c1a80c9 275ac180
0x800001a0: 035bd021 8f5a0000 00000000 03400008
0x800001b0: 00000000 00000000 00000000 00000000
0x800001c0: 00000000 00000000 00000000 00000000
0x800001d0: 00000000 00000000 00000000 00000000
0x800001e0: 00000000 00000000 00000000 00000000
0x800001f0: 00000000 00000000 00000000 00000000
0x80000200: 00000000 00000000 00000000 00000000
0x80000210: 00000000 00000000 00000000 00000000
0x80000220: 00000000 00000000 00000000 00000000
0x80000230: 00000000 00000000 00000000 00000000
0x80000240: 00000000 00000000 00000000 00000000
0x80000250: 00000000 00000000 00000000 00000000
0x80000260: 00000000 00000000 00000000 00000000
0x80000270: 00000000 00000000 00000000 00000000
0x80000280: 00000000 00000000 00000000 00000000
0x80000290: 00000000 00000000 00000000 00000000
0x800002a0: 00000000 00000000 00000000 00000000
0x800002b0: 00000000 00000000 00000000 00000000
0x800002c0: 00000000 00000000 00000000 00000000
0x800002d0: 00000000 00000000 00000000 00000000
0x800002e0: 00000000 00000000 00000000 00000000
0x800002f0: 00000000 00000000 00000000 00000000
0x80000300: 00000000 00000000 00000000 00000000
0x80000310: 00000000 00000000 00000000 00000000
0x80000320: 00000000 00000000 00000000 00000000
0x80000330: 00000000 00000000 00000000 00000000
0x80000340: 00000000 00000000 00000000 00000000
0x80000350: 00000000 00000000 00000000 00000000
0x80000360: 00000000 00000000 00000000 00000000
0x80000370: 00000000 00000000 00000000 00000000
0x80000380: 00000000 00000000 00000000 00000000
0x80000390: 00000000 00000000 00000000 00000000
0x800003a0: 00000000 00000000 00000000 00000000
0x800003b0: 00000000 00000000 00000000 00000000
0x800003c0: 00000000 00000000 00000000 00000000
0x800003d0: 00000000 00000000 00000000 00000000
0x800003e0: 00000000 00000000 00000000 00000000
0x800003f0: 00000000 00000000 00000000 00000000
Stack trace:
R4K_GetCOUNT+0xc (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x8079a9cc sz 0
DELAY+0x54 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801dc318 sz 32
shutdown_panic+0x54 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801dd608 sz 32
boot+0x7a4 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801ddee4 sz 48
panic+0x580 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x807b43b4 sz 64
panic_on_watchdog_timeout+0x78 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x807da754 sz 32
re_srxsme_watchdog_intr+0x158 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x8078aaac sz 24
mips_handle_this_interrupt+0x8c (0x186a0,0x1,0x80010700,0x508008a1) ra 0x8078ab38 sz 40
mips_handle_interrupts+0x58 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x8078af5c sz 48
mips_interrupt+0x224 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x80a6ed14 sz 32
MipsKernIntr+0x140 (0x1,0,0x80a8969c,0xd5) ra 0x80121e84 sz 368
dadone+0x1a8 (0x1,0,0x80a8969c,0xd5) ra 0 sz 776
pid 30, process: swi5: cambio
Resetting the system now...
cpu_reset: Stopping other CPUs
timeout stopping cpus

SPI stage 1 bootloader (Build time: Dec 9 2017 - 13:45:17)

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:45:17)

SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10fc00000, size: 0x400000
DRAM: 4 GiB
Clearing DRAM...... done
Using default environment

SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
Found valid SPI bootloader at offset: 0x80000, size: 1377808 bytes

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:47:20)

Using DRAM size from environment: 4096 MBytes
SATA0: not available
SATA1: not available
SATA BIST STATUS = 0x0
SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10f000000, size: 0x1000000
DRAM: 4 GiB
Clearing DRAM...... done
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
PCIe: Port 0 link active, 1 lanes, speed gen2
PCIe: Link timeout on port 1, probably the slot is empty
PCIe: Port 2 not in PCIe mode, skipping
Net: octrgmii0
octeon_fdt_broadcom_config: Unknown broadcom phy for octrgmii0
Interface 4 has 1 ports (AGL)
Type the command 'usb start' to scan for USB storage devices.

Boot Media: eUSB usb
Found TPM SLB9660 TT 1.2 by Infineon
TPM initialized
Hit any key to stop autoboot: 0
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
SF: 1048576 bytes @ 0x200000 Read: OK
## Starting application at 0x8f0000a0 ...
Consoles: U-Boot console
Found compatible API, ver. 3.5
USB1:
Starting the controller
USB XHCI 1.00
scanning bus 1 for devices... 2 USB Device(s) found
USB0:
Starting the controller
USB XHCI 1.00
scanning bus 0 for devices... 1 USB Device(s) found
scanning usb for storage devices... 1 Storage Device(s) found

FreeBSD/MIPS U-Boot bootstrap loader, Revision 2.9
(builder@haku.juniper.net, Thu Nov 5 23:17:51 UTC 2015)
Memory: 4096MB
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
[8]Booting from eUSB slice 1
Loading /boot/defaults/loader.conf
/kernel data=0xba0974+0x152ba4 WARN halted endpoint, queueing URB anyway.
Unexpected XHCI event TRB, type: 33, expected: 32, skipping... (0f3a1430 00000001 13000000 01008400)
Error: Mismatch slot ID or index, 0 != 1, field: 0x0, index: 0xffffffff, expect 0x0
Warning: transfer comp code 0x0 != 0x1a (COMP_STOP)
BUG: failure at xhci-ring.c:589/abort_td()!
BUG!

With stock factory default configuration ....

root# usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
panic: Hardware watchdog timeout
cpuid = 0
KDB: stack backtrace:
SP 0: not in kernel
uart_sab82532_class+0x0 (0,0,0,0) ra 0 sz 0
pid 30, process: swi5: cambio
Uptime: 1h0m44s
Dumping 340 MB:usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13

NMI Exception on core:0
Watchdog status, core 0: 0xfffecbffffb
FPA INT Summery: 0x2000000000000
Err EPC: 0x80121cf8
Trapframe Register Dump:
zero: 0000000000000000 at: fffffffffffffffe v0: 0000000050c808e4 v1: ffffffff80121cdc
a0: ffffffffc7085820 a1: ffffffffeafaa418 a2: 0000000000000005 a3: 00000000000000d5
t0: ffffffff80cc90f0 t1: ffffffff80dc06b0 t2: 00000000ffff8010 t3: 0000000000000800
ta0: 0000000000000000 ta1: 0000000000000001 ta2: 0000000000000000 ta3: 0000000000000000
t8: 0000000023c34600 t9: 0000000000000001 s0: ffffffffeafaa418 s1: ffffffffc709b200
s2: ffffffffc6f3d900 s3: ffffffffc6f03a00 s4: ffffffff80ca0000 s5: ffffffff80ca0000
s6: ffffffff80c5409c s7: ffffffff80ca36d0 k0: 00bb3f24808b1101 k1: 0034002000040028
gp: ffffffff80ca2a80 sp: ffffffffeafa9ff0 s8: ffffffffeafaa310 ra: ffffffff8011d144
sr: 0000000050c808e4 mullo: 0000000000000000 mulhi: 0000000000002a25
pc: ffffffff8073349c cause: 0000000040008408 badvaddr: ffffffffc000f084
ErrPC: 0000000000000840
Current ticks/softticks 3641751/3614216, curproc [30] swi5: cambio
Core0: CacheErr(I/D: current: 0x2000000000000000/0xffffffffffff0000)

PCPU dump:
cpuid = 0
curthread = 0xc6ee3000: pid 30 "swi5: cambio"
ipis = 0x0
cpuid = 1
curthread = 0xc6e61000: pid 20 "idle: cpu1"
ipis = 0x0
cpuid = 2
curthread = 0xc6e5dc60: pid 19 "idle: cpu2"
ipis = 0x0
cpuid = 3
curthread = 0xc6e5da50: pid 18 "idle: cpu3"
ipis = 0x0
cpuid = 4
curthread = none
ipis = 0x0
cpuid = 5
curthread = none
ipis = 0x0
cpuid = 6
curthread = none
ipis = 0x0
cpuid = 7
curthread = none
ipis = 0x0
cpuid = 8
curthread = none
ipis = 0x0
cpuid = 9
curthread = none
ipis = 0x0
cpuid = 10
curthread = none
ipis = 0x0
cpuid = 11
curthread = none
ipis = 0x0
Memory dump of 1024 words starting at 0x80000000
0x80000000: 0829b8e3 401a4000 00000000 00000000
0x80000010: 00100000 00000000 00000000 00000000
0x80000020: 00000000 00000000 00000000 00000000
0x80000030: 00000000 00000000 00000000 00000000
0x80000040: 00000000 00000000 00000000 00000000
0x80000050: 00000000 00000000 00000000 00000000
0x80000060: 00000000 00000000 00000000 00000000
0x80000070: 00000000 00000000 00000000 00000000
0x80000080: 0829b8e3 401a4000 00000000 00000000
0x80000090: 00000000 00000000 00000000 00000000
0x800000a0: 00000000 00000000 00000000 00000000
0x800000b0: 00000000 00000000 00000000 00000000
0x800000c0: 00000000 00000000 00000000 00000000
0x800000d0: 00000000 00000000 00000000 00000000
0x800000e0: 00000000 00000000 00000000 00000000
0x800000f0: 00000000 00000000 00000000 00000000
0x80000100: 3c1b80df 277b2910 7c1a003b 001ad0c0
0x80000110: 035bd821 403ad801 ff7a0000 401a6000
0x80000120: 335a0002 17400005 00000000 3c1a80a7
0x80000130: 275af740 03400008 00000000 3c1a807c
0x80000140: 275aa92c 03400008 00000000 1000ffff
0x80000150: 00000000 42000018 00000000 00000000
0x80000160: 00000000 00000000 00000000 00000000
0x80000170: 00000000 00000000 00000000 00000000
0x80000180: 401a6000 401b6800 335a0010 001ad0c0
0x80000190: 337b007c 037ad825 3c1a80c9 275ac180
0x800001a0: 035bd021 8f5a0000 00000000 03400008
0x800001b0: 00000000 00000000 00000000 00000000
0x800001c0: 00000000 00000000 00000000 00000000
0x800001d0: 00000000 00000000 00000000 00000000
0x800001e0: 00000000 00000000 00000000 00000000
0x800001f0: 00000000 00000000 00000000 00000000
0x80000200: 00000000 00000000 00000000 00000000
0x80000210: 00000000 00000000 00000000 00000000
0x80000220: 00000000 00000000 00000000 00000000
0x80000230: 00000000 00000000 00000000 00000000
0x80000240: 00000000 00000000 00000000 00000000
0x80000250: 00000000 00000000 00000000 00000000
0x80000260: 00000000 00000000 00000000 00000000
0x80000270: 00000000 00000000 00000000 00000000
0x80000280: 00000000 00000000 00000000 00000000
0x80000290: 00000000 00000000 00000000 00000000
0x800002a0: 00000000 00000000 00000000 00000000
0x800002b0: 00000000 00000000 00000000 00000000
0x800002c0: 00000000 00000000 00000000 00000000
0x800002d0: 00000000 00000000 00000000 00000000
0x800002e0: 00000000 00000000 00000000 00000000
0x800002f0: 00000000 00000000 00000000 00000000
0x80000300: 00000000 00000000 00000000 00000000
0x80000310: 00000000 00000000 00000000 00000000
0x80000320: 00000000 00000000 00000000 00000000
0x80000330: 00000000 00000000 00000000 00000000
0x80000340: 00000000 00000000 00000000 00000000
0x80000350: 00000000 00000000 00000000 00000000
0x80000360: 00000000 00000000 00000000 00000000
0x80000370: 00000000 00000000 00000000 00000000
0x80000380: 00000000 00000000 00000000 00000000
0x80000390: 00000000 00000000 00000000 00000000
0x800003a0: 00000000 00000000 00000000 00000000
0x800003b0: 00000000 00000000 00000000 00000000
0x800003c0: 00000000 00000000 00000000 00000000
0x800003d0: 00000000 00000000 00000000 00000000
0x800003e0: 00000000 00000000 00000000 00000000
0x800003f0: 00000000 00000000 00000000 00000000
Stack trace:
dadone+0x1c (0xc7085820,0xeafaa418,0x5,0xd5) ra 0x8011d144 sz 776
camisr+0x3cc (0xc7085820,0xeafaa418,0x5,0xd5) ra 0x8011d274 sz 176
xpt_polled_action+0xf4 (0xc7085820,0xeafaa418,0x5,0xd5) ra 0x801219ec sz 48
dadump+0xf4 (0xc7085820,0xeafaa418,0x5,0xd5) ra 0x80798dd8 sz 288
minidumpsys+0x514 (0xc7085820,0xeafaa418,0x5,0xd5) ra 0x80797d90 sz 128
dumpsys+0x4c (0xc7085820,0xeafaa418,0x5,0xd5) ra 0x801dce2c sz 4208
0x801dcd48+0xe4 (0xc7085820,0xeafaa418,0x5,0xd5) ra 0 sz 0
pid 30, process: swi5: cambio
Resetting the system now...
cpu_reset: Stopping other CPUs
timeout stopping cpus

Hello,

Is it continuous panic or predictable frequency panic?

Since RMA did not resolve the issue, can you try to zeroize the device and see if it helps?

You can also try to upgrade it to latest release.

Regards,

Rushi

Hi!

It is predictable - lets say it will panic every 3h or so. Yes, i did zeroize first but it didn't resolve this issue. At the end it won't load kernel.

Loading configuration ...
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
usbd_start_next: error=13
Ignoring watchdog timeout during boot/reboot
Time and ticks drifted too much, resetting synchronization...
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
panic: Hardware watchdog timeout
cpuid = 0
KDB: stack backtrace:
SP 0: not in kernel
uart_sab82532_class+0x0 (0,0,0,0) ra 0 sz 0
pid 30, process: swi5: cambio
Uptime: 9m2s
Cannot dump. No dump device defined.
Automatic reboot in 15 seconds - press a key on the console to abort

NMI Exception on core:0
Watchdog status, core 0: 0xfffeccffffb
FPA INT Summery: 0x2000000000000
Err EPC: 0x8079a9c4
Trapframe Register Dump:
zero: 0000000000000000 at: fffffffffffffffe v0: 0000000050c808e5 v1: 00000000090b0045
a0: 00000000000186a0 a1: ffffffff80dc06b0 a2: 00000000ffff8010 a3: 0000000000000067
t0: 00000000508008a1 t1: 0000000000000000 t2: ffffffff80011800 t3: 0000000000000800
ta0: 0000000000000000 ta1: 0000000000000001 ta2: 0000000000000000 ta3: 0000000000000000
t8: 0000000023c34600 t9: 00000000287f4a94 s0: 000000000551600e s1: 0000000009896800
s2: 0000000003b9a043 s3: ffffffffc6e3a14c s4: ffffffff80a90000 s5: 0000000000000100
s6: 0000000000000001 s7: ffffffffc6ee3000 k0: 00bb3f24808b1101 k1: 0034002000040028
gp: ffffffff80ca2a80 sp: ffffffffeafab5e0 s8: ffffffff80b423cc ra: ffffffff8079a9cc
sr: 0000000050c808e5 mullo: 000000000f023000 mulhi: 0000000019000000
pc: ffffffff8015f7bc cause: 0000000040008408 badvaddr: ffffffffc6efa2dc
ErrPC: 0000000000000840
Current ticks/softticks 540786/55023, curproc [30] swi5: cambio
Core0: CacheErr(I/D: current: 0x2000000000000000/0xffffffffffff0000)

PCPU dump:
cpuid = 0
curthread = 0xc6ee3000: pid 30 "swi5: cambio"
ipis = 0x0
cpuid = 1
curthread = 0xc6e61000: pid 20 "idle: cpu1"
ipis = 0x0
cpuid = 2
curthread = 0xc6e5dc60: pid 19 "idle: cpu2"
ipis = 0x0
cpuid = 3
curthread = 0xc6e5da50: pid 18 "idle: cpu3"
ipis = 0x0
cpuid = 4
curthread = none
ipis = 0x0
cpuid = 5
curthread = none
ipis = 0x0
cpuid = 6
curthread = none
ipis = 0x0
cpuid = 7
curthread = none
ipis = 0x0
cpuid = 8
curthread = none
ipis = 0x0
cpuid = 9
curthread = none
ipis = 0x0
cpuid = 10
curthread = none
ipis = 0x0
cpuid = 11
curthread = none
ipis = 0x0
Memory dump of 1024 words starting at 0x80000000
0x80000000: 0829b8e3 401a4000 00000000 00000000
0x80000010: 00100000 00000000 00000000 00000000
0x80000020: 00000000 00000000 00000000 00000000
0x80000030: 00000000 00000000 00000000 00000000
0x80000040: 00000000 00000000 00000000 00000000
0x80000050: 00000000 00000000 00000000 00000000
0x80000060: 00000000 00000000 00000000 00000000
0x80000070: 00000000 00000000 00000000 00000000
0x80000080: 0829b8e3 401a4000 00000000 00000000
0x80000090: 00000000 00000000 00000000 00000000
0x800000a0: 00000000 00000000 00000000 00000000
0x800000b0: 00000000 00000000 00000000 00000000
0x800000c0: 00000000 00000000 00000000 00000000
0x800000d0: 00000000 00000000 00000000 00000000
0x800000e0: 00000000 00000000 00000000 00000000
0x800000f0: 00000000 00000000 00000000 00000000
0x80000100: 3c1b80df 277b2910 7c1a003b 001ad0c0
0x80000110: 035bd821 403ad801 ff7a0000 401a6000
0x80000120: 335a0002 17400005 00000000 3c1a80a7
0x80000130: 275af740 03400008 00000000 3c1a807c
0x80000140: 275aa92c 03400008 00000000 1000ffff
0x80000150: 00000000 42000018 00000000 00000000
0x80000160: 00000000 00000000 00000000 00000000
0x80000170: 00000000 00000000 00000000 00000000
0x80000180: 401a6000 401b6800 335a0010 001ad0c0
0x80000190: 337b007c 037ad825 3c1a80c9 275ac180
0x800001a0: 035bd021 8f5a0000 00000000 03400008
0x800001b0: 00000000 00000000 00000000 00000000
0x800001c0: 00000000 00000000 00000000 00000000
0x800001d0: 00000000 00000000 00000000 00000000
0x800001e0: 00000000 00000000 00000000 00000000
0x800001f0: 00000000 00000000 00000000 00000000
0x80000200: 00000000 00000000 00000000 00000000
0x80000210: 00000000 00000000 00000000 00000000
0x80000220: 00000000 00000000 00000000 00000000
0x80000230: 00000000 00000000 00000000 00000000
0x80000240: 00000000 00000000 00000000 00000000
0x80000250: 00000000 00000000 00000000 00000000
0x80000260: 00000000 00000000 00000000 00000000
0x80000270: 00000000 00000000 00000000 00000000
0x80000280: 00000000 00000000 00000000 00000000
0x80000290: 00000000 00000000 00000000 00000000
0x800002a0: 00000000 00000000 00000000 00000000
0x800002b0: 00000000 00000000 00000000 00000000
0x800002c0: 00000000 00000000 00000000 00000000
0x800002d0: 00000000 00000000 00000000 00000000
0x800002e0: 00000000 00000000 00000000 00000000
0x800002f0: 00000000 00000000 00000000 00000000
0x80000300: 00000000 00000000 00000000 00000000
0x80000310: 00000000 00000000 00000000 00000000
0x80000320: 00000000 00000000 00000000 00000000
0x80000330: 00000000 00000000 00000000 00000000
0x80000340: 00000000 00000000 00000000 00000000
0x80000350: 00000000 00000000 00000000 00000000
0x80000360: 00000000 00000000 00000000 00000000
0x80000370: 00000000 00000000 00000000 00000000
0x80000380: 00000000 00000000 00000000 00000000
0x80000390: 00000000 00000000 00000000 00000000
0x800003a0: 00000000 00000000 00000000 00000000
0x800003b0: 00000000 00000000 00000000 00000000
0x800003c0: 00000000 00000000 00000000 00000000
0x800003d0: 00000000 00000000 00000000 00000000
0x800003e0: 00000000 00000000 00000000 00000000
0x800003f0: 00000000 00000000 00000000 00000000
Stack trace:
DELAY+0x4c (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801dc318 sz 32
shutdown_panic+0x54 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801dd608 sz 32
boot+0x7a4 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801ddee4 sz 48
panic+0x580 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x807b43b4 sz 64
panic_on_watchdog_timeout+0x78 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x807da754 sz 32
re_srxsme_watchdog_intr+0x158 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x8078aaac sz 24
mips_handle_this_interrupt+0x8c (0x186a0,0x1,0x80010700,0x508008a1) ra 0x8078ab38 sz 40
mips_handle_interrupts+0x58 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x8078af5c sz 48
mips_interrupt+0x224 (0x186a0,0x1,0x80010700,0x508008a1) ra 0x80a6ed14 sz 32
MipsKernIntr+0x140 (0xc6f4bc00,0,0x80a8969c,0xd5) ra 0x80122274 sz 368
dadone+0x598 (0xc6f4bc00,0,0x80a8969c,0xd5) ra 0xffffffff sz 776
VA 0xfffffff7: not in kernel or heuristics failed
_start+0x7fefff3f (0xc6f4bc00,0,0x80a8969c,0xd5) ra 0 sz 0
pid 30, process: swi5: cambio
Resetting the system now...
cpu_reset: Stopping other CPUs
timeout stopping cpus

SPI stage 1 bootloader (Build time: Dec 9 2017 - 13:45:17)

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:45:17)

SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10fc00000, size: 0x400000
DRAM: 4 GiB
Clearing DRAM...... done
Using default environment

SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
Found valid SPI bootloader at offset: 0x80000, size: 1377808 bytes

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:47:20)

Using DRAM size from environment: 4096 MBytes
SATA0: not available
SATA1: not available
SATA BIST STATUS = 0x0
SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10f000000, size: 0x1000000
DRAM: 4 GiB
Clearing DRAM...... done
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
PCIe: Port 0 link active, 1 lanes, speed gen2
PCIe: Link timeout on port 1, probably the slot is empty
PCIe: Port 2 not in PCIe mode, skipping
Net: octrgmii0
octeon_fdt_broadcom_config: Unknown broadcom phy for octrgmii0
Interface 4 has 1 ports (AGL)
Type the command 'usb start' to scan for USB storage devices.

Boot Media: eUSB usb
Found TPM SLB9660 TT 1.2 by Infineon
TPM initialized
Hit any key to stop autoboot: 0
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
SF: 1048576 bytes @ 0x200000 Read: OK
## Starting application at 0x8f0000a0 ...
Consoles: U-Boot console
Found compatible API, ver. 3.5
USB1:
Starting the controller
USB XHCI 1.00
scanning bus 1 for devices... 2 USB Device(s) found
USB0:
Starting the controller
USB XHCI 1.00
scanning bus 0 for devices... 1 USB Device(s) found
scanning usb for storage devices... WARN halted endpoint, queueing URB anyway.
Unexpected XHCI event TRB, type: 33, expected: 32, skipping... (0f3a1430 00000001 13000000 01008401)
Error: Mismatch slot ID or index, 0 != 1, field: 0x0, index: 0xffffffff, expect 0x0
Warning: transfer comp code 0x0 != 0x1a (COMP_STOP)
BUG: failure at xhci-ring.c:589/abort_td()!
BUG!

SPI stage 1 bootloader (Build time: Dec 9 2017 - 13:45:17)

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:45:17)

SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10fc00000, size: 0x400000
DRAM: 4 GiB
Clearing DRAM...... done
Using default environment

SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
Found valid SPI bootloader at offset: 0x80000, size: 1377808 bytes

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:47:20)

Using DRAM size from environment: 4096 MBytes
SATA0: not available
SATA1: not available
SATA BIST STATUS = 0x0
SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10f000000, size: 0x1000000
DRAM: 4 GiB
Clearing DRAM...... done
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
PCIe: Port 0 link active, 1 lanes, speed gen2
PCIe: Link timeout on port 1, probably the slot is empty
PCIe: Port 2 not in PCIe mode, skipping
Net: octrgmii0
octeon_fdt_broadcom_config: Unknown broadcom phy for octrgmii0
Interface 4 has 1 ports (AGL)
Type the command 'usb start' to scan for USB storage devices.

Boot Media: eUSB usb
Found TPM SLB9660 TT 1.2 by Infineon
TPM initialized
Hit any key to stop autoboot: 0
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
SF: 1048576 bytes @ 0x200000 Read: OK
## Starting application at 0x8f0000a0 ...
Consoles: U-Boot console
Found compatible API, ver. 3.5
USB1:
Starting the controller
USB XHCI 1.00
scanning bus 1 for devices... unable to get device descriptor (error=-1)
1 USB Device(s) found
USB0:
Starting the controller
USB XHCI 1.00
scanning bus 0 for devices... 1 USB Device(s) found
scanning usb for storage devices... 0 Storage Device(s) found

FreeBSD/MIPS U-Boot bootstrap loader, Revision 2.9
(builder@haku.juniper.net, Thu Nov 5 23:17:51 UTC 2015)
Memory: 4096MB
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
[6]Booting from eUSB slice 1

can't load '/kernel'
can't load '/kernel.old'
Press Enter to stop auto bootsequencing and to enter loader prompt.

CTRL-A Z for help | 9600 8N1 | NOR | Minicom 2.7 | VT102 | Offline | ttyUSB0

Hello,

Can you refer the link below based on the latest error message you see while booting?

https://kb.juniper.net/InfoCenter/index?page=content&id=KB29811

Regards,

Rushi

After shutdown from button it boots up as expected. Now i installed 15.1X49-D50.3 ( image from 2016 ) and seems, it stays up. Only configuration issue that came up when booted from old image was missing application-set that latest reccomended software didn't complain so i cleaned it up and we will see ...

[edit security policies global policy FTP-ACCESS-TO--EXTERNAL match application]
'junos-ftp-data'
application or application-set must be defined

Today i got this 🙂

Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0,0x80011800,0xf8) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0,0x80011800,0xf8) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0,0x80011800,0xf8) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
xhci_process_cmd_event+0x124 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801891bc sz 64
xhci_scan_ring_event+0xd8 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x801894c4 sz 64
xhci_poll+0x10 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80199d30 sz 24
usbd_dopoll+0x20 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80191e68 sz 24
umass_cam_poll+0x24 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8011d1f0 sz 24
xpt_polled_action+0x70 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x8012184c sz 48
dashutdown+0xa0 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207318 sz 664
boot+0x7a4 (0xc6e3d400,0xc6ee6270,0x80121cdc,0x13c0401) ra 0x80207bf4 sz 48
panic+0x580 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80781730 sz 64
trap+0x1250 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0x80a570ac sz 144
0x80a56f14+0x198 (0xc6e3d400,0x3,0x8000cfe4,0x67) ra 0 sz 0
pid 23, process: swi7: clock
cpu:0-Trap cause = 3 (TLB miss (store) - kernel mode)
badvaddr = 0x1010, pc = 0x80187fd4, ra = 0x801891bc, sr = 0x508008a3
panic: trap
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801ee088 ADR 0xeac19ef0
SR 8f043a00 CR 8f040e98 SP 0x8010013c boundary 0x7
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 80dd8568 CR eac1c098 SP 0 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s
Cannot dump. No dump device defined.
(da0:dead_sim0:0:0:0): Synchronize cache failed, status == 0x8, scsi status == 0x0
ktlbmiss: PC 0x801edf54 RA 0x801891bc ADR 0x1010
SR 13 CR 80a70000 SP 0x80a70000 boundary 0x80a58098
panic: kernel stack overflow
cpuid = 0
Uptime: 19h42m13s

We're running off from usb stick couple of days and discovered that umass0 ( da0 ) will fail in certain point and panic is inevitable. We will open another RMA.  Thank you guys who tried to help 🙂

A.

login: umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
umass0: at uhub0 port 1 (addr 2) disconnected
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
umass0: at uhub0 port 1 (addr 2) disconnected
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
umass0: at uhub0 port 1 (addr 2) disconnected
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
umass0: at uhub0 port 1 (addr 2) disconnected
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
umass0: at uhub0 port 1 (addr 2) disconnected
umass0: detached
umass0: ATP Electronics ATP CG eUSB, rev 2.00/11.00, addr 2
da0 at umass-sim0 bus 0 target 0 lun 0
da0: <ATP ATP CG eUSB 1100> Fixed Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7672MB (15712256 512 byte sectors: 255H 63S/T 978C)
umass0: at uhub0 port 1 (addr 2) disconnected
(da0:umass-sim0:0:0:0): lost device
(da0:umass-sim0:0:0:0): removing device entry
umass0: detached
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci0: ERROR! xHCI do command 11 failed.
xhci0: ERROR! Failed to set address for device, slot 1.
xhci_xdev_uninit+0x160 (0x5080ffa1,0x80a80000,0xffff8010,0x54) ra 0x8016e0f4 sz 80
usbd_remove_device+0x34 (0x5080ffa1,0x80a80000,0xffff8010,0x54) ra 0x8016f2c0 sz 32
usbd_new_device+0x2dc (0xc6e38540,0x80a80000,0xffff8010,0x54) ra 0x80167ae0 sz 1136
uhub_explore+0x2f8 (0xc6e38540,0x80a80000,0xffff8010,0x54) ra 0x8016c580 sz 64
usb_discover+0x44 (0xc6e38540,0x80a80000,0xffff8010,0x54) ra 0x8016cf9c sz 24
usb_event_thread+0x68 (0xc6e38540,0x80a80000,0xffff8010,0x54) ra 0x801baab8 sz 40
fork_exit+0x230 (0xc6e38540,0x80a80000,0xffff8010,0x54) ra 0x80a6f9a0 sz 40
MipsNMIException+0x34 (0xc6e38540,0x80a80000,0xffff8010,0x54) ra 0 sz 0
pid 32, process: usb0
cpu:0-Trap cause = 2 (TLB miss (load or instr. fetch) - kernel mode)
badvaddr = 0x4, pc = 0x80161540, ra = 0x80161510, sr = 0x5080ffa3
panic: trap
cpuid = 0
KDB: stack backtrace:
SP 0: not in kernel
uart_sab82532_class+0x0 (0,0,0,0) ra 0 sz 0
pid 32, process: usb0
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
Ignoring watchdog timeout during boot/reboot
panic: Hardware watchdog timeout
cpuid = 0
Uptime: 34m43s
Dumping 228 MB:Aborting dump due to I/O error.
status == 0xb, scsi status == 0x0

** Dump failed (rc = 5) **
(da1:umass-sim1:1:0:0): Synchronize cache failed, status == 0x34, scsi status == 0x0
Automatic reboot in 15 seconds - press a key on the console to abort

NMI Exception on core:0
Watchdog status, core 0: 0xfffecdffffb
FPA INT Summery: 0x2000000000000
Err EPC: 0x80a6d7dc
Trapframe Register Dump:
zero: 0000000000000000 at: fffffffffffffffe v0: 0000000050c808e5 v1: ffffffffce9f2059
a0: 00000000000186a0 a1: ffffffff80dc06b0 a2: 00000000ffff8010 a3: 0000000000000067
t0: 00000000508008a1 t1: 0000000000000000 t2: ffffffff80011800 t3: 0000000000000800
ta0: 0000000000000000 ta1: 0000000000000001 ta2: 0000000000000000 ta3: 0000000000000000
t8: 0000000023c34600 t9: 0000000000000001 s0: 0000000006419c56 s1: 0000000009896800
s2: ffffffffc85d840f s3: ffffffffc6e3a14c s4: ffffffff80a90000 s5: 0000000000000104
s6: 0000000000000000 s7: ffffffffc6ee3420 k0: 00bb3f24808b1101 k1: 0034002000040028
gp: ffffffff80ca2a80 sp: ffffffffeafb3148 s8: ffffffff80b423cc ra: ffffffff8079a9cc
sr: 0000000050c808e5 mullo: 000000000f023000 mulhi: 0000000019000000
pc: ffffffff801ff7fc cause: 0000000040008408 badvaddr: ffffffffc6e4d61c
ErrPC: 0000000000000840
Current ticks/softticks 1828450/1819714, curproc [32] usb0
Core0: CacheErr(I/D: current: 0x2000000000000000/0xffffffffffff0000)

PCPU dump:
cpuid = 0
curthread = 0xc6ee3420: pid 32 "usb0"
ipis = 0x0
cpuid = 1
curthread = 0xc6e61000: pid 20 "idle: cpu1"
ipis = 0x0
cpuid = 2
curthread = 0xc6e5dc60: pid 19 "idle: cpu2"
ipis = 0x0
cpuid = 3
curthread = 0xc6e5da50: pid 18 "idle: cpu3"
ipis = 0x0
cpuid = 4
curthread = none
ipis = 0x0
cpuid = 5
curthread = none
ipis = 0x0
cpuid = 6
curthread = none
ipis = 0x0
cpuid = 7
curthread = none
ipis = 0x0
cpuid = 8
curthread = none
ipis = 0x0
cpuid = 9
curthread = none
ipis = 0x0
cpuid = 10
curthread = none
ipis = 0x0
cpuid = 11
curthread = none
ipis = 0x0
Memory dump of 1024 words starting at 0x80000000
0x80000000: 0829b8e3 401a4000 00000000 00000000
0x80000010: 00100000 00000000 00000000 00000000
0x80000020: 00000000 00000000 00000000 00000000
0x80000030: 00000000 00000000 00000000 00000000
0x80000040: 00000000 00000000 00000000 00000000
0x80000050: 00000000 00000000 00000000 00000000
0x80000060: 00000000 00000000 00000000 00000000
0x80000070: 00000000 00000000 00000000 00000000
0x80000080: 0829b8e3 401a4000 00000000 00000000
0x80000090: 00000000 00000000 00000000 00000000
0x800000a0: 00000000 00000000 00000000 00000000
0x800000b0: 00000000 00000000 00000000 00000000
0x800000c0: 00000000 00000000 00000000 00000000
0x800000d0: 00000000 00000000 00000000 00000000
0x800000e0: 00000000 00000000 00000000 00000000
0x800000f0: 00000000 00000000 00000000 00000000
0x80000100: 3c1b80df 277b2910 7c1a003b 001ad0c0
0x80000110: 035bd821 403ad801 ff7a0000 401a6000
0x80000120: 335a0002 17400005 00000000 3c1a80a7
0x80000130: 275af740 03400008 00000000 3c1a807c
0x80000140: 275aa92c 03400008 00000000 1000ffff
0x80000150: 00000000 42000018 00000000 00000000
0x80000160: 00000000 00000000 00000000 00000000
0x80000170: 00000000 00000000 00000000 00000000
0x80000180: 401a6000 401b6800 335a0010 001ad0c0
0x80000190: 337b007c 037ad825 3c1a80c9 275ac180
0x800001a0: 035bd021 8f5a0000 00000000 03400008
0x800001b0: 00000000 00000000 00000000 00000000
0x800001c0: 00000000 00000000 00000000 00000000
0x800001d0: 00000000 00000000 00000000 00000000
0x800001e0: 00000000 00000000 00000000 00000000
0x800001f0: 00000000 00000000 00000000 00000000
0x80000200: 00000000 00000000 00000000 00000000
0x80000210: 00000000 00000000 00000000 00000000
0x80000220: 00000000 00000000 00000000 00000000
0x80000230: 00000000 00000000 00000000 00000000
0x80000240: 00000000 00000000 00000000 00000000
0x80000250: 00000000 00000000 00000000 00000000
0x80000260: 00000000 00000000 00000000 00000000
0x80000270: 00000000 00000000 00000000 00000000
0x80000280: 00000000 00000000 00000000 00000000
0x80000290: 00000000 00000000 00000000 00000000
0x800002a0: 00000000 00000000 00000000 00000000
0x800002b0: 00000000 00000000 00000000 00000000
0x800002c0: 00000000 00000000 00000000 00000000
0x800002d0: 00000000 00000000 00000000 00000000
0x800002e0: 00000000 00000000 00000000 00000000
0x800002f0: 00000000 00000000 00000000 00000000
0x80000300: 00000000 00000000 00000000 00000000
0x80000310: 00000000 00000000 00000000 00000000
0x80000320: 00000000 00000000 00000000 00000000
0x80000330: 00000000 00000000 00000000 00000000
0x80000340: 00000000 00000000 00000000 00000000
0x80000350: 00000000 00000000 00000000 00000000
0x80000360: 00000000 00000000 00000000 00000000
0x80000370: 00000000 00000000 00000000 00000000
0x80000380: 00000000 00000000 00000000 00000000
0x80000390: 00000000 00000000 00000000 00000000
0x800003a0: 00000000 00000000 00000000 00000000
0x800003b0: 00000000 00000000 00000000 00000000
0x800003c0: 00000000 00000000 00000000 00000000
0x800003d0: 00000000 00000000 00000000 00000000
0x800003e0: 00000000 00000000 00000000 00000000
0x800003f0: 00000000 00000000 00000000 00000000
Stack trace:
R4K_GetCOUNT+0xc (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x8079a9cc sz 0
DELAY+0x54 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801dc318 sz 32
shutdown_panic+0x54 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801dd608 sz 32
boot+0x7a4 (0x186a0,0x80dc06b0,0xffff8010,0x67) ra 0x801ddee4 sz 48
panic+0x580 (0x186a0,0,0x80b48118,0x11b) ra 0x807b43b4 sz 64
panic_on_watchdog_timeout+0x78 (0x186a0,0,0x80b48118,0x11b) ra 0x807da754 sz 32
re_srxsme_watchdog_intr+0x158 (0x186a0,0,0x80b48118,0x11b) ra 0x8078aaac sz 24
mips_handle_this_interrupt+0x8c (0x186a0,0,0x80b48118,0x11b) ra 0x8078ab38 sz 40
mips_handle_interrupts+0x58 (0x186a0,0,0x80b48118,0x11b) ra 0x8078af5c sz 48
mips_interrupt+0x224 (0x186a0,0,0x80b48118,0x11b) ra 0x80a6ed14 sz 32
MipsKernIntr+0x140 (0xffffffff,0,0x80011800,0x1000) ra 0x807d175c sz 368
octeon_twsi_write_byte+0x20 (0xffffffff,0,0x80011800,0x1000) ra 0x807d1ea4 sz 32
octeon_i2c_xfer_msg_raw+0x404 (0xffffffff,0,0x80011800,0x1000) ra 0x807d2334 sz 56
i2c_write_24lc256_raw+0x7c (0xffffffff,0,0x80011800,0x80d6e910) ra 0x808145fc sz 56
srxsme_dump_on_exception+0x2c8 (0xffffffff,0,0x80011800,0x80d6e910) ra 0x80814728 sz 64
srxsme_dump_on_panic+0x1c (0xffffffff,0,0x80011800,0x80d6e910) ra 0x801dd290 sz 24
boot+0x42c (0xffffffff,0,0x80011800,0x80d6e910) ra 0x801ddee4 sz 48
panic+0x580 (0xffffffff,0,0x80011800,0xf8) ra 0x80794e80 sz 64
trap+0x1250 (0xffffffff,0,0x80011800,0xf8) ra 0x80a6e5ac sz 144
0x80a6e414+0x198 (0xffffffff,0,0x80011800,0xf8) ra 0 sz 0
pid 32, process: usb0
Resetting the system now...
cpu_reset: Stopping other CPUs
timeout stopping cpus

SPI stage 1 bootloader (Build time: Dec 9 2017 - 13:45:17)

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:45:17)

SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10fc00000, size: 0x400000
DRAM: 4 GiB
Clearing DRAM...... done
Using default environment

SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
Found valid SPI bootloader at offset: 0x80000, size: 1377808 bytes

U-Boot 2013.07-JNPR-3.5 (Build time: Dec 09 2017 - 13:47:20)

Using DRAM size from environment: 4096 MBytes
SATA0: not available
SATA1: not available
SATA BIST STATUS = 0x0
SRX_340 board revision major:1, minor:13, serial #: CY5016AF0253
OCTEON CN7130-AAP pass 1.2, Core clock: 1600 MHz, IO clock: 600 MHz, DDR clock: 667 MHz (1334 Mhz DDR)
Base DRAM address used by u-boot: 0x10f000000, size: 0x1000000
DRAM: 4 GiB
Clearing DRAM...... done
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
PCIe: Port 0 link active, 1 lanes, speed gen2
PCIe: Link timeout on port 1, probably the slot is empty
PCIe: Port 2 not in PCIe mode, skipping
Net: octrgmii0
octeon_fdt_broadcom_config: Unknown broadcom phy for octrgmii0
Interface 4 has 1 ports (AGL)
Type the command 'usb start' to scan for USB storage devices.

Boot Media: eUSB usb
Found TPM SLB9660 TT 1.2 by Infineon
TPM initialized
Hit any key to stop autoboot: 0
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
SF: 1048576 bytes @ 0x200000 Read: OK
## Starting application at 0x8f0000a0 ...
Consoles: U-Boot console
Found compatible API, ver. 3.5
USB1:
Starting the controller
USB XHCI 1.00
scanning bus 1 for devices... 2 USB Device(s) found
USB0:
Starting the controller
USB XHCI 1.00
scanning bus 0 for devices... 2 USB Device(s) found
scanning usb for storage devices... 2 Storage Device(s) found

FreeBSD/MIPS U-Boot bootstrap loader, Revision 2.9
(builder@haku.juniper.net, Thu Nov 5 23:17:51 UTC 2015)
Memory: 4096MB
SF: Detected MX25L6405D with page size 256 Bytes, erase size 64 KiB, total 8 MiB
[0]Booting from usb slice 1
Loading /boot/defaults/loader.conf
/kernel data=0xba0974+0x152ba4 syms=[0x4+0xa0810+0x4+0xf0441]

I know this article is over 6 months old but just a few things that I have learnt about the 3xx series of SRX's.

I have had 2 SRX320's throw kernel panics for no particular reason.  Ended up updating LTE firmware on the first 2 and changed some dialer config and the problem went away (im not entirely certain that its actually fixed given that config shouldnt be able to panic a device)

bought a new SRX320 the other day, paniced on its first bootup.  Then panic'd copying the latest firmware from a 'Cruzer Facet USB' stick.  JTAC transferred the call to Australian JTAC who then opened a PR with engineering and was told a day later that the USB was not supported at that was panic'ing the device.  Im almost 100% certain that the first panic (did not even get a chance to change the config, it was factory) happened without the USB but the 2nd one was when i was trying to mount the USB so i will take them at their word.

Never had ANY problems with the SRX2xx series devices, but the 3xx series.... i have little confidence in them sadly.