Labs

Hi there,

For quite a while now I've been labbing infrastructure using an open source product called "Containerlab" (https://containerlab.dev/). Containerlab is an equivalent of EVE-NG except it's primarily aimed at containerised NOS like Nokia SRL and Arista vEOS etc. Containerlab also supports the deployment of traditional VM based devices with the support of vrnetlab (https://github.com/hellt/vrnetlab/). 

Using these products I have been able to successfully lab vSRX, vMX and vQFX devices. I've been working to try add support for both vJunos-Evo and vJunos-Switch however without a lot of success. Hoping to reach out here and get some feedback from those involved in the development process, as I suspect I'm not too far off being able to get them working.

Starting with vJunos-evolved and using the library document here for deploying on KVM, I have been able to successfully build a docker container, validate using the kvm-ok command that we have kvm support inside the container and we have vmx hardware virtualisation support. All of which I already knew, given we're running other Junos VM based products in the same manner and below is the log output confirming that:

root@6c2186c34a18:/# kvm-ok

INFO: /dev/kvm exists

KVM acceleration can be used

root@6c2186c34a18:/# grep -Eoc '(vmx|svm)' /proc/cpuinfo

32

It would be amazing to get these products working in Containerlab as I know much of the Containerlab community are keen on seeing support for them. My main issue is both of the virtual devices seem to actually start booting the Junos operating systems, as such I don't know how else I can troubleshoot this myself.

When the vJunos-Evolved boot process starts, it ends up failing and in a boot loop. I have added both the qemu command line information and the error logs below:

Command:

qemu-system-x86_64 -machine type=pc,accel=kvm -cpu host -m 8192 -smp 4 -display none -smbios type=0,vendor=Bochs,version=Bochs -smbios type=3,manufacturer=Bochs -smbios type=1,manufacturer=Bochs,product=Bochs,serial=chassis_no=0:slot=0:type=1:assembly_id=0x0D20:platform=251:master=0:channelized=no -serial telnet:0.0.0.0:5000,server,nowait -drive file=/vJunosEvolved-23.1R1.8-overlay.qcow2

Error Logs:

containerlab@containerlab:~$ telnet 172.17.0.2 5000

Trying 172.17.0.2...

Connected to 172.17.0.2.

Escape character is '^]'.

[    2.253910] refpga-lpcm fc800000.refpga: Scratch test failed: wr=0x01, rd=0x 0

Watchdog set to 500 seconds

Installing/Mounting on disk /dev/sda mapped to device ata1

Coming back from an uncontrolled reboot, will recreate /data!

Processing /dev/sda2 for mount on /soft ...[checking]..[ok 1]..[mounting]..done

Processing /dev/sda7 for mount on /var ...[checking]..[ok 1]..[mounting]..done

Processing /dev/sda5 for mount on /data ...[checking]..[strong check]..[saving]..[rebuilding]..[mounting]..[restoring]..done

Processing /dev/sda6 for mount on /data/config ...[checking]..[ok 0]..[mounting]..done

Processing /data/var/opt_fs for mount on /data/var/external ...[checking]..[ok 0]..[mounting]..done

mkswap: /dev/sda3: warning: wiping old swap signature.

Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)

no label, UUID=4983cc30-fb62-424e-8477-b1aaf31183de

Processing /dev/sda1 for mount on /boot ...[checking]..[ok 0]..[mounting]..done

Done with local filesystems setup.

NOTE: Now 9 keys in keyring: %keyring:.ima

NOTE: Now keyring is empty %keyring:ima_ext

Postinstall in progress...App manifest not defined in capdb. Skip customizing app policies for this platform ()

done

Installing kexec kernel...done

Warning - Empty root password found

*** Error - Config file not found !

warning: No configured root password

[   42.656218] Control value (4, 0x4), reg address 0x5, reg final addr[0xc0cc1005] label[status-blip]

[   48.226546] ip_local_port_range: prefer different parity for start/end values.

[FAILED] Failed unmounting /etc.

[FAILED] Failed unmounting /var.

[FAILED] Failed deactivating swap /sda3.

[  112.227159] systemd-shutdown[1]: Could not deactivate swap /sda3: No such file or directory

[  112.241494] printk: shutdown: 33 output lines suppressed due to ratelimiting

Shutdown target is 'reboot'

Checking on root FS daemon ........Done

Cleaning up root FS daemon...done

Rebooting.

[  120.286568] reboot: Restarting system

Below are the same details for vJunos-switch, which I also have to the boot stage, but hangs on mounting the boot volume it seems.

Command:

qemu-system-x86_64 -enable-kvm -display none -machine pc -monitor tcp:0.0.0.0:4000,server,nowait -m 8192 -serial telnet:0.0.0.0:5000,server,nowait -drive if=ide,file=/vjunos-switch-23.1R1.8-overlay.qcow2 -smp 4 -smbios type=1,product=VM-VEX

Error Logs:

containerlab@containerlab:~$ telnet 172.17.0.2 5000

Trying 172.17.0.2...

Connected to 172.17.0.2.

Escape character is '^]'.

ok

[    0.000000] Linux version 4.8.28-WR9.0.0.20_standard (builder@svl-jre-ubm1601) (gcc version 6.2.0 (GCC) ) #1 SMP PREEMPT Tue Jan 10 05:16:50 PST 2023

[    0.000000] Command line: BOOT_IMAGE=vmlinuz rootwait max_loop=255 rw clock=pit console=tty0 console=ttyS0,115200 root=PARTUUID=eddefbdd-02 altroot=/dev/vda2 isolcpus=2

[    0.000000] x86/fpu: Legacy x87 FPU detected.

[    0.000000] x86/fpu: Using 'eager' FPU context switches.

[    0.000000] e820: BIOS-provided physical RAM map:

[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable

[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdffff] usable

[    0.000000] BIOS-e820: [mem 0x00000000bffe0000-0x00000000bfffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000023fffffff] usable

[    0.000000] NX (Execute Disable) protection: active

[    0.000000] SMBIOS 2.8 present.

[    0.000000] Hypervisor detected: KVM

[    0.000000] e820: last_pfn = 0x240000 max_arch_pfn = 0x400000000

[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT 

[    0.000000] e820: last_pfn = 0xbffe0 max_arch_pfn = 0x400000000

[    0.000000] found SMP MP-table at [mem 0x000f5b90-0x000f5b9f] mapped at [ffff8800000f5b90]

[    0.000000] Scanning 1 areas for low memory corruption

[    0.000000] ACPI: Early table checksum verification disabled

[    0.000000] ACPI: RSDP 0x00000000000F59D0 000014 (v00 BOCHS )

[    0.000000] ACPI: RSDT 0x00000000BFFE2486 000034 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: FACP 0x00000000BFFE2322 000074 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: DSDT 0x00000000BFFE0040 0022E2 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: FACS 0x00000000BFFE0000 000040

[    0.000000] ACPI: APIC 0x00000000BFFE2396 000090 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: HPET 0x00000000BFFE2426 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: WAET 0x00000000BFFE245E 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] No NUMA configuration found

[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000023fffffff]

[    0.000000] NODE_DATA(0) allocated [mem 0x23fff7000-0x23fffafff]

[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00

[    0.000000] kvm-clock: cpu 0, msr 2:3fff6001, primary cpu clock

[    0.000000] kvm-clock: using sched offset of 2755169503 cycles

[    0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns

[    0.000000] Zone ranges:

[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]

[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]

[    0.000000]   Normal   [mem 0x0000000100000000-0x000000023fffffff]

[    0.000000] Movable zone start for each node

[    0.000000] Early memory node ranges

[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009efff]

[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bffdffff]

[    0.000000]   node   0: [mem 0x0000000100000000-0x000000023fffffff]

[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000023fffffff]

[    0.000000] ACPI: PM-Timer IO Port: 0x608

[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])

[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)

[    0.000000] Using ACPI (MADT) for SMP configuration information

[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000

[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs

[    0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices

[    0.000000] Booting paravirtualized kernel on KVM

[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns

[    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1

[    0.000000] percpu: Embedded 36 pages/cpu @ffff88023fc00000 s107160 r8192 d32104 u524288

[    0.000000] KVM setup async PF for cpu 0

[    0.000000] kvm-stealtime: cpu 0, msr 23fc10000

[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 2064233

[    0.000000] Policy zone: Normal

[    0.000000] Kernel command line: BOOT_IMAGE=vmlinuz rootwait max_loop=255 rw clock=pit console=tty0 console=ttyS0,115200 root=PARTUUID=eddefbdd-02 altroot=/dev/vda2 isolcpus=2

[    0.000000] clocksource: clock= boot option is deprecated - use clocksource=xyz

[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)

[    0.000000] Memory: 8169932K/8388088K available (10610K kernel code, 1329K rwdata, 3312K rodata, 1548K init, 848K bss, 218156K reserved, 0K cma-reserved)

[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1

[    0.000000] Kernel/User page tables isolation: enabled

[    0.000000] Preemptible hierarchical RCU implementation.

[    0.000000] Build-time adjustment of leaf fanout to 64.

[    0.000000] RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.

[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=4

[    0.000000] NR_IRQS:4352 nr_irqs:456 16

[    0.000000] Console: colour VGA+ 80x25

[    0.000000] console [tty0] enabled

[    0.000000] console [ttyS0] enabled

[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns

[    0.000000] tsc: Detected 2100.000 MHz processor

[    0.475279] Calibrating delay loop (skipped) preset value.. 4200.00 BogoMIPS (lpj=2100000)

[    0.480118] pid_max: default: 32768 minimum: 301

[    0.482734] ACPI: Core revision 20160422

[    0.486805] ACPI: 1 ACPI AML tables successfully acquired and loaded

[    0.490713]

[    0.492374] Security Framework initialized

[    0.495943] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)

[    0.505347] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)

[    0.514339] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)

[    0.519143] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)

[    0.526583] mce: CPU supports 10 MCE banks

[    0.530170] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0

[    0.534368] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0

[    0.538659] Spectre V2 : Mitigation: Full generic retpoline

[    0.542686] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch

[    0.548895] Speculative Store Bypass: Vulnerable

[    0.564049] Freeing SMP alternatives memory: 40K (ffffffff822d1000 - ffffffff822db000)

[    0.581375] ftrace: allocating 38335 entries in 150 pages

[    0.735116] smpboot: APIC(0) Converting physical 0 to logical package 0

[    0.739195] smpboot: Max logical packages: 1

[    0.745417] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1

[    0.850652] smpboot: CPU0: Intel QEMU Virtual CPU version 2.5+ (family: 0xf, model: 0x6b, stepping: 0x1)

[    0.857064] Performance Events: unsupported Netburst CPU model 107 no PMU driver, software events only.

[    0.873764] x86: Booting SMP configuration:

[    0.876371] .... node  #0, CPUs:      #1

[    0.890266] kvm-clock: cpu 1, msr 2:3fff6041, secondary cpu clock

[    0.896016] KVM setup async PF for cpu 1

[    0.899387] kvm-stealtime: cpu 1, msr 23fc90000

[    0.905819]  #2

[    0.920185] kvm-clock: cpu 2, msr 2:3fff6081, secondary cpu clock

[    0.932109] KVM setup async PF for cpu 2

[    0.934887] kvm-stealtime: cpu 2, msr 23fd10000

[    0.941794]  #3

[    0.954398] kvm-clock: cpu 3, msr 2:3fff60c1, secondary cpu clock

[    0.960962] KVM setup async PF for cpu 3

[    0.963739] kvm-stealtime: cpu 3, msr 23fd90000

[    0.966861] x86: Booted up 1 node, 4 CPUs

[    0.970318] smpboot: Total of 4 processors activated (16800.00 BogoMIPS)

[    0.978197] devtmpfs: initialized

[    0.981424] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns

[    0.987605] futex hash table entries: 1024 (order: 4, 65536 bytes)

[    0.991652] xor: measuring software checksum speed

[    1.004643]    prefetch64-sse: 17008.000 MB/sec

[    1.016643]    generic_sse: 15572.000 MB/sec

[    1.019475] xor: using function: prefetch64-sse (17008.000 MB/sec)

[    1.023232] pinctrl core: initialized pinctrl subsystem

[    1.026701] NET: Registered protocol family 16

[    1.031896] cpuidle: using governor menu

[    1.034729] ACPI: bus type PCI registered

[    1.037746] PCI: Using configuration type 1 for base access

[    1.047556] HugeTLB registered 2 MB page size, pre-allocated 0 pages

[    1.068647] raid6: sse2x1   gen()  8343 MB/s

[    1.087647] raid6: sse2x1   xor()  6343 MB/s

[    1.106651] raid6: sse2x2   gen() 10457 MB/s

[    1.125645] raid6: sse2x2   xor()  7667 MB/s

[    1.144648] raid6: sse2x4   gen() 11535 MB/s

[    1.163646] raid6: sse2x4   xor()  8681 MB/s

[    1.166439] raid6: using algorithm sse2x4 gen() 11535 MB/s

[    1.169884] raid6: .... xor() 8681 MB/s, rmw enabled

[    1.173108] raid6: using intx1 recovery algorithm

[    1.176274] ACPI: Added _OSI(Module Device)

[    1.179106] ACPI: Added _OSI(Processor Device)

[    1.182055] ACPI: Added _OSI(3.0 _SCP Extensions)

[    1.185130] ACPI: Added _OSI(Processor Aggregator Device)

[    1.190629] ACPI: Interpreter enabled

[    1.193248] ACPI: (supports S0 S3 S5)

[    1.195811] ACPI: Using IOAPIC for interrupt routing

[    1.199013] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug

[    1.208431] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])

[    1.212179] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]

[    1.216257] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM

[    1.220229] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

[    1.227188] PCI host bridge to bus 0000:00

[    1.229993] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]

[    1.233961] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]

[    1.238087] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]

[    1.243328] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]

[    1.248350] pci_bus 0000:00: root bus resource [mem 0x240000000-0x2bfffffff window]

[    1.253512] pci_bus 0000:00: root bus resource [bus 00-ff]

[    1.263998] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]

[    1.268428] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]

[    1.272823] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]

[    1.277119] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]

[    1.282540] pci 0000:00:01.3: quirk: [io  0x0600-0x063f] claimed by PIIX4 ACPI

[    1.325268] pci 0000:00:01.3: quirk: [io  0x0700-0x070f] claimed by PIIX4 SMB

[    6.130390] pci 0000:00:03.0: PCI bridge to [bus 01]

[    6.135862] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)

[    6.140548] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)

[    6.145321] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)

[    6.150231] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)

[    6.154863] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)

[    6.159099] ACPI: Enabled 2 GPEs in block 00 to 0F

[    6.163710] vgaarb: setting as boot device: PCI:0000:00:02.0

[    6.167111] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none

[    6.172251] vgaarb: loaded

[    6.174291] vgaarb: bridge control possible 0000:00:02.0

[    6.177851] SCSI subsystem initialized

[    6.180933] ACPI: bus type USB registered

[    6.183552] usbcore: registered new interface driver usbfs

[    6.186926] usbcore: registered new interface driver hub

[    6.190349] usbcore: registered new device driver usb

[    6.193406] pps_core: LinuxPPS API ver. 1 registered

[    6.196529] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>

[    6.202253] PTP clock support registered

[    6.205519] Advanced Linux Sound Architecture Driver Initialized.

[    6.209149] PCI: Using ACPI for IRQ routing

[    6.212798] Bluetooth: Core ver 2.21

[    6.215191] NET: Registered protocol family 31

[    6.218135] Bluetooth: HCI device and connection manager initialized

[    6.223399] Bluetooth: HCI socket layer initialized

[    6.227890] Bluetooth: L2CAP socket layer initialized

[    6.232329] Bluetooth: SCO socket layer initialized

[    6.235935] HPET: 3 timers in total, 0 timers will be used for per-cpu timer

[    6.240163] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0

[    6.244312] hpet0: 3 comparators, 64-bit 100.000000 MHz counter

[    6.253467] clocksource: Switched to clocksource kvm-clock

[    6.269556] pnp: PnP ACPI init

[    6.272426] pnp: PnP ACPI: found 6 devices

[    6.287086] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns

[    6.292976] pci 0000:00:03.0: PCI bridge to [bus 01]

[    6.296117] pci 0000:00:03.0:   bridge window [io  0xc000-0xcfff]

[    6.300849] pci 0000:00:03.0:   bridge window [mem 0xfe800000-0xfe9fffff]

[    6.305545] pci 0000:00:03.0:   bridge window [mem 0xfe000000-0xfe1fffff 64bit pref]

[    6.311939] NET: Registered protocol family 2

[    6.315976] TCP established hash table entries: 65536 (order: 7, 524288 bytes)

[    6.320810] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)

[    6.325152] TCP: Hash tables configured (established 65536 bind 65536)

[    6.329778] UDP hash table entries: 4096 (order: 5, 131072 bytes)

[    6.333501] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)

[    6.337062] NET: Registered protocol family 1

[    6.340345] RPC: Registered named UNIX socket transport module.

[    6.343989] RPC: Registered udp transport module.

[    6.347061] RPC: Registered tcp transport module.

[    6.350362] RPC: Registered tcp NFSv4.1 backchannel transport module.

[    6.354499] pci 0000:00:00.0: Limiting direct PCI/PCI transfers

[    6.358194] pci 0000:00:01.0: PIIX3: Enabling Passive Release

[    6.361852] pci 0000:00:01.0: Activating ISA DMA hang workarounds

[    6.365753] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]

[    6.371368] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)

[    6.375077] software IO TLB [mem 0xbbfe0000-0xbffe0000] (64MB) mapped at [ffff8800bbfe0000-ffff8800bffdffff]

[    6.381515] Scanning for low memory corruption every 60 seconds

[    6.386178] workingset: timestamp_bits=40 max_order=21 bucket_order=0

[    6.391777] squashfs: version 4.0 (2009/01/31) Phillip Lougher

[    6.395638] NFS: Registering the id_resolver key type

[    6.398959] Key type id_resolver registered

[    6.401808] Key type id_legacy registered

[    6.404763] 9p: Installing v9fs 9p2000 file system support

[    6.408517] aufs 4.7-20160912

[    6.420141] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)

[    6.424957] io scheduler noop registered

[    6.427657] io scheduler deadline registered

[    6.430627] io scheduler cfq registered (default)

[    6.433724] pci_hotplug: PCI Hot Plug PCI Core version: 0.5

[    6.437086] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0

[    6.442079] ACPI: Power Button [PWRF]

[    6.469313] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11

[    6.474821] xenfs: not registering filesystem on non-xen platform

[    6.478656] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled

[    6.511134] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A

[    6.517807] Linux agpgart interface v0.103

[    6.520379] [drm] Initialized drm 1.1.0 20060810

[    6.536848] brd: module loaded

[    6.659732] loop: module loaded

[    6.662205] Uniform Multi-Platform E-IDE driver

[    6.665057] piix 0000:00:01.1: IDE controller (0x8086:0x7010 rev 0x00)

[    6.668902] piix 0000:00:01.1: not 100% native mode: will probe irqs later

[    6.673518]     ide0: BM-DMA at 0xd020-0xd027

[    6.676934]     ide1: BM-DMA at 0xd028-0xd02f

[    6.949117] hda: QEMU HARDDISK, ATA DISK drive

[    7.429049] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1e4530a99b6, max_idle_ns: 440795257976 ns

[    7.577615] hda: MWDMA2 mode selected

[    8.266762] hdc: QEMU DVD-ROM, ATAPI CD/DVD-ROM drive

[    8.894201] hdc: MWDMA2 mode selected

[    8.901128] ide0 at 0x1f0-0x1f7,0x3f6 on irq 14

[    8.905661] ide1 at 0x170-0x177,0x376 on irq 15

[    8.909279] ide-gd driver 1.18

[    8.911937] hda: max request size: 1024KiB

[    8.915095] hda: 66603008 sectors (34100 MB) w/256KiB Cache, CHS=16383/255/63

[    8.934448] hda: cache flushes supported

[    8.942191]  hda: hda1 hda2

[    8.945739] ide-cd driver 5.00

[    8.949619] ide-cd: hdc: ATAPI 4X DVD-ROM drive, 512kB Cache

[    8.954789] cdrom: Uniform CD-ROM driver Revision: 3.20

[    8.977655] hv_vmbus: registering driver hv_storvsc

[    8.995988] pcnet32: pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de

[    9.003205] e100: Intel(R) PRO/100 Network Driver, 3.5.24-k2-NAPI

[    9.007470] e100: Copyright(c) 1999-2006 Intel Corporation

[    9.011446] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI

[    9.016205] e1000: Copyright (c) 1999-2006 Intel Corporation.

[    9.020308] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k

[    9.024438] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.

[    9.028628] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.0.0-k

[    9.034492] ixgbe: Copyright (c) 1999-2016 Intel Corporation.

[    9.038881] ixgb: Intel(R) PRO/10GbE Network Driver - version 1.0.135-k2-NAPI

[    9.043150] ixgb: Copyright (c) 1999-2008 Intel Corporation.

[    9.046606] VMware vmxnet3 virtual NIC driver - version 1.4.a.0-k-NAPI

[    9.050616] hv_vmbus: registering driver hv_netvsc

[    9.053626] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver

[    9.057151] ehci-pci: EHCI PCI platform driver

[    9.059775] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver

[    9.063253] ohci-pci: OHCI PCI platform driver

[    9.065911] uhci_hcd: USB Universal Host Controller Interface driver

[    9.069578] usbcore: registered new interface driver usb-storage

[    9.073058] usbcore: registered new interface driver usbserial

[    9.076750] usbcore: registered new interface driver usbserial_generic

[    9.080748] usbserial: USB Serial support registered for generic

[    9.084267] usbcore: registered new interface driver ftdi_sio

[    9.087733] usbserial: USB Serial support registered for FTDI USB Serial Device

[    9.092336] usbcore: registered new interface driver pl2303

[    9.095496] usbserial: USB Serial support registered for pl2303

[    9.098659] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12

[    9.104865] serio: i8042 KBD port at 0x60,0x64 irq 1

[    9.107679] serio: i8042 AUX port at 0x60,0x64 irq 12

[    9.110530] hv_vmbus: registering driver hyperv_keyboard

[    9.114039] mousedev: PS/2 mouse device common for all mice

[    9.118146] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1

[    9.126114] rtc_cmos 00:05: RTC can wake from S4

[    9.133006] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0

[    9.137996] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs

[    9.143859] md: linear personality registered for level -1

[    9.147895] md: raid0 personality registered for level 0

[    9.151807] md: raid1 personality registered for level 1

[    9.155938] md: raid10 personality registered for level 10

[    9.159954] md: multipath personality registered for level -4

[    9.164085] md: faulty personality registered for level -5

[    9.168376] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com

[    9.176548] sdhci: Secure Digital Host Controller Interface driver

[    9.180972] sdhci: Copyright(c) Pierre Ossman

[    9.184424] sdhci-pltfm: SDHCI platform and OF driver helper

[    9.188647] hv_vmbus: registering driver hid_hyperv

[    9.192440] usbcore: registered new interface driver usbhid

[    9.196531] usbhid: USB HID core driver

[    9.199814] hv_utils: Registering HyperV Utility Driver

[    9.203612] hv_vmbus: registering driver hv_util

[    9.207074] hv_vmbus: registering driver hv_balloon

[    9.210784] u32 classifier

[    9.213234]     Actions configured

[    9.216810] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)

[    9.221898] NET: Registered protocol family 10

[    9.227298] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver

[    9.232060] NET: Registered protocol family 17

[    9.235801] 9pnet: Installing 9P2000 support

[    9.239387] Key type dns_resolver registered

[    9.243429] microcode: sig=0x60fb1, pf=0x1, revision=0x1

[    9.248283] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba

[    9.304530] registered taskstats version 1

[    9.308946] Btrfs loaded, crc32c=crc32c-generic

[    9.313398] console [netcon0] enabled

[    9.320324] netconsole: network logging started

[    9.324517] rtc_cmos 00:05: setting system clock to 2023-06-05 00:26:48 UTC (1685924808)

[    9.330810] ALSA device list:

[    9.333438]   No soundcards found.

[    9.405915] random: fast init done

[    9.826793] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3

[    9.835265] md: Waiting for all devices to be available before autodetect

[    9.842960] md: If you don't use raid, use raid=noautodetect

[    9.848174] md: Autodetecting RAID arrays.

[    9.856572] md: Scanned 0 and added 0 devices.

[    9.861922] md: autorun ...

[    9.864389] md: ... autorun DONE.

[    9.868365] EXT4-fs (hda2): mounting ext3 file system using the ext4 subsystem

[   10.034060] EXT4-fs (hda2): mounted filesystem with ordered data mode. Opts: (null)

[   10.043297] VFS: Mounted root (ext3 filesystem) on device 3:2.

[   10.055269] devtmpfs: mounted

[   10.060705] Freeing unused kernel memory: 1548K (ffffffff8214e000 - ffffffff822d1000)

[   10.066640] Write protecting the kernel read-only data: 16384k

[   10.075378] Freeing unused kernel memory: 1660K (ffff880001a61000 - ffff880001c00000)

[   10.082979] Freeing unused kernel memory: 784K (ffff880001f3c000 - ffff880002000000)

INIT: version 2.88 booting

[   10.597550] uvesafb: SeaBIOS Developers, SeaBIOS VBE Adapter, Rev. 1, OEM: SeaBIOS VBE(C) 2011, VBE v3.0

[   10.643110] uvesafb: VBIOS/hardware supports both DDC1 and DDC2 transfers

[   10.647913] uvesafb: monitor limits: vf = 125 Hz, hf = 160 kHz, clk = 2550 MHz

[   10.654217] uvesafb: scrolling: redraw

[   10.721104] Console: switching to colour frame buffer device 80x30

[   10.723888] uvesafb: framebuffer at 0xfd000000, mapped to 0xffffc90002000000, using 16384k, total 16384k

[   10.727335] fb0: VESA VGA frame buffer device

[   10.736600] random: crng init done

Starting udev

[   11.124241] udevd[387]: starting version 3.2

[   11.179836] udevd[388]: starting eudev-3.2

[   11.308382] parport_pc 00:03: reported by Plug and Play ACPI

[   11.311888] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]

[   11.319214] Floppy drive(s): fd0 is 2.88M AMI BIOS

[   11.335487] FDC 0 is a S82078B

[   13.451304] EXT4-fs (hda2): re-mounted. Opts: (null)

Populating dev cache

stat: cannot stat 'lib/udev/rules.d/*': No such file or directory

Running postinst /etc/rpm-postinsts/100-ifupdown...

update-rc.d: /etc/init.d/run-postinsts exists during rc.d purge (continuing)

Removing any system startup links for run-postinsts ...

  /etc/rcS.d/S99run-postinsts

INIT: Entering runlevel: 3

Configuring network interfaces...check_for_aws_c5 saw IS_AWS_C5:

[   15.188366] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.

[   15.199081] br-ext: port 1(eth0) entered blocking state

[   15.201364] br-ext: port 1(eth0) entered disabled state

[   15.203529] device eth0 entered promiscuous mode

Internet Systems Consortium DHCP Client 4.3.4

Copyright 2004-2016 Internet Systems Consortium.

All rights reserved.

For info, please visit https://www.isc.org/software/dhcp/

[   15.522401] br-ext: port 1(eth0) entered blocking state

[   15.529035] br-ext: port 1(eth0) entered forwarding state

Listening on LPF/br-ext/0c:00:83:a2:c2:00

Sending on   LPF/br-ext/0c:00:83:a2:c2:00

Sending on   Socket/fallback

DHCPDISCOVER on br-ext to 255.255.255.255 port 67 interval 4

DHCPREQUEST on br-ext to 255.255.255.255 port 67

DHCPOFFER from 10.0.0.2

DHCPACK from 10.0.0.2

bound to 10.0.0.15 -- renewal in 39533 seconds.

done.

Starting OpenBSD Secure Shell server: sshd

  generating ssh RSA key...

  generating ssh ECDSA key...

  generating ssh DSA key...

  generating ssh ED25519 key...

done.

Starting rpcbind daemon...done.

nested_env.sh sees AWS as no

Starting Advanced Configuration and Power Interface daemon: acpid: starting up with netlink and the input layer

acpid.

acpid: 1 rule loaded

acpid: waiting for events: event logging is off

Starting atd: OK

Starting domain name service: namedwrote key file "/etc/bind/rndc.key"

.

/etc/rc3.d/S20cloud-init: line 35: init_is_upstart: command not found

/etc/rc3.d/S20cloud-init: line 48: log_daemon_msg: command not found

Cloud-init v. 0.7.6 running 'init' at Mon, 05 Jun 2023 00:26:57 +0000. Up 14.15 seconds.

2023-06-05 00:26:57,862 - util.py[WARNING]: Unable to change the ownership of /var/log/cloud-init.log to user syslog, group adm

ci-info: +++++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++++

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: | Device |   Up  |  Address   |      Mask     |                    Hw-Address                   |

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: |  int   |  True | 128.0.0.16 | 255.255.255.0 |                02:00:00:00:00:10                |

ci-info: |   lo   | False |     .      |       .       |                        .                        |

ci-info: |  sit0  | False |     .      |       .       | 00-00-00-00-30-30-30-00-00-00-00-00-00-00-00-00 |

ci-info: | br-ext |  True | 10.0.0.15  | 255.255.255.0 |                0c:00:83:a2:c2:00                |

ci-info: |  eth0  |  True |     .      |       .       |                0c:00:83:a2:c2:00                |

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: ++++++++++++++++++++++++++++++Route info++++++++++++++++++++++++++++++

ci-info: +-------+-------------+----------+---------------+-----------+-------+

ci-info: | Route | Destination | Gateway  |    Genmask    | Interface | Flags |

ci-info: +-------+-------------+----------+---------------+-----------+-------+

ci-info: |   0   |   0.0.0.0   | 10.0.0.2 |    0.0.0.0    |   br-ext  |   UG  |

ci-info: |   1   |   10.0.0.0  | 0.0.0.0  | 255.255.255.0 |   br-ext  |   U   |

ci-info: |   2   |  128.0.0.0  | 0.0.0.0  | 255.255.255.0 |    int    |   U   |

ci-info: +-------+-------------+----------+---------------+-----------+-------+

2023-06-05 00:26:58,095 - cc_resizefs.py[WARNING]: Device '/dev/PARTUUID=eddefbdd-02' did not exist. cannot resize: dev=/dev/root mnt_point=/ path=/

Generating public/private rsa key pair.

Your identification has been saved in /etc/ssh/ssh_host_rsa_key.

Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.

The key fingerprint is:

SHA256:r5hMswDBvrEE03nf8FZKKw+NfsDwL+jXuyrmtIRr1eE root@qemux86-64

The key's randomart image is:

+---[RSA 2048]----+

|                 |

| o .             |

|o = o . . .      |

| + o =.B +       |

|  =  oO.S        |

| . *.oEB .       |

|  +.= =.+ .      |

|  .=o=.B..       |

| ..o+o*.+o       |

+----[SHA256]-----+

Generating public/private dsa key pair.

Your identification has been saved in /etc/ssh/ssh_host_dsa_key.

Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.

The key fingerprint is:

Wind River Linux 9.0.0.20 qemux86-64 console

qemux86-64 login: cp: cannot stat '/home/pfe/junos/loader.conf': No such file or directory

mkfs.fat 4.0 (2016-05-06)

Total number of sectors (32768) not a multiple of sectors per track (63)!

Add mtools_skip_check=1 to your .mtoolsrc file to skip this test

image: /home/pfe/junos/metadata-usb.img

file format: qcow2

virtual size: 16M (16777216 bytes)

disk size: 328K

cluster_size: 65536

Format specific information:

    compat: 1.1

    lazy refcounts: false

    refcount bits: 16

    corrupt: false

[   27.192663] br-ext: port 1(eth0) entered disabled state

866

[   27.272747] IPv6: ADDRCONF(NETDEV_UP): br-ext: link is not ready

[   27.276752] br-ext: port 1(eth0) entered blocking state

[   27.278764] br-ext: port 1(eth0) entered forwarding state

[   27.281137] IPv6: ADDRCONF(NETDEV_CHANGE): br-ext: link becomes ready

Product is vJunos-ex, place it in Lab mode

Product is VM-vex_g-151-re-0

VFPMEM in MB: 4096

VCPMEM in MB: 3886, VCPCPU: 1

trace command not available: missing audit-libs devel package at build time.

Could not access KVM kernel module: No such file or directory

failed to initialize KVM: No such file or directory

Back to tcg accelerator.

[   28.116005] br-ext: port 2(tap0) entered blocking state

[   28.120646] br-ext: port 2(tap0) entered disabled state

[   28.123251] device tap0 entered promiscuous mode

[   28.125603] br-ext: port 2(tap0) entered blocking state

[   28.128057] br-ext: port 2(tap0) entered forwarding state

[   28.139990] int: port 1(tap1) entered blocking state

[   28.142239] int: port 1(tap1) entered disabled state

[   28.144323] device tap1 entered promiscuous mode

[   28.146341] int: port 1(tap1) entered blocking state

[   28.148362] int: port 1(tap1) entered forwarding state

qemu-system-x86_64: CPU model 'host' requires KVM

[   28.167097] int: port 1(tap1) entered disabled state

[   28.169317] device tap1 left promiscuous mode

[   28.171429] int: port 1(tap1) entered disabled state

[   28.183675] br-ext: port 2(tap0) entered disabled state

[   28.186247] device tap0 left promiscuous mode

[   28.188151] br-ext: port 2(tap0) entered disabled state

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

mount /dev/hda1 /boot <<<<<<<< HANGS HERE

Will have a look at your logs. Have you tried using virtio for the disk emulation rather than IDE? We don't usually use IDE anymore if we can help it as virtio makes the I/O faster. Can you share the complete qemu cmd line for both? And maybe drop into the qemu monitor and do a 'info block' so we can see in more detail.

We have an intern this summer who amongst other tasks, is going to work on formal containerlab support.

Art

Hi there,

For quite a while now I've been labbing infrastructure using an open source product called "Containerlab" (https://containerlab.dev/). Containerlab is an equivalent of EVE-NG except it's primarily aimed at containerised NOS like Nokia SRL and Arista vEOS etc. Containerlab also supports the deployment of traditional VM based devices with the support of vrnetlab (https://github.com/hellt/vrnetlab/). 

Using these products I have been able to successfully lab vSRX, vMX and vQFX devices. I've been working to try add support for both vJunos-Evo and vJunos-Switch however without a lot of success. Hoping to reach out here and get some feedback from those involved in the development process, as I suspect I'm not too far off being able to get them working.

Starting with vJunos-evolved and using the library document here for deploying on KVM, I have been able to successfully build a docker container, validate using the kvm-ok command that we have kvm support inside the container and we have vmx hardware virtualisation support. All of which I already knew, given we're running other Junos VM based products in the same manner and below is the log output confirming that:

root@6c2186c34a18:/# kvm-ok

INFO: /dev/kvm exists

KVM acceleration can be used

root@6c2186c34a18:/# grep -Eoc '(vmx|svm)' /proc/cpuinfo

32

It would be amazing to get these products working in Containerlab as I know much of the Containerlab community are keen on seeing support for them. My main issue is both of the virtual devices seem to actually start booting the Junos operating systems, as such I don't know how else I can troubleshoot this myself.

When the vJunos-Evolved boot process starts, it ends up failing and in a boot loop. I have added both the qemu command line information and the error logs below:

Command:

qemu-system-x86_64 -machine type=pc,accel=kvm -cpu host -m 8192 -smp 4 -display none -smbios type=0,vendor=Bochs,version=Bochs -smbios type=3,manufacturer=Bochs -smbios type=1,manufacturer=Bochs,product=Bochs,serial=chassis_no=0:slot=0:type=1:assembly_id=0x0D20:platform=251:master=0:channelized=no -serial telnet:0.0.0.0:5000,server,nowait -drive file=/vJunosEvolved-23.1R1.8-overlay.qcow2

Error Logs:

containerlab@containerlab:~$ telnet 172.17.0.2 5000

Trying 172.17.0.2...

Connected to 172.17.0.2.

Escape character is '^]'.

[    2.253910] refpga-lpcm fc800000.refpga: Scratch test failed: wr=0x01, rd=0x 0

Watchdog set to 500 seconds

Installing/Mounting on disk /dev/sda mapped to device ata1

Coming back from an uncontrolled reboot, will recreate /data!

Processing /dev/sda2 for mount on /soft ...[checking]..[ok 1]..[mounting]..done

Processing /dev/sda7 for mount on /var ...[checking]..[ok 1]..[mounting]..done

Processing /dev/sda5 for mount on /data ...[checking]..[strong check]..[saving]..[rebuilding]..[mounting]..[restoring]..done

Processing /dev/sda6 for mount on /data/config ...[checking]..[ok 0]..[mounting]..done

Processing /data/var/opt_fs for mount on /data/var/external ...[checking]..[ok 0]..[mounting]..done

mkswap: /dev/sda3: warning: wiping old swap signature.

Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)

no label, UUID=4983cc30-fb62-424e-8477-b1aaf31183de

Processing /dev/sda1 for mount on /boot ...[checking]..[ok 0]..[mounting]..done

Done with local filesystems setup.

NOTE: Now 9 keys in keyring: %keyring:.ima

NOTE: Now keyring is empty %keyring:ima_ext

Postinstall in progress...App manifest not defined in capdb. Skip customizing app policies for this platform ()

done

Installing kexec kernel...done

Warning - Empty root password found

*** Error - Config file not found !

warning: No configured root password

[   42.656218] Control value (4, 0x4), reg address 0x5, reg final addr[0xc0cc1005] label[status-blip]

[   48.226546] ip_local_port_range: prefer different parity for start/end values.

[FAILED] Failed unmounting /etc.

[FAILED] Failed unmounting /var.

[FAILED] Failed deactivating swap /sda3.

[  112.227159] systemd-shutdown[1]: Could not deactivate swap /sda3: No such file or directory

[  112.241494] printk: shutdown: 33 output lines suppressed due to ratelimiting

Shutdown target is 'reboot'

Checking on root FS daemon ........Done

Cleaning up root FS daemon...done

Rebooting.

[  120.286568] reboot: Restarting system

Below are the same details for vJunos-switch, which I also have to the boot stage, but hangs on mounting the boot volume it seems.

Command:

qemu-system-x86_64 -enable-kvm -display none -machine pc -monitor tcp:0.0.0.0:4000,server,nowait -m 8192 -serial telnet:0.0.0.0:5000,server,nowait -drive if=ide,file=/vjunos-switch-23.1R1.8-overlay.qcow2 -smp 4 -smbios type=1,product=VM-VEX

Error Logs:

containerlab@containerlab:~$ telnet 172.17.0.2 5000

Trying 172.17.0.2...

Connected to 172.17.0.2.

Escape character is '^]'.

ok

[    0.000000] Linux version 4.8.28-WR9.0.0.20_standard (builder@svl-jre-ubm1601) (gcc version 6.2.0 (GCC) ) #1 SMP PREEMPT Tue Jan 10 05:16:50 PST 2023

[    0.000000] Command line: BOOT_IMAGE=vmlinuz rootwait max_loop=255 rw clock=pit console=tty0 console=ttyS0,115200 root=PARTUUID=eddefbdd-02 altroot=/dev/vda2 isolcpus=2

[    0.000000] x86/fpu: Legacy x87 FPU detected.

[    0.000000] x86/fpu: Using 'eager' FPU context switches.

[    0.000000] e820: BIOS-provided physical RAM map:

[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable

[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdffff] usable

[    0.000000] BIOS-e820: [mem 0x00000000bffe0000-0x00000000bfffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000023fffffff] usable

[    0.000000] NX (Execute Disable) protection: active

[    0.000000] SMBIOS 2.8 present.

[    0.000000] Hypervisor detected: KVM

[    0.000000] e820: last_pfn = 0x240000 max_arch_pfn = 0x400000000

[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT 

[    0.000000] e820: last_pfn = 0xbffe0 max_arch_pfn = 0x400000000

[    0.000000] found SMP MP-table at [mem 0x000f5b90-0x000f5b9f] mapped at [ffff8800000f5b90]

[    0.000000] Scanning 1 areas for low memory corruption

[    0.000000] ACPI: Early table checksum verification disabled

[    0.000000] ACPI: RSDP 0x00000000000F59D0 000014 (v00 BOCHS )

[    0.000000] ACPI: RSDT 0x00000000BFFE2486 000034 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: FACP 0x00000000BFFE2322 000074 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: DSDT 0x00000000BFFE0040 0022E2 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: FACS 0x00000000BFFE0000 000040

[    0.000000] ACPI: APIC 0x00000000BFFE2396 000090 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: HPET 0x00000000BFFE2426 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: WAET 0x00000000BFFE245E 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] No NUMA configuration found

[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000023fffffff]

[    0.000000] NODE_DATA(0) allocated [mem 0x23fff7000-0x23fffafff]

[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00

[    0.000000] kvm-clock: cpu 0, msr 2:3fff6001, primary cpu clock

[    0.000000] kvm-clock: using sched offset of 2755169503 cycles

[    0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns

[    0.000000] Zone ranges:

[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]

[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]

[    0.000000]   Normal   [mem 0x0000000100000000-0x000000023fffffff]

[    0.000000] Movable zone start for each node

[    0.000000] Early memory node ranges

[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009efff]

[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bffdffff]

[    0.000000]   node   0: [mem 0x0000000100000000-0x000000023fffffff]

[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000023fffffff]

[    0.000000] ACPI: PM-Timer IO Port: 0x608

[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])

[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)

[    0.000000] Using ACPI (MADT) for SMP configuration information

[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000

[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs

[    0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices

[    0.000000] Booting paravirtualized kernel on KVM

[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns

[    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1

[    0.000000] percpu: Embedded 36 pages/cpu @ffff88023fc00000 s107160 r8192 d32104 u524288

[    0.000000] KVM setup async PF for cpu 0

[    0.000000] kvm-stealtime: cpu 0, msr 23fc10000

[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 2064233

[    0.000000] Policy zone: Normal

[    0.000000] Kernel command line: BOOT_IMAGE=vmlinuz rootwait max_loop=255 rw clock=pit console=tty0 console=ttyS0,115200 root=PARTUUID=eddefbdd-02 altroot=/dev/vda2 isolcpus=2

[    0.000000] clocksource: clock= boot option is deprecated - use clocksource=xyz

[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)

[    0.000000] Memory: 8169932K/8388088K available (10610K kernel code, 1329K rwdata, 3312K rodata, 1548K init, 848K bss, 218156K reserved, 0K cma-reserved)

[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1

[    0.000000] Kernel/User page tables isolation: enabled

[    0.000000] Preemptible hierarchical RCU implementation.

[    0.000000] Build-time adjustment of leaf fanout to 64.

[    0.000000] RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.

[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=4

[    0.000000] NR_IRQS:4352 nr_irqs:456 16

[    0.000000] Console: colour VGA+ 80x25

[    0.000000] console [tty0] enabled

[    0.000000] console [ttyS0] enabled

[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns

[    0.000000] tsc: Detected 2100.000 MHz processor

[    0.475279] Calibrating delay loop (skipped) preset value.. 4200.00 BogoMIPS (lpj=2100000)

[    0.480118] pid_max: default: 32768 minimum: 301

[    0.482734] ACPI: Core revision 20160422

[    0.486805] ACPI: 1 ACPI AML tables successfully acquired and loaded

[    0.490713]

[    0.492374] Security Framework initialized

[    0.495943] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)

[    0.505347] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)

[    0.514339] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)

[    0.519143] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)

[    0.526583] mce: CPU supports 10 MCE banks

[    0.530170] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0

[    0.534368] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0

[    0.538659] Spectre V2 : Mitigation: Full generic retpoline

[    0.542686] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch

[    0.548895] Speculative Store Bypass: Vulnerable

[    0.564049] Freeing SMP alternatives memory: 40K (ffffffff822d1000 - ffffffff822db000)

[    0.581375] ftrace: allocating 38335 entries in 150 pages

[    0.735116] smpboot: APIC(0) Converting physical 0 to logical package 0

[    0.739195] smpboot: Max logical packages: 1

[    0.745417] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1

[    0.850652] smpboot: CPU0: Intel QEMU Virtual CPU version 2.5+ (family: 0xf, model: 0x6b, stepping: 0x1)

[    0.857064] Performance Events: unsupported Netburst CPU model 107 no PMU driver, software events only.

[    0.873764] x86: Booting SMP configuration:

[    0.876371] .... node  #0, CPUs:      #1

[    0.890266] kvm-clock: cpu 1, msr 2:3fff6041, secondary cpu clock

[    0.896016] KVM setup async PF for cpu 1

[    0.899387] kvm-stealtime: cpu 1, msr 23fc90000

[    0.905819]  #2

[    0.920185] kvm-clock: cpu 2, msr 2:3fff6081, secondary cpu clock

[    0.932109] KVM setup async PF for cpu 2

[    0.934887] kvm-stealtime: cpu 2, msr 23fd10000

[    0.941794]  #3

[    0.954398] kvm-clock: cpu 3, msr 2:3fff60c1, secondary cpu clock

[    0.960962] KVM setup async PF for cpu 3

[    0.963739] kvm-stealtime: cpu 3, msr 23fd90000

[    0.966861] x86: Booted up 1 node, 4 CPUs

[    0.970318] smpboot: Total of 4 processors activated (16800.00 BogoMIPS)

[    0.978197] devtmpfs: initialized

[    0.981424] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns

[    0.987605] futex hash table entries: 1024 (order: 4, 65536 bytes)

[    0.991652] xor: measuring software checksum speed

[    1.004643]    prefetch64-sse: 17008.000 MB/sec

[    1.016643]    generic_sse: 15572.000 MB/sec

[    1.019475] xor: using function: prefetch64-sse (17008.000 MB/sec)

[    1.023232] pinctrl core: initialized pinctrl subsystem

[    1.026701] NET: Registered protocol family 16

[    1.031896] cpuidle: using governor menu

[    1.034729] ACPI: bus type PCI registered

[    1.037746] PCI: Using configuration type 1 for base access

[    1.047556] HugeTLB registered 2 MB page size, pre-allocated 0 pages

[    1.068647] raid6: sse2x1   gen()  8343 MB/s

[    1.087647] raid6: sse2x1   xor()  6343 MB/s

[    1.106651] raid6: sse2x2   gen() 10457 MB/s

[    1.125645] raid6: sse2x2   xor()  7667 MB/s

[    1.144648] raid6: sse2x4   gen() 11535 MB/s

[    1.163646] raid6: sse2x4   xor()  8681 MB/s

[    1.166439] raid6: using algorithm sse2x4 gen() 11535 MB/s

[    1.169884] raid6: .... xor() 8681 MB/s, rmw enabled

[    1.173108] raid6: using intx1 recovery algorithm

[    1.176274] ACPI: Added _OSI(Module Device)

[    1.179106] ACPI: Added _OSI(Processor Device)

[    1.182055] ACPI: Added _OSI(3.0 _SCP Extensions)

[    1.185130] ACPI: Added _OSI(Processor Aggregator Device)

[    1.190629] ACPI: Interpreter enabled

[    1.193248] ACPI: (supports S0 S3 S5)

[    1.195811] ACPI: Using IOAPIC for interrupt routing

[    1.199013] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug

[    1.208431] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])

[    1.212179] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]

[    1.216257] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM

[    1.220229] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

[    1.227188] PCI host bridge to bus 0000:00

[    1.229993] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]

[    1.233961] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]

[    1.238087] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]

[    1.243328] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]

[    1.248350] pci_bus 0000:00: root bus resource [mem 0x240000000-0x2bfffffff window]

[    1.253512] pci_bus 0000:00: root bus resource [bus 00-ff]

[    1.263998] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]

[    1.268428] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]

[    1.272823] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]

[    1.277119] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]

[    1.282540] pci 0000:00:01.3: quirk: [io  0x0600-0x063f] claimed by PIIX4 ACPI

[    1.325268] pci 0000:00:01.3: quirk: [io  0x0700-0x070f] claimed by PIIX4 SMB

[    6.130390] pci 0000:00:03.0: PCI bridge to [bus 01]

[    6.135862] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)

[    6.140548] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)

[    6.145321] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)

[    6.150231] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)

[    6.154863] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)

[    6.159099] ACPI: Enabled 2 GPEs in block 00 to 0F

[    6.163710] vgaarb: setting as boot device: PCI:0000:00:02.0

[    6.167111] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none

[    6.172251] vgaarb: loaded

[    6.174291] vgaarb: bridge control possible 0000:00:02.0

[    6.177851] SCSI subsystem initialized

[    6.180933] ACPI: bus type USB registered

[    6.183552] usbcore: registered new interface driver usbfs

[    6.186926] usbcore: registered new interface driver hub

[    6.190349] usbcore: registered new device driver usb

[    6.193406] pps_core: LinuxPPS API ver. 1 registered

[    6.196529] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>

[    6.202253] PTP clock support registered

[    6.205519] Advanced Linux Sound Architecture Driver Initialized.

[    6.209149] PCI: Using ACPI for IRQ routing

[    6.212798] Bluetooth: Core ver 2.21

[    6.215191] NET: Registered protocol family 31

[    6.218135] Bluetooth: HCI device and connection manager initialized

[    6.223399] Bluetooth: HCI socket layer initialized

[    6.227890] Bluetooth: L2CAP socket layer initialized

[    6.232329] Bluetooth: SCO socket layer initialized

[    6.235935] HPET: 3 timers in total, 0 timers will be used for per-cpu timer

[    6.240163] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0

[    6.244312] hpet0: 3 comparators, 64-bit 100.000000 MHz counter

[    6.253467] clocksource: Switched to clocksource kvm-clock

[    6.269556] pnp: PnP ACPI init

[    6.272426] pnp: PnP ACPI: found 6 devices

[    6.287086] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns

[    6.292976] pci 0000:00:03.0: PCI bridge to [bus 01]

[    6.296117] pci 0000:00:03.0:   bridge window [io  0xc000-0xcfff]

[    6.300849] pci 0000:00:03.0:   bridge window [mem 0xfe800000-0xfe9fffff]

[    6.305545] pci 0000:00:03.0:   bridge window [mem 0xfe000000-0xfe1fffff 64bit pref]

[    6.311939] NET: Registered protocol family 2

[    6.315976] TCP established hash table entries: 65536 (order: 7, 524288 bytes)

[    6.320810] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)

[    6.325152] TCP: Hash tables configured (established 65536 bind 65536)

[    6.329778] UDP hash table entries: 4096 (order: 5, 131072 bytes)

[    6.333501] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)

[    6.337062] NET: Registered protocol family 1

[    6.340345] RPC: Registered named UNIX socket transport module.

[    6.343989] RPC: Registered udp transport module.

[    6.347061] RPC: Registered tcp transport module.

[    6.350362] RPC: Registered tcp NFSv4.1 backchannel transport module.

[    6.354499] pci 0000:00:00.0: Limiting direct PCI/PCI transfers

[    6.358194] pci 0000:00:01.0: PIIX3: Enabling Passive Release

[    6.361852] pci 0000:00:01.0: Activating ISA DMA hang workarounds

[    6.365753] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]

[    6.371368] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)

[    6.375077] software IO TLB [mem 0xbbfe0000-0xbffe0000] (64MB) mapped at [ffff8800bbfe0000-ffff8800bffdffff]

[    6.381515] Scanning for low memory corruption every 60 seconds

[    6.386178] workingset: timestamp_bits=40 max_order=21 bucket_order=0

[    6.391777] squashfs: version 4.0 (2009/01/31) Phillip Lougher

[    6.395638] NFS: Registering the id_resolver key type

[    6.398959] Key type id_resolver registered

[    6.401808] Key type id_legacy registered

[    6.404763] 9p: Installing v9fs 9p2000 file system support

[    6.408517] aufs 4.7-20160912

[    6.420141] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)

[    6.424957] io scheduler noop registered

[    6.427657] io scheduler deadline registered

[    6.430627] io scheduler cfq registered (default)

[    6.433724] pci_hotplug: PCI Hot Plug PCI Core version: 0.5

[    6.437086] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0

[    6.442079] ACPI: Power Button [PWRF]

[    6.469313] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11

[    6.474821] xenfs: not registering filesystem on non-xen platform

[    6.478656] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled

[    6.511134] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A

[    6.517807] Linux agpgart interface v0.103

[    6.520379] [drm] Initialized drm 1.1.0 20060810

[    6.536848] brd: module loaded

[    6.659732] loop: module loaded

[    6.662205] Uniform Multi-Platform E-IDE driver

[    6.665057] piix 0000:00:01.1: IDE controller (0x8086:0x7010 rev 0x00)

[    6.668902] piix 0000:00:01.1: not 100% native mode: will probe irqs later

[    6.673518]     ide0: BM-DMA at 0xd020-0xd027

[    6.676934]     ide1: BM-DMA at 0xd028-0xd02f

[    6.949117] hda: QEMU HARDDISK, ATA DISK drive

[    7.429049] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1e4530a99b6, max_idle_ns: 440795257976 ns

[    7.577615] hda: MWDMA2 mode selected

[    8.266762] hdc: QEMU DVD-ROM, ATAPI CD/DVD-ROM drive

[    8.894201] hdc: MWDMA2 mode selected

[    8.901128] ide0 at 0x1f0-0x1f7,0x3f6 on irq 14

[    8.905661] ide1 at 0x170-0x177,0x376 on irq 15

[    8.909279] ide-gd driver 1.18

[    8.911937] hda: max request size: 1024KiB

[    8.915095] hda: 66603008 sectors (34100 MB) w/256KiB Cache, CHS=16383/255/63

[    8.934448] hda: cache flushes supported

[    8.942191]  hda: hda1 hda2

[    8.945739] ide-cd driver 5.00

[    8.949619] ide-cd: hdc: ATAPI 4X DVD-ROM drive, 512kB Cache

[    8.954789] cdrom: Uniform CD-ROM driver Revision: 3.20

[    8.977655] hv_vmbus: registering driver hv_storvsc

[    8.995988] pcnet32: pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de

[    9.003205] e100: Intel(R) PRO/100 Network Driver, 3.5.24-k2-NAPI

[    9.007470] e100: Copyright(c) 1999-2006 Intel Corporation

[    9.011446] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI

[    9.016205] e1000: Copyright (c) 1999-2006 Intel Corporation.

[    9.020308] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k

[    9.024438] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.

[    9.028628] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.0.0-k

[    9.034492] ixgbe: Copyright (c) 1999-2016 Intel Corporation.

[    9.038881] ixgb: Intel(R) PRO/10GbE Network Driver - version 1.0.135-k2-NAPI

[    9.043150] ixgb: Copyright (c) 1999-2008 Intel Corporation.

[    9.046606] VMware vmxnet3 virtual NIC driver - version 1.4.a.0-k-NAPI

[    9.050616] hv_vmbus: registering driver hv_netvsc

[    9.053626] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver

[    9.057151] ehci-pci: EHCI PCI platform driver

[    9.059775] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver

[    9.063253] ohci-pci: OHCI PCI platform driver

[    9.065911] uhci_hcd: USB Universal Host Controller Interface driver

[    9.069578] usbcore: registered new interface driver usb-storage

[    9.073058] usbcore: registered new interface driver usbserial

[    9.076750] usbcore: registered new interface driver usbserial_generic

[    9.080748] usbserial: USB Serial support registered for generic

[    9.084267] usbcore: registered new interface driver ftdi_sio

[    9.087733] usbserial: USB Serial support registered for FTDI USB Serial Device

[    9.092336] usbcore: registered new interface driver pl2303

[    9.095496] usbserial: USB Serial support registered for pl2303

[    9.098659] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12

[    9.104865] serio: i8042 KBD port at 0x60,0x64 irq 1

[    9.107679] serio: i8042 AUX port at 0x60,0x64 irq 12

[    9.110530] hv_vmbus: registering driver hyperv_keyboard

[    9.114039] mousedev: PS/2 mouse device common for all mice

[    9.118146] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1

[    9.126114] rtc_cmos 00:05: RTC can wake from S4

[    9.133006] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0

[    9.137996] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs

[    9.143859] md: linear personality registered for level -1

[    9.147895] md: raid0 personality registered for level 0

[    9.151807] md: raid1 personality registered for level 1

[    9.155938] md: raid10 personality registered for level 10

[    9.159954] md: multipath personality registered for level -4

[    9.164085] md: faulty personality registered for level -5

[    9.168376] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com

[    9.176548] sdhci: Secure Digital Host Controller Interface driver

[    9.180972] sdhci: Copyright(c) Pierre Ossman

[    9.184424] sdhci-pltfm: SDHCI platform and OF driver helper

[    9.188647] hv_vmbus: registering driver hid_hyperv

[    9.192440] usbcore: registered new interface driver usbhid

[    9.196531] usbhid: USB HID core driver

[    9.199814] hv_utils: Registering HyperV Utility Driver

[    9.203612] hv_vmbus: registering driver hv_util

[    9.207074] hv_vmbus: registering driver hv_balloon

[    9.210784] u32 classifier

[    9.213234]     Actions configured

[    9.216810] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)

[    9.221898] NET: Registered protocol family 10

[    9.227298] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver

[    9.232060] NET: Registered protocol family 17

[    9.235801] 9pnet: Installing 9P2000 support

[    9.239387] Key type dns_resolver registered

[    9.243429] microcode: sig=0x60fb1, pf=0x1, revision=0x1

[    9.248283] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba

[    9.304530] registered taskstats version 1

[    9.308946] Btrfs loaded, crc32c=crc32c-generic

[    9.313398] console [netcon0] enabled

[    9.320324] netconsole: network logging started

[    9.324517] rtc_cmos 00:05: setting system clock to 2023-06-05 00:26:48 UTC (1685924808)

[    9.330810] ALSA device list:

[    9.333438]   No soundcards found.

[    9.405915] random: fast init done

[    9.826793] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3

[    9.835265] md: Waiting for all devices to be available before autodetect

[    9.842960] md: If you don't use raid, use raid=noautodetect

[    9.848174] md: Autodetecting RAID arrays.

[    9.856572] md: Scanned 0 and added 0 devices.

[    9.861922] md: autorun ...

[    9.864389] md: ... autorun DONE.

[    9.868365] EXT4-fs (hda2): mounting ext3 file system using the ext4 subsystem

[   10.034060] EXT4-fs (hda2): mounted filesystem with ordered data mode. Opts: (null)

[   10.043297] VFS: Mounted root (ext3 filesystem) on device 3:2.

[   10.055269] devtmpfs: mounted

[   10.060705] Freeing unused kernel memory: 1548K (ffffffff8214e000 - ffffffff822d1000)

[   10.066640] Write protecting the kernel read-only data: 16384k

[   10.075378] Freeing unused kernel memory: 1660K (ffff880001a61000 - ffff880001c00000)

[   10.082979] Freeing unused kernel memory: 784K (ffff880001f3c000 - ffff880002000000)

INIT: version 2.88 booting

[   10.597550] uvesafb: SeaBIOS Developers, SeaBIOS VBE Adapter, Rev. 1, OEM: SeaBIOS VBE(C) 2011, VBE v3.0

[   10.643110] uvesafb: VBIOS/hardware supports both DDC1 and DDC2 transfers

[   10.647913] uvesafb: monitor limits: vf = 125 Hz, hf = 160 kHz, clk = 2550 MHz

[   10.654217] uvesafb: scrolling: redraw

[   10.721104] Console: switching to colour frame buffer device 80x30

[   10.723888] uvesafb: framebuffer at 0xfd000000, mapped to 0xffffc90002000000, using 16384k, total 16384k

[   10.727335] fb0: VESA VGA frame buffer device

[   10.736600] random: crng init done

Starting udev

[   11.124241] udevd[387]: starting version 3.2

[   11.179836] udevd[388]: starting eudev-3.2

[   11.308382] parport_pc 00:03: reported by Plug and Play ACPI

[   11.311888] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]

[   11.319214] Floppy drive(s): fd0 is 2.88M AMI BIOS

[   11.335487] FDC 0 is a S82078B

[   13.451304] EXT4-fs (hda2): re-mounted. Opts: (null)

Populating dev cache

stat: cannot stat 'lib/udev/rules.d/*': No such file or directory

Running postinst /etc/rpm-postinsts/100-ifupdown...

update-rc.d: /etc/init.d/run-postinsts exists during rc.d purge (continuing)

Removing any system startup links for run-postinsts ...

  /etc/rcS.d/S99run-postinsts

INIT: Entering runlevel: 3

Configuring network interfaces...check_for_aws_c5 saw IS_AWS_C5:

[   15.188366] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.

[   15.199081] br-ext: port 1(eth0) entered blocking state

[   15.201364] br-ext: port 1(eth0) entered disabled state

[   15.203529] device eth0 entered promiscuous mode

Internet Systems Consortium DHCP Client 4.3.4

Copyright 2004-2016 Internet Systems Consortium.

All rights reserved.

For info, please visit https://www.isc.org/software/dhcp/

[   15.522401] br-ext: port 1(eth0) entered blocking state

[   15.529035] br-ext: port 1(eth0) entered forwarding state

Listening on LPF/br-ext/0c:00:83:a2:c2:00

Sending on   LPF/br-ext/0c:00:83:a2:c2:00

Sending on   Socket/fallback

DHCPDISCOVER on br-ext to 255.255.255.255 port 67 interval 4

DHCPREQUEST on br-ext to 255.255.255.255 port 67

DHCPOFFER from 10.0.0.2

DHCPACK from 10.0.0.2

bound to 10.0.0.15 -- renewal in 39533 seconds.

done.

Starting OpenBSD Secure Shell server: sshd

  generating ssh RSA key...

  generating ssh ECDSA key...

  generating ssh DSA key...

  generating ssh ED25519 key...

done.

Starting rpcbind daemon...done.

nested_env.sh sees AWS as no

Starting Advanced Configuration and Power Interface daemon: acpid: starting up with netlink and the input layer

acpid.

acpid: 1 rule loaded

acpid: waiting for events: event logging is off

Starting atd: OK

Starting domain name service: namedwrote key file "/etc/bind/rndc.key"

.

/etc/rc3.d/S20cloud-init: line 35: init_is_upstart: command not found

/etc/rc3.d/S20cloud-init: line 48: log_daemon_msg: command not found

Cloud-init v. 0.7.6 running 'init' at Mon, 05 Jun 2023 00:26:57 +0000. Up 14.15 seconds.

2023-06-05 00:26:57,862 - util.py[WARNING]: Unable to change the ownership of /var/log/cloud-init.log to user syslog, group adm

ci-info: +++++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++++

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: | Device |   Up  |  Address   |      Mask     |                    Hw-Address                   |

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: |  int   |  True | 128.0.0.16 | 255.255.255.0 |                02:00:00:00:00:10                |

ci-info: |   lo   | False |     .      |       .       |                        .                        |

ci-info: |  sit0  | False |     .      |       .       | 00-00-00-00-30-30-30-00-00-00-00-00-00-00-00-00 |

ci-info: | br-ext |  True | 10.0.0.15  | 255.255.255.0 |                0c:00:83:a2:c2:00                |

ci-info: |  eth0  |  True |     .      |       .       |                0c:00:83:a2:c2:00                |

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: ++++++++++++++++++++++++++++++Route info++++++++++++++++++++++++++++++

ci-info: +-------+-------------+----------+---------------+-----------+-------+

ci-info: | Route | Destination | Gateway  |    Genmask    | Interface | Flags |

ci-info: +-------+-------------+----------+---------------+-----------+-------+

ci-info: |   0   |   0.0.0.0   | 10.0.0.2 |    0.0.0.0    |   br-ext  |   UG  |

ci-info: |   1   |   10.0.0.0  | 0.0.0.0  | 255.255.255.0 |   br-ext  |   U   |

ci-info: |   2   |  128.0.0.0  | 0.0.0.0  | 255.255.255.0 |    int    |   U   |

ci-info: +-------+-------------+----------+---------------+-----------+-------+

2023-06-05 00:26:58,095 - cc_resizefs.py[WARNING]: Device '/dev/PARTUUID=eddefbdd-02' did not exist. cannot resize: dev=/dev/root mnt_point=/ path=/

Generating public/private rsa key pair.

Your identification has been saved in /etc/ssh/ssh_host_rsa_key.

Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.

The key fingerprint is:

SHA256:r5hMswDBvrEE03nf8FZKKw+NfsDwL+jXuyrmtIRr1eE root@qemux86-64

The key's randomart image is:

+---[RSA 2048]----+

|                 |

| o .             |

|o = o . . .      |

| + o =.B +       |

|  =  oO.S        |

| . *.oEB .       |

|  +.= =.+ .      |

|  .=o=.B..       |

| ..o+o*.+o       |

+----[SHA256]-----+

Generating public/private dsa key pair.

Your identification has been saved in /etc/ssh/ssh_host_dsa_key.

Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.

The key fingerprint is:

Wind River Linux 9.0.0.20 qemux86-64 console

qemux86-64 login: cp: cannot stat '/home/pfe/junos/loader.conf': No such file or directory

mkfs.fat 4.0 (2016-05-06)

Total number of sectors (32768) not a multiple of sectors per track (63)!

Add mtools_skip_check=1 to your .mtoolsrc file to skip this test

image: /home/pfe/junos/metadata-usb.img

file format: qcow2

virtual size: 16M (16777216 bytes)

disk size: 328K

cluster_size: 65536

Format specific information:

    compat: 1.1

    lazy refcounts: false

    refcount bits: 16

    corrupt: false

[   27.192663] br-ext: port 1(eth0) entered disabled state

866

[   27.272747] IPv6: ADDRCONF(NETDEV_UP): br-ext: link is not ready

[   27.276752] br-ext: port 1(eth0) entered blocking state

[   27.278764] br-ext: port 1(eth0) entered forwarding state

[   27.281137] IPv6: ADDRCONF(NETDEV_CHANGE): br-ext: link becomes ready

Product is vJunos-ex, place it in Lab mode

Product is VM-vex_g-151-re-0

VFPMEM in MB: 4096

VCPMEM in MB: 3886, VCPCPU: 1

trace command not available: missing audit-libs devel package at build time.

Could not access KVM kernel module: No such file or directory

failed to initialize KVM: No such file or directory

Back to tcg accelerator.

[   28.116005] br-ext: port 2(tap0) entered blocking state

[   28.120646] br-ext: port 2(tap0) entered disabled state

[   28.123251] device tap0 entered promiscuous mode

[   28.125603] br-ext: port 2(tap0) entered blocking state

[   28.128057] br-ext: port 2(tap0) entered forwarding state

[   28.139990] int: port 1(tap1) entered blocking state

[   28.142239] int: port 1(tap1) entered disabled state

[   28.144323] device tap1 entered promiscuous mode

[   28.146341] int: port 1(tap1) entered blocking state

[   28.148362] int: port 1(tap1) entered forwarding state

qemu-system-x86_64: CPU model 'host' requires KVM

[   28.167097] int: port 1(tap1) entered disabled state

[   28.169317] device tap1 left promiscuous mode

[   28.171429] int: port 1(tap1) entered disabled state

[   28.183675] br-ext: port 2(tap0) entered disabled state

[   28.186247] device tap0 left promiscuous mode

[   28.188151] br-ext: port 2(tap0) entered disabled state

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

mount /dev/hda1 /boot <<<<<<<< HANGS HERE

Hi Art,

Thanks for the reply, I have attempted to use virtio for disk emulation today and that certainly speeds things up from a boot perspective. The complete qemu cmd line I was trying for vJunos-Evolved was this:

qemu-system-x86_64 -machine type=pc,accel=kvm -monitor stdio -cpu host -m 8192 -smp 4 -display none -smbios type=0,vendor=Bochs,version=Bochs -smbios type=3,manufacturer=Bochs -smbios type=1,manufacturer=Bochs,product=Bochs,serial=chassis_no=0:slot=0:type=1:assembly_id=0x0D20:platform=251:master=0:channelized=no -serial telnet:0.0.0.0:5000,server,nowait -drive if=virtio,file=/vJunosEvolved-23.1R1.8-overlay.qcow2

Output from info block:

(qemu) info block

virtio0 (#block101): /vJunosEvolved-23.1R1.8-overlay.qcow2 (qcow2)

    Attached to:      /machine/peripheral-anon/device[0]/virtio-backend

    Cache mode:       writeback

    Backing file:     /vJunosEvolved-23.1R1.8.qcow2 (chain depth: 1)

ide1-cd0: [not inserted]

    Attached to:      /machine/unattached/device[27]

    Removable device: not locked, tray closed

floppy0: [not inserted]

    Attached to:      /machine/unattached/device[20]

    Removable device: not locked, tray closed

sd0: [not inserted]

    Removable device: not locked, tray closed

I have been using a very cut down qemu command just to ensure I could get the device to hopefully boot. I have also attempted this by creating a PCI bridge device however  (virtio-net-pci type) in case it was failing to boot without one.

I also tried modifying the qemu command for vJunos-switch to use the virtio disk type instead of ide and found it again was much faster to boot however still produces the same errors/logs as my original message. Qemu command for that one:

qemu-system-x86_64 -enable-kvm -monitor stdio -display none -machine pc -monitor tcp:0.0.0.0:4000,server,nowait -m 8192 -serial telnet:0.0.0.0:5000,server,nowait -drive if=virtio,file=/vjunos-switch-23.1R1.8-overlay.qcow2 -smp 4 -smbios type=1,product=VM-VEX

Also very cool to hear you have an intern working on official containerlab support.

Will have a look at your logs. Have you tried using virtio for the disk emulation rather than IDE? We don't usually use IDE anymore if we can help it as virtio makes the I/O faster. Can you share the complete qemu cmd line for both? And maybe drop into the qemu monitor and do a 'info block' so we can see in more detail.

We have an intern this summer who amongst other tasks, is going to work on formal containerlab support.

Art

Hi there,

For quite a while now I've been labbing infrastructure using an open source product called "Containerlab" (https://containerlab.dev/). Containerlab is an equivalent of EVE-NG except it's primarily aimed at containerised NOS like Nokia SRL and Arista vEOS etc. Containerlab also supports the deployment of traditional VM based devices with the support of vrnetlab (https://github.com/hellt/vrnetlab/). 

Using these products I have been able to successfully lab vSRX, vMX and vQFX devices. I've been working to try add support for both vJunos-Evo and vJunos-Switch however without a lot of success. Hoping to reach out here and get some feedback from those involved in the development process, as I suspect I'm not too far off being able to get them working.

Starting with vJunos-evolved and using the library document here for deploying on KVM, I have been able to successfully build a docker container, validate using the kvm-ok command that we have kvm support inside the container and we have vmx hardware virtualisation support. All of which I already knew, given we're running other Junos VM based products in the same manner and below is the log output confirming that:

root@6c2186c34a18:/# kvm-ok

INFO: /dev/kvm exists

KVM acceleration can be used

root@6c2186c34a18:/# grep -Eoc '(vmx|svm)' /proc/cpuinfo

32

It would be amazing to get these products working in Containerlab as I know much of the Containerlab community are keen on seeing support for them. My main issue is both of the virtual devices seem to actually start booting the Junos operating systems, as such I don't know how else I can troubleshoot this myself.

When the vJunos-Evolved boot process starts, it ends up failing and in a boot loop. I have added both the qemu command line information and the error logs below:

Command:

qemu-system-x86_64 -machine type=pc,accel=kvm -cpu host -m 8192 -smp 4 -display none -smbios type=0,vendor=Bochs,version=Bochs -smbios type=3,manufacturer=Bochs -smbios type=1,manufacturer=Bochs,product=Bochs,serial=chassis_no=0:slot=0:type=1:assembly_id=0x0D20:platform=251:master=0:channelized=no -serial telnet:0.0.0.0:5000,server,nowait -drive file=/vJunosEvolved-23.1R1.8-overlay.qcow2

Error Logs:

containerlab@containerlab:~$ telnet 172.17.0.2 5000

Trying 172.17.0.2...

Connected to 172.17.0.2.

Escape character is '^]'.

[    2.253910] refpga-lpcm fc800000.refpga: Scratch test failed: wr=0x01, rd=0x 0

Watchdog set to 500 seconds

Installing/Mounting on disk /dev/sda mapped to device ata1

Coming back from an uncontrolled reboot, will recreate /data!

Processing /dev/sda2 for mount on /soft ...[checking]..[ok 1]..[mounting]..done

Processing /dev/sda7 for mount on /var ...[checking]..[ok 1]..[mounting]..done

Processing /dev/sda5 for mount on /data ...[checking]..[strong check]..[saving]..[rebuilding]..[mounting]..[restoring]..done

Processing /dev/sda6 for mount on /data/config ...[checking]..[ok 0]..[mounting]..done

Processing /data/var/opt_fs for mount on /data/var/external ...[checking]..[ok 0]..[mounting]..done

mkswap: /dev/sda3: warning: wiping old swap signature.

Setting up swapspace version 1, size = 4 GiB (4294963200 bytes)

no label, UUID=4983cc30-fb62-424e-8477-b1aaf31183de

Processing /dev/sda1 for mount on /boot ...[checking]..[ok 0]..[mounting]..done

Done with local filesystems setup.

NOTE: Now 9 keys in keyring: %keyring:.ima

NOTE: Now keyring is empty %keyring:ima_ext

Postinstall in progress...App manifest not defined in capdb. Skip customizing app policies for this platform ()

done

Installing kexec kernel...done

Warning - Empty root password found

*** Error - Config file not found !

warning: No configured root password

[   42.656218] Control value (4, 0x4), reg address 0x5, reg final addr[0xc0cc1005] label[status-blip]

[   48.226546] ip_local_port_range: prefer different parity for start/end values.

[FAILED] Failed unmounting /etc.

[FAILED] Failed unmounting /var.

[FAILED] Failed deactivating swap /sda3.

[  112.227159] systemd-shutdown[1]: Could not deactivate swap /sda3: No such file or directory

[  112.241494] printk: shutdown: 33 output lines suppressed due to ratelimiting

Shutdown target is 'reboot'

Checking on root FS daemon ........Done

Cleaning up root FS daemon...done

Rebooting.

[  120.286568] reboot: Restarting system

Below are the same details for vJunos-switch, which I also have to the boot stage, but hangs on mounting the boot volume it seems.

Command:

qemu-system-x86_64 -enable-kvm -display none -machine pc -monitor tcp:0.0.0.0:4000,server,nowait -m 8192 -serial telnet:0.0.0.0:5000,server,nowait -drive if=ide,file=/vjunos-switch-23.1R1.8-overlay.qcow2 -smp 4 -smbios type=1,product=VM-VEX

Error Logs:

containerlab@containerlab:~$ telnet 172.17.0.2 5000

Trying 172.17.0.2...

Connected to 172.17.0.2.

Escape character is '^]'.

ok

[    0.000000] Linux version 4.8.28-WR9.0.0.20_standard (builder@svl-jre-ubm1601) (gcc version 6.2.0 (GCC) ) #1 SMP PREEMPT Tue Jan 10 05:16:50 PST 2023

[    0.000000] Command line: BOOT_IMAGE=vmlinuz rootwait max_loop=255 rw clock=pit console=tty0 console=ttyS0,115200 root=PARTUUID=eddefbdd-02 altroot=/dev/vda2 isolcpus=2

[    0.000000] x86/fpu: Legacy x87 FPU detected.

[    0.000000] x86/fpu: Using 'eager' FPU context switches.

[    0.000000] e820: BIOS-provided physical RAM map:

[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable

[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdffff] usable

[    0.000000] BIOS-e820: [mem 0x00000000bffe0000-0x00000000bfffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000023fffffff] usable

[    0.000000] NX (Execute Disable) protection: active

[    0.000000] SMBIOS 2.8 present.

[    0.000000] Hypervisor detected: KVM

[    0.000000] e820: last_pfn = 0x240000 max_arch_pfn = 0x400000000

[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT 

[    0.000000] e820: last_pfn = 0xbffe0 max_arch_pfn = 0x400000000

[    0.000000] found SMP MP-table at [mem 0x000f5b90-0x000f5b9f] mapped at [ffff8800000f5b90]

[    0.000000] Scanning 1 areas for low memory corruption

[    0.000000] ACPI: Early table checksum verification disabled

[    0.000000] ACPI: RSDP 0x00000000000F59D0 000014 (v00 BOCHS )

[    0.000000] ACPI: RSDT 0x00000000BFFE2486 000034 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: FACP 0x00000000BFFE2322 000074 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: DSDT 0x00000000BFFE0040 0022E2 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: FACS 0x00000000BFFE0000 000040

[    0.000000] ACPI: APIC 0x00000000BFFE2396 000090 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: HPET 0x00000000BFFE2426 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] ACPI: WAET 0x00000000BFFE245E 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)

[    0.000000] No NUMA configuration found

[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000023fffffff]

[    0.000000] NODE_DATA(0) allocated [mem 0x23fff7000-0x23fffafff]

[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00

[    0.000000] kvm-clock: cpu 0, msr 2:3fff6001, primary cpu clock

[    0.000000] kvm-clock: using sched offset of 2755169503 cycles

[    0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns

[    0.000000] Zone ranges:

[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]

[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]

[    0.000000]   Normal   [mem 0x0000000100000000-0x000000023fffffff]

[    0.000000] Movable zone start for each node

[    0.000000] Early memory node ranges

[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009efff]

[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bffdffff]

[    0.000000]   node   0: [mem 0x0000000100000000-0x000000023fffffff]

[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000023fffffff]

[    0.000000] ACPI: PM-Timer IO Port: 0x608

[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])

[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)

[    0.000000] Using ACPI (MADT) for SMP configuration information

[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000

[    0.000000] smpboot: Allowing 4 CPUs, 0 hotplug CPUs

[    0.000000] e820: [mem 0xc0000000-0xfeffbfff] available for PCI devices

[    0.000000] Booting paravirtualized kernel on KVM

[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns

[    0.000000] setup_percpu: NR_CPUS:64 nr_cpumask_bits:64 nr_cpu_ids:4 nr_node_ids:1

[    0.000000] percpu: Embedded 36 pages/cpu @ffff88023fc00000 s107160 r8192 d32104 u524288

[    0.000000] KVM setup async PF for cpu 0

[    0.000000] kvm-stealtime: cpu 0, msr 23fc10000

[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 2064233

[    0.000000] Policy zone: Normal

[    0.000000] Kernel command line: BOOT_IMAGE=vmlinuz rootwait max_loop=255 rw clock=pit console=tty0 console=ttyS0,115200 root=PARTUUID=eddefbdd-02 altroot=/dev/vda2 isolcpus=2

[    0.000000] clocksource: clock= boot option is deprecated - use clocksource=xyz

[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)

[    0.000000] Memory: 8169932K/8388088K available (10610K kernel code, 1329K rwdata, 3312K rodata, 1548K init, 848K bss, 218156K reserved, 0K cma-reserved)

[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1

[    0.000000] Kernel/User page tables isolation: enabled

[    0.000000] Preemptible hierarchical RCU implementation.

[    0.000000] Build-time adjustment of leaf fanout to 64.

[    0.000000] RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=4.

[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=4

[    0.000000] NR_IRQS:4352 nr_irqs:456 16

[    0.000000] Console: colour VGA+ 80x25

[    0.000000] console [tty0] enabled

[    0.000000] console [ttyS0] enabled

[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns

[    0.000000] tsc: Detected 2100.000 MHz processor

[    0.475279] Calibrating delay loop (skipped) preset value.. 4200.00 BogoMIPS (lpj=2100000)

[    0.480118] pid_max: default: 32768 minimum: 301

[    0.482734] ACPI: Core revision 20160422

[    0.486805] ACPI: 1 ACPI AML tables successfully acquired and loaded

[    0.490713]

[    0.492374] Security Framework initialized

[    0.495943] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)

[    0.505347] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)

[    0.514339] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)

[    0.519143] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)

[    0.526583] mce: CPU supports 10 MCE banks

[    0.530170] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0

[    0.534368] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0

[    0.538659] Spectre V2 : Mitigation: Full generic retpoline

[    0.542686] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch

[    0.548895] Speculative Store Bypass: Vulnerable

[    0.564049] Freeing SMP alternatives memory: 40K (ffffffff822d1000 - ffffffff822db000)

[    0.581375] ftrace: allocating 38335 entries in 150 pages

[    0.735116] smpboot: APIC(0) Converting physical 0 to logical package 0

[    0.739195] smpboot: Max logical packages: 1

[    0.745417] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1

[    0.850652] smpboot: CPU0: Intel QEMU Virtual CPU version 2.5+ (family: 0xf, model: 0x6b, stepping: 0x1)

[    0.857064] Performance Events: unsupported Netburst CPU model 107 no PMU driver, software events only.

[    0.873764] x86: Booting SMP configuration:

[    0.876371] .... node  #0, CPUs:      #1

[    0.890266] kvm-clock: cpu 1, msr 2:3fff6041, secondary cpu clock

[    0.896016] KVM setup async PF for cpu 1

[    0.899387] kvm-stealtime: cpu 1, msr 23fc90000

[    0.905819]  #2

[    0.920185] kvm-clock: cpu 2, msr 2:3fff6081, secondary cpu clock

[    0.932109] KVM setup async PF for cpu 2

[    0.934887] kvm-stealtime: cpu 2, msr 23fd10000

[    0.941794]  #3

[    0.954398] kvm-clock: cpu 3, msr 2:3fff60c1, secondary cpu clock

[    0.960962] KVM setup async PF for cpu 3

[    0.963739] kvm-stealtime: cpu 3, msr 23fd90000

[    0.966861] x86: Booted up 1 node, 4 CPUs

[    0.970318] smpboot: Total of 4 processors activated (16800.00 BogoMIPS)

[    0.978197] devtmpfs: initialized

[    0.981424] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns

[    0.987605] futex hash table entries: 1024 (order: 4, 65536 bytes)

[    0.991652] xor: measuring software checksum speed

[    1.004643]    prefetch64-sse: 17008.000 MB/sec

[    1.016643]    generic_sse: 15572.000 MB/sec

[    1.019475] xor: using function: prefetch64-sse (17008.000 MB/sec)

[    1.023232] pinctrl core: initialized pinctrl subsystem

[    1.026701] NET: Registered protocol family 16

[    1.031896] cpuidle: using governor menu

[    1.034729] ACPI: bus type PCI registered

[    1.037746] PCI: Using configuration type 1 for base access

[    1.047556] HugeTLB registered 2 MB page size, pre-allocated 0 pages

[    1.068647] raid6: sse2x1   gen()  8343 MB/s

[    1.087647] raid6: sse2x1   xor()  6343 MB/s

[    1.106651] raid6: sse2x2   gen() 10457 MB/s

[    1.125645] raid6: sse2x2   xor()  7667 MB/s

[    1.144648] raid6: sse2x4   gen() 11535 MB/s

[    1.163646] raid6: sse2x4   xor()  8681 MB/s

[    1.166439] raid6: using algorithm sse2x4 gen() 11535 MB/s

[    1.169884] raid6: .... xor() 8681 MB/s, rmw enabled

[    1.173108] raid6: using intx1 recovery algorithm

[    1.176274] ACPI: Added _OSI(Module Device)

[    1.179106] ACPI: Added _OSI(Processor Device)

[    1.182055] ACPI: Added _OSI(3.0 _SCP Extensions)

[    1.185130] ACPI: Added _OSI(Processor Aggregator Device)

[    1.190629] ACPI: Interpreter enabled

[    1.193248] ACPI: (supports S0 S3 S5)

[    1.195811] ACPI: Using IOAPIC for interrupt routing

[    1.199013] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug

[    1.208431] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])

[    1.212179] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]

[    1.216257] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM

[    1.220229] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

[    1.227188] PCI host bridge to bus 0000:00

[    1.229993] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]

[    1.233961] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]

[    1.238087] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]

[    1.243328] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]

[    1.248350] pci_bus 0000:00: root bus resource [mem 0x240000000-0x2bfffffff window]

[    1.253512] pci_bus 0000:00: root bus resource [bus 00-ff]

[    1.263998] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]

[    1.268428] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]

[    1.272823] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]

[    1.277119] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]

[    1.282540] pci 0000:00:01.3: quirk: [io  0x0600-0x063f] claimed by PIIX4 ACPI

[    1.325268] pci 0000:00:01.3: quirk: [io  0x0700-0x070f] claimed by PIIX4 SMB

[    6.130390] pci 0000:00:03.0: PCI bridge to [bus 01]

[    6.135862] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)

[    6.140548] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)

[    6.145321] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)

[    6.150231] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)

[    6.154863] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)

[    6.159099] ACPI: Enabled 2 GPEs in block 00 to 0F

[    6.163710] vgaarb: setting as boot device: PCI:0000:00:02.0

[    6.167111] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none

[    6.172251] vgaarb: loaded

[    6.174291] vgaarb: bridge control possible 0000:00:02.0

[    6.177851] SCSI subsystem initialized

[    6.180933] ACPI: bus type USB registered

[    6.183552] usbcore: registered new interface driver usbfs

[    6.186926] usbcore: registered new interface driver hub

[    6.190349] usbcore: registered new device driver usb

[    6.193406] pps_core: LinuxPPS API ver. 1 registered

[    6.196529] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>

[    6.202253] PTP clock support registered

[    6.205519] Advanced Linux Sound Architecture Driver Initialized.

[    6.209149] PCI: Using ACPI for IRQ routing

[    6.212798] Bluetooth: Core ver 2.21

[    6.215191] NET: Registered protocol family 31

[    6.218135] Bluetooth: HCI device and connection manager initialized

[    6.223399] Bluetooth: HCI socket layer initialized

[    6.227890] Bluetooth: L2CAP socket layer initialized

[    6.232329] Bluetooth: SCO socket layer initialized

[    6.235935] HPET: 3 timers in total, 0 timers will be used for per-cpu timer

[    6.240163] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0

[    6.244312] hpet0: 3 comparators, 64-bit 100.000000 MHz counter

[    6.253467] clocksource: Switched to clocksource kvm-clock

[    6.269556] pnp: PnP ACPI init

[    6.272426] pnp: PnP ACPI: found 6 devices

[    6.287086] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns

[    6.292976] pci 0000:00:03.0: PCI bridge to [bus 01]

[    6.296117] pci 0000:00:03.0:   bridge window [io  0xc000-0xcfff]

[    6.300849] pci 0000:00:03.0:   bridge window [mem 0xfe800000-0xfe9fffff]

[    6.305545] pci 0000:00:03.0:   bridge window [mem 0xfe000000-0xfe1fffff 64bit pref]

[    6.311939] NET: Registered protocol family 2

[    6.315976] TCP established hash table entries: 65536 (order: 7, 524288 bytes)

[    6.320810] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)

[    6.325152] TCP: Hash tables configured (established 65536 bind 65536)

[    6.329778] UDP hash table entries: 4096 (order: 5, 131072 bytes)

[    6.333501] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)

[    6.337062] NET: Registered protocol family 1

[    6.340345] RPC: Registered named UNIX socket transport module.

[    6.343989] RPC: Registered udp transport module.

[    6.347061] RPC: Registered tcp transport module.

[    6.350362] RPC: Registered tcp NFSv4.1 backchannel transport module.

[    6.354499] pci 0000:00:00.0: Limiting direct PCI/PCI transfers

[    6.358194] pci 0000:00:01.0: PIIX3: Enabling Passive Release

[    6.361852] pci 0000:00:01.0: Activating ISA DMA hang workarounds

[    6.365753] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]

[    6.371368] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)

[    6.375077] software IO TLB [mem 0xbbfe0000-0xbffe0000] (64MB) mapped at [ffff8800bbfe0000-ffff8800bffdffff]

[    6.381515] Scanning for low memory corruption every 60 seconds

[    6.386178] workingset: timestamp_bits=40 max_order=21 bucket_order=0

[    6.391777] squashfs: version 4.0 (2009/01/31) Phillip Lougher

[    6.395638] NFS: Registering the id_resolver key type

[    6.398959] Key type id_resolver registered

[    6.401808] Key type id_legacy registered

[    6.404763] 9p: Installing v9fs 9p2000 file system support

[    6.408517] aufs 4.7-20160912

[    6.420141] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)

[    6.424957] io scheduler noop registered

[    6.427657] io scheduler deadline registered

[    6.430627] io scheduler cfq registered (default)

[    6.433724] pci_hotplug: PCI Hot Plug PCI Core version: 0.5

[    6.437086] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0

[    6.442079] ACPI: Power Button [PWRF]

[    6.469313] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11

[    6.474821] xenfs: not registering filesystem on non-xen platform

[    6.478656] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled

[    6.511134] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A

[    6.517807] Linux agpgart interface v0.103

[    6.520379] [drm] Initialized drm 1.1.0 20060810

[    6.536848] brd: module loaded

[    6.659732] loop: module loaded

[    6.662205] Uniform Multi-Platform E-IDE driver

[    6.665057] piix 0000:00:01.1: IDE controller (0x8086:0x7010 rev 0x00)

[    6.668902] piix 0000:00:01.1: not 100% native mode: will probe irqs later

[    6.673518]     ide0: BM-DMA at 0xd020-0xd027

[    6.676934]     ide1: BM-DMA at 0xd028-0xd02f

[    6.949117] hda: QEMU HARDDISK, ATA DISK drive

[    7.429049] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1e4530a99b6, max_idle_ns: 440795257976 ns

[    7.577615] hda: MWDMA2 mode selected

[    8.266762] hdc: QEMU DVD-ROM, ATAPI CD/DVD-ROM drive

[    8.894201] hdc: MWDMA2 mode selected

[    8.901128] ide0 at 0x1f0-0x1f7,0x3f6 on irq 14

[    8.905661] ide1 at 0x170-0x177,0x376 on irq 15

[    8.909279] ide-gd driver 1.18

[    8.911937] hda: max request size: 1024KiB

[    8.915095] hda: 66603008 sectors (34100 MB) w/256KiB Cache, CHS=16383/255/63

[    8.934448] hda: cache flushes supported

[    8.942191]  hda: hda1 hda2

[    8.945739] ide-cd driver 5.00

[    8.949619] ide-cd: hdc: ATAPI 4X DVD-ROM drive, 512kB Cache

[    8.954789] cdrom: Uniform CD-ROM driver Revision: 3.20

[    8.977655] hv_vmbus: registering driver hv_storvsc

[    8.995988] pcnet32: pcnet32.c:v1.35 21.Apr.2008 tsbogend@alpha.franken.de

[    9.003205] e100: Intel(R) PRO/100 Network Driver, 3.5.24-k2-NAPI

[    9.007470] e100: Copyright(c) 1999-2006 Intel Corporation

[    9.011446] e1000: Intel(R) PRO/1000 Network Driver - version 7.3.21-k8-NAPI

[    9.016205] e1000: Copyright (c) 1999-2006 Intel Corporation.

[    9.020308] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k

[    9.024438] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.

[    9.028628] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.0.0-k

[    9.034492] ixgbe: Copyright (c) 1999-2016 Intel Corporation.

[    9.038881] ixgb: Intel(R) PRO/10GbE Network Driver - version 1.0.135-k2-NAPI

[    9.043150] ixgb: Copyright (c) 1999-2008 Intel Corporation.

[    9.046606] VMware vmxnet3 virtual NIC driver - version 1.4.a.0-k-NAPI

[    9.050616] hv_vmbus: registering driver hv_netvsc

[    9.053626] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver

[    9.057151] ehci-pci: EHCI PCI platform driver

[    9.059775] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver

[    9.063253] ohci-pci: OHCI PCI platform driver

[    9.065911] uhci_hcd: USB Universal Host Controller Interface driver

[    9.069578] usbcore: registered new interface driver usb-storage

[    9.073058] usbcore: registered new interface driver usbserial

[    9.076750] usbcore: registered new interface driver usbserial_generic

[    9.080748] usbserial: USB Serial support registered for generic

[    9.084267] usbcore: registered new interface driver ftdi_sio

[    9.087733] usbserial: USB Serial support registered for FTDI USB Serial Device

[    9.092336] usbcore: registered new interface driver pl2303

[    9.095496] usbserial: USB Serial support registered for pl2303

[    9.098659] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12

[    9.104865] serio: i8042 KBD port at 0x60,0x64 irq 1

[    9.107679] serio: i8042 AUX port at 0x60,0x64 irq 12

[    9.110530] hv_vmbus: registering driver hyperv_keyboard

[    9.114039] mousedev: PS/2 mouse device common for all mice

[    9.118146] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1

[    9.126114] rtc_cmos 00:05: RTC can wake from S4

[    9.133006] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0

[    9.137996] rtc_cmos 00:05: alarms up to one day, y3k, 242 bytes nvram, hpet irqs

[    9.143859] md: linear personality registered for level -1

[    9.147895] md: raid0 personality registered for level 0

[    9.151807] md: raid1 personality registered for level 1

[    9.155938] md: raid10 personality registered for level 10

[    9.159954] md: multipath personality registered for level -4

[    9.164085] md: faulty personality registered for level -5

[    9.168376] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com

[    9.176548] sdhci: Secure Digital Host Controller Interface driver

[    9.180972] sdhci: Copyright(c) Pierre Ossman

[    9.184424] sdhci-pltfm: SDHCI platform and OF driver helper

[    9.188647] hv_vmbus: registering driver hid_hyperv

[    9.192440] usbcore: registered new interface driver usbhid

[    9.196531] usbhid: USB HID core driver

[    9.199814] hv_utils: Registering HyperV Utility Driver

[    9.203612] hv_vmbus: registering driver hv_util

[    9.207074] hv_vmbus: registering driver hv_balloon

[    9.210784] u32 classifier

[    9.213234]     Actions configured

[    9.216810] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)

[    9.221898] NET: Registered protocol family 10

[    9.227298] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver

[    9.232060] NET: Registered protocol family 17

[    9.235801] 9pnet: Installing 9P2000 support

[    9.239387] Key type dns_resolver registered

[    9.243429] microcode: sig=0x60fb1, pf=0x1, revision=0x1

[    9.248283] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba

[    9.304530] registered taskstats version 1

[    9.308946] Btrfs loaded, crc32c=crc32c-generic

[    9.313398] console [netcon0] enabled

[    9.320324] netconsole: network logging started

[    9.324517] rtc_cmos 00:05: setting system clock to 2023-06-05 00:26:48 UTC (1685924808)

[    9.330810] ALSA device list:

[    9.333438]   No soundcards found.

[    9.405915] random: fast init done

[    9.826793] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3

[    9.835265] md: Waiting for all devices to be available before autodetect

[    9.842960] md: If you don't use raid, use raid=noautodetect

[    9.848174] md: Autodetecting RAID arrays.

[    9.856572] md: Scanned 0 and added 0 devices.

[    9.861922] md: autorun ...

[    9.864389] md: ... autorun DONE.

[    9.868365] EXT4-fs (hda2): mounting ext3 file system using the ext4 subsystem

[   10.034060] EXT4-fs (hda2): mounted filesystem with ordered data mode. Opts: (null)

[   10.043297] VFS: Mounted root (ext3 filesystem) on device 3:2.

[   10.055269] devtmpfs: mounted

[   10.060705] Freeing unused kernel memory: 1548K (ffffffff8214e000 - ffffffff822d1000)

[   10.066640] Write protecting the kernel read-only data: 16384k

[   10.075378] Freeing unused kernel memory: 1660K (ffff880001a61000 - ffff880001c00000)

[   10.082979] Freeing unused kernel memory: 784K (ffff880001f3c000 - ffff880002000000)

INIT: version 2.88 booting

[   10.597550] uvesafb: SeaBIOS Developers, SeaBIOS VBE Adapter, Rev. 1, OEM: SeaBIOS VBE(C) 2011, VBE v3.0

[   10.643110] uvesafb: VBIOS/hardware supports both DDC1 and DDC2 transfers

[   10.647913] uvesafb: monitor limits: vf = 125 Hz, hf = 160 kHz, clk = 2550 MHz

[   10.654217] uvesafb: scrolling: redraw

[   10.721104] Console: switching to colour frame buffer device 80x30

[   10.723888] uvesafb: framebuffer at 0xfd000000, mapped to 0xffffc90002000000, using 16384k, total 16384k

[   10.727335] fb0: VESA VGA frame buffer device

[   10.736600] random: crng init done

Starting udev

[   11.124241] udevd[387]: starting version 3.2

[   11.179836] udevd[388]: starting eudev-3.2

[   11.308382] parport_pc 00:03: reported by Plug and Play ACPI

[   11.311888] parport0: PC-style at 0x378, irq 7 [PCSPP(,...)]

[   11.319214] Floppy drive(s): fd0 is 2.88M AMI BIOS

[   11.335487] FDC 0 is a S82078B

[   13.451304] EXT4-fs (hda2): re-mounted. Opts: (null)

Populating dev cache

stat: cannot stat 'lib/udev/rules.d/*': No such file or directory

Running postinst /etc/rpm-postinsts/100-ifupdown...

update-rc.d: /etc/init.d/run-postinsts exists during rc.d purge (continuing)

Removing any system startup links for run-postinsts ...

  /etc/rcS.d/S99run-postinsts

INIT: Entering runlevel: 3

Configuring network interfaces...check_for_aws_c5 saw IS_AWS_C5:

[   15.188366] bridge: automatic filtering via arp/ip/ip6tables has been deprecated. Update your scripts to load br_netfilter if you need this.

[   15.199081] br-ext: port 1(eth0) entered blocking state

[   15.201364] br-ext: port 1(eth0) entered disabled state

[   15.203529] device eth0 entered promiscuous mode

Internet Systems Consortium DHCP Client 4.3.4

Copyright 2004-2016 Internet Systems Consortium.

All rights reserved.

For info, please visit https://www.isc.org/software/dhcp/

[   15.522401] br-ext: port 1(eth0) entered blocking state

[   15.529035] br-ext: port 1(eth0) entered forwarding state

Listening on LPF/br-ext/0c:00:83:a2:c2:00

Sending on   LPF/br-ext/0c:00:83:a2:c2:00

Sending on   Socket/fallback

DHCPDISCOVER on br-ext to 255.255.255.255 port 67 interval 4

DHCPREQUEST on br-ext to 255.255.255.255 port 67

DHCPOFFER from 10.0.0.2

DHCPACK from 10.0.0.2

bound to 10.0.0.15 -- renewal in 39533 seconds.

done.

Starting OpenBSD Secure Shell server: sshd

  generating ssh RSA key...

  generating ssh ECDSA key...

  generating ssh DSA key...

  generating ssh ED25519 key...

done.

Starting rpcbind daemon...done.

nested_env.sh sees AWS as no

Starting Advanced Configuration and Power Interface daemon: acpid: starting up with netlink and the input layer

acpid.

acpid: 1 rule loaded

acpid: waiting for events: event logging is off

Starting atd: OK

Starting domain name service: namedwrote key file "/etc/bind/rndc.key"

.

/etc/rc3.d/S20cloud-init: line 35: init_is_upstart: command not found

/etc/rc3.d/S20cloud-init: line 48: log_daemon_msg: command not found

Cloud-init v. 0.7.6 running 'init' at Mon, 05 Jun 2023 00:26:57 +0000. Up 14.15 seconds.

2023-06-05 00:26:57,862 - util.py[WARNING]: Unable to change the ownership of /var/log/cloud-init.log to user syslog, group adm

ci-info: +++++++++++++++++++++++++++++++++++++++++Net device info+++++++++++++++++++++++++++++++++++++++++

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: | Device |   Up  |  Address   |      Mask     |                    Hw-Address                   |

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: |  int   |  True | 128.0.0.16 | 255.255.255.0 |                02:00:00:00:00:10                |

ci-info: |   lo   | False |     .      |       .       |                        .                        |

ci-info: |  sit0  | False |     .      |       .       | 00-00-00-00-30-30-30-00-00-00-00-00-00-00-00-00 |

ci-info: | br-ext |  True | 10.0.0.15  | 255.255.255.0 |                0c:00:83:a2:c2:00                |

ci-info: |  eth0  |  True |     .      |       .       |                0c:00:83:a2:c2:00                |

ci-info: +--------+-------+------------+---------------+-------------------------------------------------+

ci-info: ++++++++++++++++++++++++++++++Route info++++++++++++++++++++++++++++++

ci-info: +-------+-------------+----------+---------------+-----------+-------+

ci-info: | Route | Destination | Gateway  |    Genmask    | Interface | Flags |

ci-info: +-------+-------------+----------+---------------+-----------+-------+

ci-info: |   0   |   0.0.0.0   | 10.0.0.2 |    0.0.0.0    |   br-ext  |   UG  |

ci-info: |   1   |   10.0.0.0  | 0.0.0.0  | 255.255.255.0 |   br-ext  |   U   |

ci-info: |   2   |  128.0.0.0  | 0.0.0.0  | 255.255.255.0 |    int    |   U   |

ci-info: +-------+-------------+----------+---------------+-----------+-------+

2023-06-05 00:26:58,095 - cc_resizefs.py[WARNING]: Device '/dev/PARTUUID=eddefbdd-02' did not exist. cannot resize: dev=/dev/root mnt_point=/ path=/

Generating public/private rsa key pair.

Your identification has been saved in /etc/ssh/ssh_host_rsa_key.

Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub.

The key fingerprint is:

SHA256:r5hMswDBvrEE03nf8FZKKw+NfsDwL+jXuyrmtIRr1eE root@qemux86-64

The key's randomart image is:

+---[RSA 2048]----+

|                 |

| o .             |

|o = o . . .      |

| + o =.B +       |

|  =  oO.S        |

| . *.oEB .       |

|  +.= =.+ .      |

|  .=o=.B..       |

| ..o+o*.+o       |

+----[SHA256]-----+

Generating public/private dsa key pair.

Your identification has been saved in /etc/ssh/ssh_host_dsa_key.

Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub.

The key fingerprint is:

Wind River Linux 9.0.0.20 qemux86-64 console

qemux86-64 login: cp: cannot stat '/home/pfe/junos/loader.conf': No such file or directory

mkfs.fat 4.0 (2016-05-06)

Total number of sectors (32768) not a multiple of sectors per track (63)!

Add mtools_skip_check=1 to your .mtoolsrc file to skip this test

image: /home/pfe/junos/metadata-usb.img

file format: qcow2

virtual size: 16M (16777216 bytes)

disk size: 328K

cluster_size: 65536

Format specific information:

    compat: 1.1

    lazy refcounts: false

    refcount bits: 16

    corrupt: false

[   27.192663] br-ext: port 1(eth0) entered disabled state

866

[   27.272747] IPv6: ADDRCONF(NETDEV_UP): br-ext: link is not ready

[   27.276752] br-ext: port 1(eth0) entered blocking state

[   27.278764] br-ext: port 1(eth0) entered forwarding state

[   27.281137] IPv6: ADDRCONF(NETDEV_CHANGE): br-ext: link becomes ready

Product is vJunos-ex, place it in Lab mode

Product is VM-vex_g-151-re-0

VFPMEM in MB: 4096

VCPMEM in MB: 3886, VCPCPU: 1

trace command not available: missing audit-libs devel package at build time.

Could not access KVM kernel module: No such file or directory

failed to initialize KVM: No such file or directory

Back to tcg accelerator.

[   28.116005] br-ext: port 2(tap0) entered blocking state

[   28.120646] br-ext: port 2(tap0) entered disabled state

[   28.123251] device tap0 entered promiscuous mode

[   28.125603] br-ext: port 2(tap0) entered blocking state

[   28.128057] br-ext: port 2(tap0) entered forwarding state

[   28.139990] int: port 1(tap1) entered blocking state

[   28.142239] int: port 1(tap1) entered disabled state

[   28.144323] device tap1 entered promiscuous mode

[   28.146341] int: port 1(tap1) entered blocking state

[   28.148362] int: port 1(tap1) entered forwarding state

qemu-system-x86_64: CPU model 'host' requires KVM

[   28.167097] int: port 1(tap1) entered disabled state

[   28.169317] device tap1 left promiscuous mode

[   28.171429] int: port 1(tap1) entered disabled state

[   28.183675] br-ext: port 2(tap0) entered disabled state

[   28.186247] device tap0 left promiscuous mode

[   28.188151] br-ext: port 2(tap0) entered disabled state

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

nc: can't connect to remote host (127.0.0.1): Connection refused

mount /dev/hda1 /boot <<<<<<<< HANGS HERE

I now realise that the issues are a result of Junos expecting all the correct PCI devices. I've used virsh to assist in generating the required qemu full command and now I've managed to get it booting. :) From here I just need to get interfaces and a few other things working.

Hi Art,

Thanks for the reply, I have attempted to use virtio for disk emulation today and that certainly speeds things up from a boot perspective. The complete qemu cmd line I was trying for vJunos-Evolved was this:

qemu-system-x86_64 -machine type=pc,accel=kvm -monitor stdio -cpu host -m 8192 -smp 4 -display none -smbios type=0,vendor=Bochs,version=Bochs -smbios type=3,manufacturer=Bochs -smbios type=1,manufacturer=Bochs,product=Bochs,serial=chassis_no=0:slot=0:type=1:assembly_id=0x0D20:platform=251:master=0:channelized=no -serial telnet:0.0.0.0:5000,server,nowait -drive if=virtio,file=/vJunosEvolved-23.1R1.8-overlay.qcow2

Output from info block:

(qemu) info block

virtio0 (#block101): /vJunosEvolved-23.1R1.8-overlay.qcow2 (qcow2)

    Attached to:      /machine/peripheral-anon/device[0]/virtio-backend

    Cache mode:       writeback

    Backing file:     /vJunosEvolved-23.1R1.8.qcow2 (chain depth: 1)

ide1-cd0: [not inserted]

    Attached to:      /machine/unattached/device[27]

    Removable device: not locked, tray closed

floppy0: [not inserted]