[amdgpu] kernel crash when trying to resume from suspend
Brief summary of the problem:
system does not resume from suspend. kernel crash with hints to amdgpu
(see steps to reproduce for more details)
Downstream bug report: https://github.com/NixOS/nixpkgs/issues/119843
Hardware description:
- CPU: Intel i9-9900K
- GPU: AMD Radeon RX 480
- System Memory: G.Skill Ripjaws 32 GB DDR4 RAM (3200 MHz)
- Display(s): Dell UP2716D 27" 2K IPS LED Display, Samsung SyncMaster 943NW 19" TFT
- Type of Diplay Connection: Dell HDMI, Samsung HDMI-to-VGA Adapter
System infomration:
- Distro name and Version: NixOS 21.05pre283256.b2f2d04f01b (beta)
- Kernel version: 5.11.13 (also reproducible with default kernel 5.10.29 and older 5.4.111)
- Custom kernel: selected latest stable kernel (
pkgs.linuxPackages_latest
) - AMD package version: "No package" i guess. just have
services.xserver.videoDrivers = [ "amdgpu" ];
set
How to reproduce the issue:
With this i'm able to reproduce it always:
-
close every program except terminal
-
disable swap
sudo swapoff -a
- fill 99.9% of RAM
stress-ng --vm-bytes $(awk '/MemAvailable/{printf "%d\n", $2 * 0.99;}' < /proc/meminfo)k --vm-keep -m 1
- suspend the system. it can take some time until the system actually turns off
- try to resume. the system does power on, but i see a black screen. at that point, kernel errors are written to journal
- you have to hard shutdown the system by holding the power button
- start the system and check journal for kernel errors
Attached files:
See linked downstream issue for logs from older kernel versions.
from journal:
Click to expand
Apr 19 09:28:44 gaming ModemManager[2176]: <info> [sleep-monitor] system is about to suspend
Apr 19 09:28:44 gaming dbus-daemon[788]: [system] Activating via systemd: service name='org.freedesktop.nm_dispatcher' unit='dbus-org.freedesktop.nm-dispatcher.service' requested by ':1.7' (uid=0 pid=790 comm="/nix/store/5xmawzdfqv584kl5x>
Apr 19 09:28:44 gaming systemd[1]: Starting Network Manager Script Dispatcher Service...
Apr 19 09:28:44 gaming .wingpanel-wrap[2056]: DisplayWidget.vala:159: Unknown network state, cannot show the good icon: NETWORK_STATE_FAILED_WIRED
Apr 19 09:28:44 gaming dbus-daemon[788]: [system] Successfully activated service 'org.freedesktop.nm_dispatcher'
Apr 19 09:28:44 gaming systemd[1]: Started Network Manager Script Dispatcher Service.
Apr 19 09:28:44 gaming avahi-daemon[787]: Withdrawing address record for fe80::b73d:dce7:648e:9c84 on enp4s0.
Apr 19 09:28:44 gaming avahi-daemon[787]: Leaving mDNS multicast group on interface enp4s0.IPv6 with address fe80::b73d:dce7:648e:9c84.
Apr 19 09:28:44 gaming avahi-daemon[787]: Interface enp4s0.IPv6 no longer relevant for mDNS.
Apr 19 09:28:44 gaming avahi-daemon[787]: Withdrawing address record for 10.0.4.12 on enp4s0.
Apr 19 09:28:44 gaming avahi-daemon[787]: Leaving mDNS multicast group on interface enp4s0.IPv4 with address 10.0.4.12.
Apr 19 09:28:44 gaming avahi-daemon[787]: Interface enp4s0.IPv4 no longer relevant for mDNS.
Apr 19 09:28:44 gaming kernel: r8169 0000:04:00.0 enp4s0: Link is Down
Apr 19 09:28:44 gaming dnsmasq[1361]: reading /etc/resolv.conf
Apr 19 09:28:44 gaming .gsd-sharing-wr[1904]: Failed to StopUnit service: GDBus.Error:org.freedesktop.systemd1.NoSuchUnit: Unit gnome-user-share-webdav.service not loaded.
Apr 19 09:28:44 gaming .gsd-sharing-wr[1904]: Failed to StopUnit service: GDBus.Error:org.freedesktop.systemd1.NoSuchUnit: Unit gnome-remote-desktop.service not loaded.
Apr 19 09:28:44 gaming .gsd-sharing-wr[1904]: Failed to StopUnit service: GDBus.Error:org.freedesktop.systemd1.NoSuchUnit: Unit vino-server.service not loaded.
Apr 19 09:28:44 gaming dnsmasq[1361]: using nameserver 127.0.0.53#53
Apr 19 09:28:44 gaming .wingpanel-wrap[2056]: DisplayWidget.vala:159: Unknown network state, cannot show the good icon: NETWORK_STATE_FAILED_WIRED
Apr 19 09:28:44 gaming dnsmasq[1361]: reading /etc/resolv.conf
Apr 19 09:28:44 gaming dnsmasq[1361]: using nameserver 127.0.0.53#53
Apr 19 09:28:44 gaming dnsmasq[1361]: reading /etc/resolv.conf
Apr 19 09:28:44 gaming dnsmasq[1361]: using nameserver 127.0.0.53#53
Apr 19 09:28:44 gaming systemd[1]: Starting Pre-Sleep Actions...
Apr 19 09:28:44 gaming systemd[1]: pre-sleep.service: Succeeded.
Apr 19 09:28:44 gaming systemd[1]: Finished Pre-Sleep Actions.
Apr 19 09:28:44 gaming systemd[1]: Reached target Sleep.
Apr 19 09:28:44 gaming systemd[1]: Starting Restart Syncthing after resume...
Apr 19 09:28:44 gaming systemd[1]: Starting Suspend...
Apr 19 09:28:44 gaming systemd[1]: syncthing-resume.service: Succeeded.
Apr 19 09:28:44 gaming systemd[1]: Finished Restart Syncthing after resume.
Apr 19 09:28:44 gaming systemd-sleep[4572]: Suspending system...
Apr 19 09:28:44 gaming kernel: PM: suspend entry (deep)
Apr 19 09:28:44 gaming syncthing[1738]: [KS27C] 09:28:44 INFO: QUIC listener ([::]:22000) shutting down
Apr 19 09:28:44 gaming syncthing[1738]: [KS27C] 09:28:44 INFO: TCP listener ([::]:22000) shutting down
Apr 19 09:28:44 gaming syncthing[1738]: [KS27C] 09:28:44 INFO: Connection to YWRW6UX-77BCS7Z-BW3NCIZ-2P6EB2R-4BELP3L-OENVOQ4-PXH2ZBY-COVXZAM at [fe80::b73d:dce7:648e:9c84%enp4s0]:22000-[fe80::d85d:1ca7:3836:abe6%enp4s0]:22000/tcp-client/T>
Apr 19 09:28:44 gaming syncthing[1738]: [KS27C] 09:28:44 INFO: Connection to 5WUEWIO-FHLQ6BR-HJPVQBU-7ITVSF2-EB4WZ63-3UYUW6F-FNCK5EC-TWIRWQJ at 10.0.4.12:22000-10.0.0.4:22000/tcp-client/TLS1.3-TLS_AES_128_GCM_SHA256 closed: Syncthing is b>
Apr 19 09:28:44 gaming syncthing[1738]: [KS27C] 09:28:44 INFO: Exiting
Apr 19 09:28:44 gaming syncthing[1738]: [monitor] 09:28:44 INFO: Signal 1 received; restarting
Apr 19 09:28:44 gaming systemd[1]: syncthing.service: Succeeded.
Apr 19 09:28:44 gaming systemd[1]: syncthing.service: Consumed 2.602s CPU time, received 883.0K IP traffic, sent 101.7K IP traffic.
Apr 19 09:28:44 gaming kernel: Filesystems sync: 0.153 seconds
Apr 19 09:31:58 gaming kernel: Freezing user space processes ... (elapsed 0.003 seconds) done.
Apr 19 09:31:58 gaming kernel: OOM killer disabled.
Apr 19 09:31:58 gaming kernel: Freezing remaining freezable tasks ... (elapsed 0.000 seconds) done.
Apr 19 09:31:58 gaming kernel: printk: Suspending console(s) (use no_console_suspend to debug)
Apr 19 09:31:58 gaming kernel: serial 00:01: disabled
Apr 19 09:31:59 gaming kernel: sd 4:0:0:0: [sda] Synchronizing SCSI cache
Apr 19 09:31:59 gaming kernel: sd 4:0:0:0: [sda] Stopping disk
Apr 19 09:31:59 gaming kernel: kworker/u32:11: page allocation failure: order:0, mode:0x100c02(GFP_NOIO|__GFP_HIGHMEM|__GFP_HARDWALL), nodemask=(null),cpuset=/,mems_allowed=0
Apr 19 09:31:59 gaming kernel: CPU: 13 PID: 4582 Comm: kworker/u32:11 Not tainted 5.11.13 #1-NixOS
Apr 19 09:31:59 gaming kernel: Hardware name: Gigabyte Technology Co., Ltd. Z390 UD/Z390 UD, BIOS F6 01/16/2019
Apr 19 09:31:59 gaming kernel: Workqueue: events_unbound async_run_entry_fn
Apr 19 09:31:59 gaming kernel: Call Trace:
Apr 19 09:31:59 gaming kernel: dump_stack+0x6b/0x83
Apr 19 09:31:59 gaming kernel: warn_alloc.cold+0x78/0xdc
Apr 19 09:31:59 gaming kernel: ? unreserve_highatomic_pageblock+0x192/0x1d0
Apr 19 09:31:59 gaming kernel: __alloc_pages_slowpath.constprop.0+0xc70/0xcb0
Apr 19 09:31:59 gaming kernel: __alloc_pages_nodemask+0x308/0x340
Apr 19 09:31:59 gaming kernel: ttm_pool_alloc+0x2e4/0x5e0 [ttm]
Apr 19 09:31:59 gaming kernel: ttm_tt_populate+0x37/0xe0 [ttm]
Apr 19 09:31:59 gaming kernel: ttm_bo_handle_move_mem+0x142/0x180 [ttm]
Apr 19 09:31:59 gaming kernel: ttm_bo_evict+0x140/0x1a0 [ttm]
Apr 19 09:31:59 gaming kernel: ttm_mem_evict_first+0x106/0x3b0 [ttm]
Apr 19 09:31:59 gaming kernel: ? kfd_gtt_sa_free+0x56/0x80 [amdgpu]
Apr 19 09:31:59 gaming kernel: ttm_resource_manager_evict_all+0xad/0x1c0 [ttm]
Apr 19 09:31:59 gaming kernel: amdgpu_device_suspend+0x93/0x2d0 [amdgpu]
Apr 19 09:31:59 gaming kernel: pci_pm_suspend+0x74/0x160
Apr 19 09:31:59 gaming kernel: ? pci_pm_freeze+0xb0/0xb0
Apr 19 09:31:59 gaming kernel: dpm_run_callback+0x4c/0x120
Apr 19 09:31:59 gaming kernel: __device_suspend+0xfa/0x410
Apr 19 09:31:59 gaming kernel: async_suspend+0x1b/0x90
Apr 19 09:31:59 gaming kernel: async_run_entry_fn+0x37/0x140
Apr 19 09:31:59 gaming kernel: process_one_work+0x1df/0x370
Apr 19 09:31:59 gaming kernel: worker_thread+0x50/0x400
Apr 19 09:31:59 gaming kernel: ? process_one_work+0x370/0x370
Apr 19 09:31:59 gaming kernel: kthread+0x11b/0x140
Apr 19 09:31:59 gaming kernel: ? __kthread_bind_mask+0x60/0x60
Apr 19 09:31:59 gaming kernel: ret_from_fork+0x22/0x30
Apr 19 09:31:59 gaming kernel: Mem-Info:
Apr 19 09:31:59 gaming kernel: active_anon:2 inactive_anon:7785427 isolated_anon:32
active_file:131 inactive_file:144 isolated_file:0
unevictable:8 dirty:14 writeback:2
slab_reclaimable:21974 slab_unreclaimable:33835
mapped:134 shmem:2735270 pagetables:31943 bounce:0
free:101807 free_pcp:62 free_cma:0
Apr 19 09:31:59 gaming kernel: Node 0 active_anon:8kB inactive_anon:31141708kB active_file:524kB inactive_file:576kB unevictable:32kB isolated(anon):128kB isolated(file):0kB mapped:536kB dirty:56kB writeback:8kB shmem:10941080kB shmem_thp>
Apr 19 09:31:59 gaming kernel: Node 0 DMA free:15900kB min:32kB low:44kB high:56kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15984kB managed:15900k>
Apr 19 09:31:59 gaming kernel: lowmem_reserve[]: 0 891 32013 32013 32013
Apr 19 09:31:59 gaming kernel: Node 0 DMA32 free:131900kB min:7436kB low:8348kB high:9260kB reserved_highatomic:0KB active_anon:0kB inactive_anon:622304kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:996632kB>
Apr 19 09:31:59 gaming kernel: lowmem_reserve[]: 0 0 31122 31122 31122
Apr 19 09:31:59 gaming kernel: Node 0 Normal free:259428kB min:259772kB low:291640kB high:323508kB reserved_highatomic:0KB active_anon:8kB inactive_anon:30519364kB active_file:524kB inactive_file:576kB unevictable:32kB writepending:64kB p>
Apr 19 09:31:59 gaming kernel: lowmem_reserve[]: 0 0 0 0 0
Apr 19 09:31:59 gaming kernel: Node 0 DMA: 1*4kB (U) 1*8kB (U) 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15900kB
Apr 19 09:31:59 gaming kernel: Node 0 DMA32: 7767*4kB (UM) 5474*8kB (UM) 2915*16kB (UM) 319*32kB (UM) 3*64kB (M) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 131900kB
Apr 19 09:31:59 gaming kernel: Node 0 Normal: 55107*4kB (UME) 4725*8kB (UME) 5*16kB (U) 15*32kB (U) 6*64kB (U) 2*128kB (U) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 259428kB
Apr 19 09:31:59 gaming kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Apr 19 09:31:59 gaming kernel: Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Apr 19 09:31:59 gaming kernel: 2735545 total pagecache pages
Apr 19 09:31:59 gaming kernel: 0 pages in swap cache
Apr 19 09:31:59 gaming kernel: Swap cache stats: add 133791, delete 133863, find 1882/3541
Apr 19 09:31:59 gaming kernel: Free swap = 33039864kB
Apr 19 09:31:59 gaming kernel: Total swap = 33554424kB
Apr 19 09:31:59 gaming kernel: 8371426 pages RAM
Apr 19 09:31:59 gaming kernel: 0 pages HighMem/MovableOnly
Apr 19 09:31:59 gaming kernel: 166091 pages reserved
Apr 19 09:31:59 gaming kernel: 0 pages cma reserved
Apr 19 09:31:59 gaming kernel: [TTM] Buffer eviction failed
Apr 19 09:31:59 gaming kernel: amdgpu: Move buffer fallback to memcpy unavailable
Apr 19 09:31:59 gaming kernel: [TTM] Buffer eviction failed
Apr 19 09:31:59 gaming kernel: ACPI: Preparing to enter system sleep state S3
...
Apr 19 09:31:59 gaming kernel: ata5.00: disabling queued TRIM support
Apr 19 09:31:59 gaming kernel: ata5.00: configured for UDMA/133
Apr 19 09:31:59 gaming kernel: amdgpu 0000:01:00.0: [drm:amdgpu_ring_test_helper [amdgpu]] *ERROR* ring gfx test failed (-110)
Apr 19 09:31:59 gaming kernel: [drm:amdgpu_device_ip_resume_phase2 [amdgpu]] *ERROR* resume of IP block <gfx_v8_0> failed -110
Apr 19 09:31:59 gaming kernel: amdgpu 0000:01:00.0: amdgpu: amdgpu_device_ip_resume failed (-110).
Apr 19 09:31:59 gaming kernel: PM: dpm_run_callback(): pci_pm_resume+0x0/0xe0 returns -110
Apr 19 09:31:59 gaming kernel: PM: Device 0000:01:00.0 failed to resume async: error -110
Apr 19 09:31:59 gaming kernel: acpi LNXPOWER:04: Turning OFF
Apr 19 09:31:59 gaming kernel: acpi LNXPOWER:00: Turning OFF
Apr 19 09:31:59 gaming kernel: OOM killer enabled.
Apr 19 09:31:59 gaming kernel: Restarting tasks ...
Apr 19 09:31:59 gaming kernel: pwc: Logitech QuickCam 4000 Pro USB webcam detected.
Apr 19 09:31:59 gaming kernel: done.
Apr 19 09:31:59 gaming kernel: PM: suspend exit
Apr 19 09:31:59 gaming kernel: pwc: Registered as video0.
Apr 19 09:31:59 gaming kernel: input: PWC snapshot button as /devices/pci0000:00/0000:00:14.0/usb1/1-1/input/input26
Apr 19 09:31:58 gaming rtkit-daemon[1764]: The canary thread is apparently starving. Taking action.
Apr 19 09:31:58 gaming systemd-sleep[4572]: System resumed.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Demoting known real-time threads.
Apr 19 09:31:58 gaming systemd[1]: syncthing.service: Scheduled restart job, restart counter is at 2.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3587 of process 2448.
Apr 19 09:31:58 gaming systemd[1]: Stopped Syncthing service.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3574 of process 2532.
Apr 19 09:31:58 gaming systemd[1]: syncthing.service: Consumed 2.602s CPU time, received 883.0K IP traffic, sent 101.7K IP traffic.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3552 of process 2423.
Apr 19 09:31:58 gaming systemd[1]: Started Syncthing service.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3547 of process 2501.
Apr 19 09:31:58 gaming systemd[1]: NetworkManager-dispatcher.service: Succeeded.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3504 of process 2397.
Apr 19 09:31:58 gaming systemd[1]: systemd-suspend.service: Succeeded.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3493 of process 2341.
Apr 19 09:31:58 gaming systemd[1]: Finished Suspend.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3049 of process 2475.
Apr 19 09:31:58 gaming systemd[1]: Stopped target Sleep.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 3045 of process 2402.
Apr 19 09:31:58 gaming systemd[1]: Reached target Suspend.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 2372 of process 2252.
Apr 19 09:31:58 gaming systemd[1]: Starting Post-Resume Actions...
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 4068 of process 2010.
Apr 19 09:31:58 gaming systemd[1]: Stopped target Suspend.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 2049 of process 2010.
Apr 19 09:31:58 gaming systemd-logind[821]: Operation 'sleep' finished.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 2041 of process 2010.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 2038 of process 2010.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 2037 of process 2010.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Successfully demoted thread 2010 of process 2010.
Apr 19 09:31:58 gaming rtkit-daemon[1764]: Demoted 15 threads.
Apr 19 09:31:58 gaming bluetoothd[1071]: Controller resume with wake event 0x0
Apr 19 09:31:59 gaming ModemManager[2176]: <info> [sleep-monitor] system is resuming
Apr 19 09:31:59 gaming kernel: Generic FE-GE Realtek PHY r8169-400:00: attached PHY driver (mii_bus:phy_addr=r8169-400:00, irq=IGNORE)
Apr 19 09:31:59 gaming systemd[1]: post-resume.service: Succeeded.
Apr 19 09:31:59 gaming systemd[1]: Finished Post-Resume Actions.
Apr 19 09:31:59 gaming systemd[1]: Reached target Post-Resume Actions.
Apr 19 09:31:59 gaming systemd[1]: Stopped target Post-Resume Actions.
Apr 19 09:31:59 gaming kernel: amdgpu: Move buffer fallback to memcpy unavailable
Apr 19 09:31:59 gaming kernel: [drm:amdgpu_cs_ioctl [amdgpu]] *ERROR* Failed to process the buffer list -19!
Apr 19 09:31:59 gaming kernel: r8169 0000:04:00.0 enp4s0: Link is Down
Apr 19 09:31:59 gaming gala.desktop[2005]: amdgpu: The CS has been rejected, see dmesg for more information (-19).
Apr 19 09:31:59 gaming kernel: amdgpu: Move buffer fallback to memcpy unavailable
Apr 19 09:31:59 gaming kernel: [drm:amdgpu_cs_ioctl [amdgpu]] *ERROR* Failed to process the buffer list -19!
...
Apr 19 09:32:09 gaming kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring sdma1 timeout, signaled seq=7280, emitted seq=7282
Apr 19 09:32:09 gaming kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process pid 0 thread pid 0
Apr 19 09:32:09 gaming kernel: amdgpu 0000:01:00.0: amdgpu: GPU reset begin!
Apr 19 09:32:09 gaming kernel: BUG: unable to handle page fault for address: 0000016d00000028
Apr 19 09:32:09 gaming kernel: #PF: supervisor read access in kernel mode
Apr 19 09:32:09 gaming kernel: #PF: error_code(0x0000) - not-present page
Apr 19 09:32:09 gaming kernel: PGD 0 P4D 0
Apr 19 09:32:09 gaming kernel: Oops: 0000 [#1] SMP NOPTI
Apr 19 09:32:09 gaming kernel: CPU: 1 PID: 4578 Comm: kworker/1:0 Not tainted 5.11.13 #1-NixOS
Apr 19 09:32:09 gaming kernel: Hardware name: Gigabyte Technology Co., Ltd. Z390 UD/Z390 UD, BIOS F6 01/16/2019
Apr 19 09:32:09 gaming kernel: Workqueue: events drm_sched_job_timedout [gpu_sched]
Apr 19 09:32:09 gaming kernel: RIP: 0010:kernel_queue_uninit+0xd/0xf0 [amdgpu]
Apr 19 09:32:09 gaming kernel: Code: ee 48 89 c7 e8 b4 f9 ff ff 84 c0 0f 84 21 94 1f 00 4c 89 e0 5d 41 5c 41 5d c3 0f 1f 00 0f 1f 44 00 00 55 48 8b 47 10 48 89 fd <8b> 50 28 83 fa 02 74 78 83 fa 03 0f 84 b1 00 00 00 48 8b 7f 08 4c
Apr 19 09:32:09 gaming kernel: RSP: 0018:ffffa87b03ef3d50 EFLAGS: 00010246
Apr 19 09:32:09 gaming kernel: RAX: 0000016d00000000 RBX: ffff97e1280cb000 RCX: 0000000000800079
Apr 19 09:32:09 gaming kernel: RDX: 000000000080007a RSI: 0000000000000001 RDI: ffff97e128056540
Apr 19 09:32:09 gaming kernel: RBP: ffff97e128056540 R08: 0000000000000000 R09: ffffffffc10f6100
Apr 19 09:32:09 gaming kernel: R10: ffff97e10f929a40 R11: 0000000000000001 R12: ffff97e1280cb0d0
Apr 19 09:32:09 gaming kernel: R13: ffff97e11bc80000 R14: ffff97e1013a8000 R15: ffff97e1013a80c0
Apr 19 09:32:09 gaming kernel: FS: 0000000000000000(0000) GS:ffff97e89da40000(0000) knlGS:0000000000000000
Apr 19 09:32:09 gaming kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 19 09:32:09 gaming kernel: CR2: 0000016d00000028 CR3: 0000000729410001 CR4: 00000000003706e0
Apr 19 09:32:09 gaming kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Apr 19 09:32:09 gaming kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Apr 19 09:32:09 gaming kernel: Call Trace:
Apr 19 09:32:09 gaming kernel: stop_cpsch+0xa0/0xc0 [amdgpu]
Apr 19 09:32:09 gaming kernel: kgd2kfd_suspend.part.0+0x2f/0x40 [amdgpu]
Apr 19 09:32:09 gaming kernel: kgd2kfd_pre_reset+0x3f/0x50 [amdgpu]
Apr 19 09:32:09 gaming kernel: amdgpu_device_gpu_recover.cold+0x36e/0x95d [amdgpu]
Apr 19 09:32:09 gaming kernel: amdgpu_job_timedout+0x11c/0x140 [amdgpu]
Apr 19 09:32:09 gaming kernel: drm_sched_job_timedout+0x66/0xf0 [gpu_sched]
Apr 19 09:32:09 gaming kernel: process_one_work+0x1df/0x370
Apr 19 09:32:09 gaming kernel: worker_thread+0x50/0x400
Apr 19 09:32:09 gaming kernel: ? process_one_work+0x370/0x370
Apr 19 09:32:09 gaming kernel: kthread+0x11b/0x140
Apr 19 09:32:09 gaming kernel: ? __kthread_bind_mask+0x60/0x60
Apr 19 09:32:09 gaming kernel: ret_from_fork+0x22/0x30
Apr 19 09:32:09 gaming kernel: Modules linked in: af_packet rfcomm nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype br_netfilter xt_CHECKSUM xt_MASQUERADE xt_conntrack overlay ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_man>
Apr 19 09:32:09 gaming kernel: ledtrig_audio led_class mei_hdcp ee1004 snd_hda_codec_hdmi snd_compress iTCO_wdt ac97_bus intel_pmc_bxt snd_pcm_dmaengine watchdog x86_pkg_temp_thermal intel_powerclamp snd_hda_intel coretemp crc32_pclmul e>
Apr 19 09:32:09 gaming kernel: crc32c_generic crc16 mbcache jbd2 sd_mod t10_pi crc_t10dif crct10dif_generic xhci_pci xhci_pci_renesas ahci xhci_hcd libahci libata usbcore scsi_mod crct10dif_pclmul crct10dif_common crc32c_intel usb_common>
Apr 19 09:32:09 gaming kernel: CR2: 0000016d00000028
Apr 19 09:32:09 gaming kernel: ---[ end trace 7d4c5d926545c8d0 ]---
Apr 19 09:32:09 gaming kernel: RIP: 0010:kernel_queue_uninit+0xd/0xf0 [amdgpu]
Apr 19 09:32:09 gaming kernel: Code: ee 48 89 c7 e8 b4 f9 ff ff 84 c0 0f 84 21 94 1f 00 4c 89 e0 5d 41 5c 41 5d c3 0f 1f 00 0f 1f 44 00 00 55 48 8b 47 10 48 89 fd <8b> 50 28 83 fa 02 74 78 83 fa 03 0f 84 b1 00 00 00 48 8b 7f 08 4c
Apr 19 09:32:09 gaming kernel: RSP: 0018:ffffa87b03ef3d50 EFLAGS: 00010246
Apr 19 09:32:09 gaming kernel: RAX: 0000016d00000000 RBX: ffff97e1280cb000 RCX: 0000000000800079
Apr 19 09:32:09 gaming kernel: RDX: 000000000080007a RSI: 0000000000000001 RDI: ffff97e128056540
Apr 19 09:32:09 gaming kernel: RBP: ffff97e128056540 R08: 0000000000000000 R09: ffffffffc10f6100
Apr 19 09:32:09 gaming kernel: R10: ffff97e10f929a40 R11: 0000000000000001 R12: ffff97e1280cb0d0
Apr 19 09:32:09 gaming kernel: R13: ffff97e11bc80000 R14: ffff97e1013a8000 R15: ffff97e1013a80c0
Apr 19 09:32:09 gaming kernel: FS: 0000000000000000(0000) GS:ffff97e89da40000(0000) knlGS:0000000000000000
Apr 19 09:32:09 gaming kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 19 09:32:09 gaming kernel: CR2: 0000016d00000028 CR3: 0000000729410001 CR4: 00000000003706e0
Apr 19 09:32:09 gaming kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Apr 19 09:32:09 gaming kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Apr 19 09:32:09 gaming kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring sdma0 timeout, signaled seq=5010, emitted seq=5012
Apr 19 09:32:09 gaming kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process pid 0 thread pid 0
Apr 19 09:32:09 gaming kernel: amdgpu 0000:01:00.0: amdgpu: GPU reset begin!
Apr 19 09:32:09 gaming kernel: amdgpu 0000:01:00.0: amdgpu: Bailing on TDR for s_job:1122, as another already in progress
Here is another one with 5.11.14:
Click to expand
May 03 13:31:33 gaming kernel: rcu: INFO: rcu_sched self-detected stall on CPU
May 03 13:31:33 gaming kernel: rcu: 8-....: (20999 ticks this GP) idle=a3a/1/0x4000000000000000 softirq=3190516/3190516 fqs=5229
May 03 13:31:33 gaming kernel: (t=21000 jiffies g=6023301 q=885)
May 03 13:31:33 gaming kernel: NMI backtrace for cpu 8
May 03 13:31:33 gaming kernel: CPU: 8 PID: 52924 Comm: kworker/8:2 Not tainted 5.11.14 #1-NixOS
May 03 13:31:33 gaming kernel: Hardware name: Gigabyte Technology Co., Ltd. Z390 UD/Z390 UD, BIOS F6 01/16/2019
May 03 13:31:33 gaming kernel: Workqueue: events drm_sched_job_timedout [gpu_sched]
May 03 13:31:33 gaming kernel: Call Trace:
May 03 13:31:33 gaming kernel: <IRQ>
May 03 13:31:33 gaming kernel: dump_stack+0x6b/0x83
May 03 13:31:33 gaming kernel: nmi_cpu_backtrace.cold+0x32/0x69
May 03 13:31:33 gaming kernel: ? lapic_can_unplug_cpu+0x80/0x80
May 03 13:31:33 gaming kernel: nmi_trigger_cpumask_backtrace+0xdb/0xe0
May 03 13:31:33 gaming kernel: rcu_dump_cpu_stacks+0xa5/0xd3
May 03 13:31:33 gaming kernel: rcu_sched_clock_irq.cold+0x202/0x3b3
May 03 13:31:33 gaming kernel: ? timekeeping_advance+0x370/0x5c0
May 03 13:31:33 gaming kernel: update_process_times+0x8c/0xc0
May 03 13:31:33 gaming kernel: tick_sched_handle+0x34/0x50
May 03 13:31:33 gaming kernel: tick_sched_timer+0x7a/0xa0
May 03 13:31:33 gaming kernel: ? tick_nohz_handler+0xb0/0xb0
May 03 13:31:33 gaming kernel: __hrtimer_run_queues+0x12a/0x270
May 03 13:31:33 gaming kernel: hrtimer_interrupt+0x110/0x2c0
May 03 13:31:33 gaming kernel: __sysvec_apic_timer_interrupt+0x5f/0xd0
May 03 13:31:33 gaming kernel: asm_call_irq_on_stack+0x12/0x20
May 03 13:31:33 gaming kernel: </IRQ>
May 03 13:31:33 gaming kernel: sysvec_apic_timer_interrupt+0x72/0x80
May 03 13:31:33 gaming kernel: asm_sysvec_apic_timer_interrupt+0x12/0x20
May 03 13:31:33 gaming kernel: RIP: 0010:kfd_gtt_sa_free+0x3e/0x80 [amdgpu]
May 03 13:31:33 gaming kernel: Code: 0f 1f 44 00 00 4c 8d a3 70 01 00 00 4c 89 e7 e8 98 9b 6b fc 8b 45 00 3b 45 04 77 16 48 8b 93 68 01 00 00 89 c1 f0 48 0f b3 0a <83> c0 01 39 45 04 73 ea 4c 89 e7 e8 c2 8c 6b fc 48 89 ef e8 1a cc
May 03 13:31:33 gaming kernel: RSP: 0018:ffffb7bc0421fd40 EFLAGS: 00000286
May 03 13:31:33 gaming kernel: RAX: 000000005dfdb04a RBX: ffff9e8c58518c00 RCX: 000000005dfdb04a
May 03 13:31:33 gaming kernel: RDX: ffff9e8c4c1dc800 RSI: ffff9e8c5ca0c1e0 RDI: ffff9e8c58518d70
May 03 13:31:33 gaming kernel: RBP: ffff9e8c5ca0c1e0 R08: 0000000000000000 R09: 0000000000009ffb
May 03 13:31:33 gaming kernel: R10: 00000000ffffe000 R11: 3fffffffffffffff R12: ffff9e8c58518d70
May 03 13:31:33 gaming kernel: R13: ffff9e8c5b360000 R14: ffff9e8c41461000 R15: ffff9e8c414610c0
May 03 13:31:33 gaming kernel: stop_cpsch+0x94/0xc0 [amdgpu]
May 03 13:31:33 gaming kernel: kgd2kfd_suspend.part.0+0x2f/0x40 [amdgpu]
May 03 13:31:33 gaming kernel: kgd2kfd_pre_reset+0x3f/0x50 [amdgpu]
May 03 13:31:33 gaming kernel: amdgpu_device_gpu_recover.cold+0x36e/0x95d [amdgpu]
May 03 13:31:33 gaming kernel: amdgpu_job_timedout+0x11c/0x140 [amdgpu]
May 03 13:31:33 gaming kernel: drm_sched_job_timedout+0x66/0xf0 [gpu_sched]
May 03 13:31:33 gaming kernel: process_one_work+0x1df/0x370
May 03 13:31:33 gaming kernel: worker_thread+0x50/0x400
May 03 13:31:33 gaming kernel: ? process_one_work+0x370/0x370
May 03 13:31:33 gaming kernel: kthread+0x11b/0x140
May 03 13:31:33 gaming kernel: ? __kthread_bind_mask+0x60/0x60
May 03 13:31:33 gaming kernel: ret_from_fork+0x22/0x30
May 03 13:31:55 gaming kernel: BUG: unable to handle page fault for address: ffff9e8c580cb000
May 03 13:31:55 gaming kernel: #PF: supervisor write access in kernel mode
May 03 13:31:55 gaming kernel: #PF: error_code(0x0003) - permissions violation
May 03 13:31:55 gaming kernel: PGD 693201067 P4D 693201067 PUD 100d45063 PMD 1142c0063 PTE 80000001180cb161
May 03 13:31:55 gaming kernel: Oops: 0003 [#1] SMP NOPTI
May 03 13:31:55 gaming kernel: CPU: 8 PID: 52924 Comm: kworker/8:2 Not tainted 5.11.14 #1-NixOS
May 03 13:31:55 gaming kernel: Hardware name: Gigabyte Technology Co., Ltd. Z390 UD/Z390 UD, BIOS F6 01/16/2019
May 03 13:31:55 gaming kernel: Workqueue: events drm_sched_job_timedout [gpu_sched]
May 03 13:31:55 gaming kernel: RIP: 0010:kfd_gtt_sa_free+0x39/0x80 [amdgpu]
May 03 13:31:55 gaming kernel: Code: f5 53 48 89 fb 0f 1f 44 00 00 4c 8d a3 70 01 00 00 4c 89 e7 e8 98 9b 6b fc 8b 45 00 3b 45 04 77 16 48 8b 93 68 01 00 00 89 c1 <f0> 48 0f b3 0a 83 c0 01 39 45 04 73 ea 4c 89 e7 e8 c2 8c 6b fc 48
May 03 13:31:55 gaming kernel: RSP: 0018:ffffb7bc0421fd40 EFLAGS: 00010282
May 03 13:31:55 gaming kernel: RAX: 000000005f774000 RBX: ffff9e8c58518c00 RCX: 000000005f774000
May 03 13:31:55 gaming kernel: RDX: ffff9e8c4c1dc800 RSI: ffff9e8c5ca0c1e0 RDI: ffff9e8c58518d70
May 03 13:31:55 gaming kernel: RBP: ffff9e8c5ca0c1e0 R08: 0000000000000000 R09: 0000000000009ffb
May 03 13:31:55 gaming kernel: R10: 00000000ffffe000 R11: 3fffffffffffffff R12: ffff9e8c58518d70
May 03 13:31:55 gaming kernel: R13: ffff9e8c5b360000 R14: ffff9e8c41461000 R15: ffff9e8c414610c0
May 03 13:31:55 gaming kernel: FS: 0000000000000000(0000) GS:ffff9e93ddc00000(0000) knlGS:0000000000000000
May 03 13:31:55 gaming kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 03 13:31:55 gaming kernel: CR2: ffff9e8c580cb000 CR3: 0000000692a10002 CR4: 00000000003706e0
May 03 13:31:55 gaming kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
May 03 13:31:55 gaming kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
May 03 13:31:55 gaming kernel: Call Trace:
May 03 13:31:55 gaming kernel: stop_cpsch+0x94/0xc0 [amdgpu]
May 03 13:31:55 gaming kernel: kgd2kfd_suspend.part.0+0x2f/0x40 [amdgpu]
May 03 13:31:55 gaming kernel: kgd2kfd_pre_reset+0x3f/0x50 [amdgpu]
May 03 13:31:55 gaming kernel: amdgpu_device_gpu_recover.cold+0x36e/0x95d [amdgpu]
May 03 13:31:55 gaming kernel: amdgpu_job_timedout+0x11c/0x140 [amdgpu]
May 03 13:31:55 gaming kernel: drm_sched_job_timedout+0x66/0xf0 [gpu_sched]
May 03 13:31:55 gaming kernel: process_one_work+0x1df/0x370
May 03 13:31:55 gaming kernel: worker_thread+0x50/0x400
May 03 13:31:55 gaming kernel: ? process_one_work+0x370/0x370
May 03 13:31:55 gaming kernel: kthread+0x11b/0x140
May 03 13:31:55 gaming kernel: ? __kthread_bind_mask+0x60/0x60
May 03 13:31:55 gaming kernel: ret_from_fork+0x22/0x30
May 03 13:31:55 gaming kernel: Modules linked in: nf_conntrack_netlink nfnetlink xfrm_user xfrm_algo xt_addrtype br_netfilter overlay af_packet rfcomm xt_CHECKSUM xt_MASQUERADE xt_conntrack ipt_REJECT nf_reject_ipv4 xt_tcpudp ip6table_mangle ip6table_nat ip6table_filter ip6_tables iptable_mangle iptable_nat cmac nf_nat algif_hash nf_conntrack algif_skcipher af_>
May 03 13:31:55 gaming kernel: iTCO_wdt ledtrig_audio hid intel_pmc_bxt led_class mei_hdcp snd_hda_codec_hdmi ee1004 ac97_bus watchdog snd_pcm_dmaengine iommu_v2 snd_hda_intel gpu_sched x86_pkg_temp_thermal intel_powerclamp snd_intel_dspcfg wmi_bmof drm_ttm_helper coretemp evdev crc32_pclmul mac_hid ttm intel_wmi_thunderbolt snd_hda_codec sch_fq_codel ghash_cl>
May 03 13:31:55 gaming kernel: crc16 mbcache jbd2 sd_mod t10_pi crc_t10dif crct10dif_generic ahci xhci_pci xhci_pci_renesas libahci xhci_hcd libata usbcore scsi_mod crct10dif_pclmul crct10dif_common crc32c_intel usb_common rtc_cmos dm_mod
May 03 13:31:55 gaming kernel: CR2: ffff9e8c580cb000
May 03 13:31:55 gaming kernel: ---[ end trace 6eeeeb3830fcc510 ]---
May 03 13:31:55 gaming kernel: RIP: 0010:kfd_gtt_sa_free+0x39/0x80 [amdgpu]
May 03 13:31:55 gaming kernel: Code: f5 53 48 89 fb 0f 1f 44 00 00 4c 8d a3 70 01 00 00 4c 89 e7 e8 98 9b 6b fc 8b 45 00 3b 45 04 77 16 48 8b 93 68 01 00 00 89 c1 <f0> 48 0f b3 0a 83 c0 01 39 45 04 73 ea 4c 89 e7 e8 c2 8c 6b fc 48
May 03 13:31:55 gaming kernel: RSP: 0018:ffffb7bc0421fd40 EFLAGS: 00010282
May 03 13:31:55 gaming kernel: RAX: 000000005f774000 RBX: ffff9e8c58518c00 RCX: 000000005f774000
May 03 13:31:55 gaming kernel: RDX: ffff9e8c4c1dc800 RSI: ffff9e8c5ca0c1e0 RDI: ffff9e8c58518d70
May 03 13:31:55 gaming kernel: RBP: ffff9e8c5ca0c1e0 R08: 0000000000000000 R09: 0000000000009ffb
May 03 13:31:55 gaming kernel: R10: 00000000ffffe000 R11: 3fffffffffffffff R12: ffff9e8c58518d70
May 03 13:31:55 gaming kernel: R13: ffff9e8c5b360000 R14: ffff9e8c41461000 R15: ffff9e8c414610c0
May 03 13:31:55 gaming kernel: FS: 0000000000000000(0000) GS:ffff9e93ddc00000(0000) knlGS:0000000000000000
May 03 13:31:55 gaming kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
May 03 13:31:55 gaming kernel: CR2: ffff9e8c580cb000 CR3: 0000000692a10002 CR4: 00000000003706e0
May 03 13:31:55 gaming kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
May 03 13:31:55 gaming kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
May 03 13:31:55 gaming io.elementary.wingpanel.desktop[12950]: out of memory: 0x0000000000000050 bytes requested
May 03 13:31:55 gaming kernel: Web Content[12950]: segfault at 0 ip 0000555a63448ace sp 00007ffe9e1a0380 error 6 in firefox[555a6343d000+67000]
May 03 13:31:55 gaming kernel: Code: 68 c6 05 00 48 8b 33 e8 20 a1 05 00 48 8b 33 bf 0a 00 00 00 e8 c3 a1 05 00 48 8d 05 63 4f fe ff 48 8d 0d a5 f6 05 00 48 89 01 <c7> 04 25 00 00 00 00 21 00 00 00 e8 02 00 00 00 cc cc 48 83 ec 08
May 03 13:31:55 gaming kernel: audit: type=1701 audit(1620041515.779:89): auid=1000 uid=1000 gid=100 ses=5 subj=kernel pid=12950 comm=57656220436F6E74656E74 exe="/nix/store/76a3k311qrvb7yvss8llfwqq5cyr9sa0-firefox-88.0/lib/firefox/firefox" sig=11 res=1
May 03 13:31:55 gaming audit[12950]: ANOM_ABEND auid=1000 uid=1000 gid=100 ses=5 subj=kernel pid=12950 comm=57656220436F6E74656E74 exe="/nix/store/76a3k311qrvb7yvss8llfwqq5cyr9sa0-firefox-88.0/lib/firefox/firefox" sig=11 res=1
May 03 13:31:55 gaming audit: BPF prog-id=691 op=UNLOAD
May 03 13:31:55 gaming audit: BPF prog-id=692 op=UNLOAD
May 03 13:31:55 gaming audit: BPF prog-id=734 op=LOAD
May 03 13:31:55 gaming audit: BPF prog-id=735 op=LOAD
May 03 13:31:55 gaming audit: BPF prog-id=736 op=LOAD
May 03 13:31:55 gaming kernel: audit: type=1334 audit(1620041515.803:90): prog-id=691 op=UNLOAD
May 03 13:31:55 gaming kernel: audit: type=1334 audit(1620041515.803:91): prog-id=692 op=UNLOAD
May 03 13:31:55 gaming kernel: audit: type=1334 audit(1620041515.803:92): prog-id=734 op=LOAD
May 03 13:31:55 gaming kernel: audit: type=1334 audit(1620041515.803:93): prog-id=735 op=LOAD
May 03 13:31:55 gaming kernel: audit: type=1334 audit(1620041515.803:94): prog-id=736 op=LOAD
May 03 13:31:55 gaming kernel: audit: type=1334 audit(1620041515.804:95): prog-id=737 op=LOAD
May 03 13:31:55 gaming audit: BPF prog-id=737 op=LOAD
May 03 13:31:55 gaming audit: BPF prog-id=738 op=LOAD
May 03 13:31:55 gaming systemd[1]: Started Process Core Dump (PID 55026/UID 0).
May 03 13:31:55 gaming kernel: audit: type=1334 audit(1620041515.804:96): prog-id=738 op=LOAD
May 03 13:31:55 gaming kernel: audit: type=1130 audit(1620041515.804:97): pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-coredump@5-55026-0 comm="systemd" exe="/nix/store/piwibdb9y24dqpn91vyfx06ql9zsk8wn-systemd-247.6/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
May 03 13:31:55 gaming audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-coredump@5-55026-0 comm="systemd" exe="/nix/store/piwibdb9y24dqpn91vyfx06ql9zsk8wn-systemd-247.6/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
May 03 13:31:56 gaming audit[13023]: ANOM_ABEND auid=1000 uid=1000 gid=100 ses=5 subj=kernel pid=13023 comm=57656220436F6E74656E74 exe="/nix/store/76a3k311qrvb7yvss8llfwqq5cyr9sa0-firefox-88.0/lib/firefox/firefox" sig=11 res=1
May 03 13:31:56 gaming audit: BPF prog-id=739 op=LOAD
May 03 13:31:56 gaming audit: BPF prog-id=740 op=LOAD
May 03 13:31:56 gaming audit: BPF prog-id=741 op=LOAD
May 03 13:31:56 gaming systemd[1]: Started Process Core Dump (PID 55028/UID 0).
May 03 13:31:56 gaming audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 subj=kernel msg='unit=systemd-coredump@6-55028-0 comm="systemd" exe="/nix/store/piwibdb9y24dqpn91vyfx06ql9zsk8wn-systemd-247.6/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
May 03 13:31:59 gaming kernel: BUG: kernel NULL pointer dereference, address: 0000000000000008
May 03 13:31:59 gaming kernel: #PF: supervisor write access in kernel mode
May 03 13:31:59 gaming kernel: #PF: error_code(0x0002) - not-present page
May 03 13:31:59 gaming kernel: PGD 0 P4D 0
May 03 13:31:59 gaming kernel: Oops: 0002 [#2] SMP NOPTI
May 03 13:31:59 gaming kernel: CPU: 9 PID: 126 Comm: kswapd0 Tainted: G D 5.11.14 #1-NixOS
Edited by davidak