AMDGPU fails to resume from suspend
Brief summary of the problem:
The display always remains off after resume, no signal is detected on any interface. In case of hibernation, the system boots normally, then the display turns off immediately after reloading the saved state. I tested with multiple kernel versions, the error is same (6.3.x-6.4.x)
Hardware description:
- CPU: i7-12700
- GPU: [AMD/ATI] Navi 23 [Radeon RX 6650 XT / 6700S / 6800S] (rev c1) - ASUS ROG Strix RX 6650 XT OC Edition
- System Memory: 48GB
- Display(s): DELL U2717D
- Type of Display Connection: DP (HDMI, both tested)
System information:
- Distro name and Version: Arch Linux, up-to-date
- Kernel version: 6.4.2
- Custom kernel: 6.4.2-zen1-1-zen
- AMD official driver version: N/A
How to reproduce the issue:
- Suspend the system.
- Resume the system, display remains DPMS off mode.
Attached files:
Log files (for system lockups / game freezes / crashes)
Activity
added S3 label
added 6000 dGPU Series label
Thank you for your answer.
I tried but no change. journalctl2.log.zip
10:47:10 kernel: [drm] psp gfx command UNKNOWN CMD(0xFFFFFFFF) failed and response status is (0xFFFFFFFF)
After this has happened; can you run
rmmod amdgpufollowed bymodprobe amdgpuvia SSH? I'm wondering if maybe the driver is trying to communicate with the hardware before it's actually up and running.of course dmesg
I can't remove amdgpu module after resume, it says "Device or resource busy" (Suspend initialized from shell after login without xorg or wayland.)
I have seemingly identical problem with RX5700, it happened so far only on kernel 6.4.
Kernel version: 6.4.3-2-MANJARO #1 (closed) SMP PREEMPT_DYNAMIC Sun Jul 16 16:55:12 UTC 2023 x86_64 GNU/Linux
Suspend took longer than usual and after resume by pressing a key on keyboard, screen did not turn on.
A hopefully relevant part of trace (attached complete):
Jul 20 21:44:50 too-pc kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring sdma0 timeout, signaled seq=1605372, emitted seq=1605374 Jul 20 21:44:50 too-pc kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process pid 0 thread pid 0 Jul 20 21:44:50 too-pc kernel: amdgpu 0000:2f:00.0: amdgpu: GPU reset begin! Jul 20 21:44:51 too-pc systemd[1]: NetworkManager-dispatcher.service: Deactivated successfully. Jul 20 21:44:54 too-pc kernel: amdgpu 0000:2f:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x0000003A SMN_C2PMSG_82:0x00000000 Jul 20 21:44:54 too-pc kernel: amdgpu 0000:2f:00.0: amdgpu: Failed to retrieve enabled ppfeatures! Jul 20 21:44:58 too-pc kernel: amdgpu 0000:2f:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x0000003A SMN_C2PMSG_82:0x00000000 Jul 20 21:44:58 too-pc kernel: amdgpu 0000:2f:00.0: amdgpu: Failed to retrieve enabled ppfeatures! Jul 20 21:45:02 too-pc kernel: amdgpu 0000:2f:00.0: amdgpu: failed to suspend display audio Jul 20 21:45:02 too-pc kernel: amdgpu 0000:2f:00.0: amdgpu: Failed to disallow df cstate Jul 20 21:45:02 too-pc kernel: ------------[ cut here ]------------ Jul 20 21:45:02 too-pc kernel: WARNING: CPU: 24 PID: 574073 at drivers/gpu/drm/amd/amdgpu/amdgpu_irq.c:599 amdgpu_irq_put+0x46/0x70 [amdgpu] Jul 20 21:45:02 too-pc kernel: Modules linked in: tls vhost_net vhost vhost_iotlb tap tun dm_crypt cbc encrypted_keys trusted asn1_encoder tee xt_conntrack xt_MASQUERADE nf_conntrack_netlink nfnetlink iptable_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 libcrc32c x t_addrtype iptable_filter br_netfilter snd_seq_dummy snd_hrtimer snd_seq bridge stp llc rfkill qrtr overlay uvcvideo videobuf2_vmalloc uvc videobuf2_memops snd_usb_audio videobuf2_v4l2 snd_usbmidi_lib videodev uas snd_rawmidi videobuf2_common snd_seq_device mousedev mc joyd ev vfat fat intel_rapl_msr intel_rapl_common edac_mce_amd kvm_amd snd_hda_codec_realtek ccp snd_hda_codec_generic ledtrig_audio snd_hda_codec_hdmi snd_hda_intel kvm snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec crct10dif_pclmul crc32_pclmul polyval_clmulni snd_hda_core polyval_generic gf128mul snd_hwdep r8169 ghash_clmulni_intel snd_pcm sha512_ssse3 aesni_intel snd_timer crypto_simd wmi_bmof sp5100_tco realtek cryptd snd rapl mdio_devres pcspkr soundcore k10temp i2c_piix4 libphy ryzen_smu(OE) Jul 20 21:45:02 too-pc kernel: mac_hid uinput i2c_dev dm_multipath fuse crypto_user dm_mod loop bpf_preload ip_tables x_tables ext4 crc32c_generic crc16 mbcache jbd2 usb_storage usbhid crc32c_intel nvme xhci_pci nvme_core xhci_pci_renesas nvme_common vfio_pci vfio_pci_core irqbypass vfio_iommu_type1 vfio iommufd amdgpu i2c_algo_bit drm_ttm_helper ttm video wmi drm_suballoc_helper drm_buddy gpu_sched drm_display_helper cec Jul 20 21:45:02 too-pc kernel: CPU: 24 PID: 574073 Comm: kworker/u64:25 Tainted: G W OE 6.4.3-2-MANJARO #1 00e85e278f33e769813ea7ae6ba8e625d37e2fac Jul 20 21:45:02 too-pc kernel: Hardware name: Micro-Star International Co., Ltd. MS-7C37/MPG X570 GAMING PLUS (MS-7C37), BIOS A.I0 08/10/2022 Jul 20 21:45:02 too-pc kernel: Workqueue: amdgpu-reset-dev drm_sched_job_timedout [gpu_sched] Jul 20 21:45:02 too-pc kernel: RIP: 0010:amdgpu_irq_put+0x46/0x70 [amdgpu] Jul 20 21:45:02 too-pc kernel: Code: c0 74 33 48 8b 4e 10 48 83 39 00 74 29 89 d1 48 8d 04 88 8b 08 85 c9 74 11 f0 ff 08 74 07 31 c0 e9 8f c5 ae f0 e9 5a fd ff ff <0f> 0b b8 ea ff ff ff e9 7e c5 ae f0 b8 ea ff ff ff e9 74 c5 ae f0 Jul 20 21:45:02 too-pc kernel: RSP: 0018:ffffa87787687c98 EFLAGS: 00010246 Jul 20 21:45:02 too-pc kernel: RAX: ffff9c5f5233c980 RBX: ffff9c5f546c0000 RCX: 0000000000000000 Jul 20 21:45:02 too-pc kernel: RDX: 0000000000000000 RSI: ffff9c5f546d9250 RDI: ffff9c5f546c0000 Jul 20 21:45:02 too-pc kernel: RBP: ffff9c5f546c0000 R08: 000000000003ac80 R09: 0000000000000006 Jul 20 21:45:02 too-pc kernel: R10: 0000000000000100 R11: 0000000000000000 R12: 0000000000001050 Jul 20 21:45:02 too-pc kernel: R13: ffff9c5f546e5d70 R14: ffff9c666fb86000 R15: 0000000000000000 Jul 20 21:45:02 too-pc kernel: FS: 0000000000000000(0000) GS:ffff9c6a3f000000(0000) knlGS:0000000000000000 Jul 20 21:45:02 too-pc kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jul 20 21:45:02 too-pc kernel: CR2: 00007f26044c5038 CR3: 000000036936a000 CR4: 0000000000350ee0 Jul 20 21:45:02 too-pc kernel: Call Trace: Jul 20 21:45:02 too-pc kernel: <TASK> Jul 20 21:45:02 too-pc kernel: ? amdgpu_irq_put+0x46/0x70 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: ? __warn+0x81/0x130 Jul 20 21:45:02 too-pc kernel: ? amdgpu_irq_put+0x46/0x70 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: ? report_bug+0x171/0x1a0 Jul 20 21:45:02 too-pc kernel: ? handle_bug+0x3c/0x80 Jul 20 21:45:02 too-pc kernel: ? exc_invalid_op+0x17/0x70 Jul 20 21:45:02 too-pc kernel: ? asm_exc_invalid_op+0x1a/0x20 Jul 20 21:45:02 too-pc kernel: ? amdgpu_irq_put+0x46/0x70 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: gfx_v10_0_hw_fini+0x1e/0x160 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: amdgpu_device_ip_suspend_phase2+0x107/0x1a0 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: ? amdgpu_device_ip_suspend_phase1+0x71/0xe0 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: amdgpu_device_ip_suspend+0x36/0x70 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: amdgpu_device_pre_asic_reset+0xd3/0x2b0 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: amdgpu_device_gpu_recover+0x4c9/0xd80 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: amdgpu_job_timedout+0x18d/0x240 [amdgpu e53a5ce3236982c3abd9d891fdaf5541b1a96ab9] Jul 20 21:45:02 too-pc kernel: drm_sched_job_timedout+0x7a/0x110 [gpu_sched e56a49900f4cfad6f449f14abf3e996a15ceae97] Jul 20 21:45:02 too-pc kernel: process_one_work+0x1c7/0x3d0 Jul 20 21:45:02 too-pc kernel: worker_thread+0x51/0x390 Jul 20 21:45:02 too-pc kernel: ? __pfx_worker_thread+0x10/0x10 Jul 20 21:45:02 too-pc kernel: kthread+0xe8/0x120 Jul 20 21:45:02 too-pc kernel: ? __pfx_kthread+0x10/0x10 Jul 20 21:45:02 too-pc kernel: ret_from_fork+0x2c/0x50 Jul 20 21:45:02 too-pc kernel: </TASK> Jul 20 21:45:02 too-pc kernel: ---[ end trace 0000000000000000 ]--- Jul 20 21:45:02 too-pc kernel: ------------[ cut here ]------------Edited by Michal TureckiIt it likely new to the 6.4 but it never happened to me on 6.4.1 or 6.4.2. Granted 1 and 2 were not stable in other areas (random crashes under GPU stress from firefox and games due to a known and already reverted/fixed bug).
Problem is the issue happened only once for me, when Firefox with many tabs was opened, after using VLC with OpenGL renderer, playing Rocket League on latest arch wine and CS:Go with -vulkan.
I will try to post an update what of the above triggers the issue, it might be just Gnome Wayland as well.
Edited by Michal Turecki
Same issue here. Linux 6.4 AND Linux 6.5, AMD RX580.
Steps to reproduce:
- Start up your favorite Linux distribution
- Suspend the computer with “systemctl suspend”
- Wake the computer.
- No disk activity, monitors stay black. System cannot be reset using “reisub”
This is relatively consistent too.
Tested with Arch Linux
Edited by SlayerProof32Hello. Just installed Arch on my 11,5 MacBookPro which has the "AMD Radeon R9 M370X". This is the Mid-2015, model with the aformentioned discrete gpu.
I have exactly the same problem as OP. I am able to SSH into the system after resuming suspend, but the screen is black. rmmod cant' work because "amdgpu" driver is in use, even after stopping gdm.
Kernel boot options: "acpi_osi=Darwin acpi_backlight=native radeon.si_support=0 amdgpu.si_support=1 cryptdevice=UUID=REDACTED:root root=/dev/mapper/root rw add_efi_memmap"
Ensured that "amdgpu" loads before "radeon" I am not sure what I'm looking at, but because some of the strings match exactly, I thought you might be interested to see my trace (attached due to spam protection).
Thanks and good luck!
Got the same issue, it's not always occurring, but this time I had a 3D application running when suspending. No additional options on the cmdline.
Hardware
H/W path Device Class Description ======================================================================== system MS-7C56 (To be filled by O.E.M.) /0 bus MPG B550 GAMING PLUS (MS-7C56) /0/0 memory 64KiB BIOS /0/10 memory 48GiB System Memory /0/10/0 memory 8GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 21 /0/10/1 memory 8GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 21 /0/10/2 memory 16GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 2 /0/10/3 memory 16GiB DIMM DDR4 Synchronous Unbuffered (Unregistered) 2 /0/12 memory 768KiB L1 cache /0/13 memory 4MiB L2 cache /0/14 memory 16MiB L3 cache /0/15 processor AMD Ryzen 7 1700X Eight-Core Processor /0/100 bridge Family 17h (Models 00h-0fh) Root Complex /0/100/0.2 generic Family 17h (Models 00h-0fh) I/O Memory Management Unit /0/100/1.1 bridge Family 17h (Models 00h-0fh) PCIe GPP Bridge /0/100/1.1/0 /dev/nvme0 storage Samsung SSD 970 EVO Plus 2TB /0/100/1.1/0/0 hwmon1 disk NVMe disk /0/100/1.1/0/2 /dev/ng0n1 disk NVMe disk /0/100/1.1/0/1 /dev/nvme0n1 disk 2TB NVMe disk /0/100/1.1/0/1/1 /dev/nvme0n1p1 volume 1863GiB OS X ZFS partition or Solaris /usr partition /0/100/1.1/0/1/9 /dev/nvme0n1p9 volume 8191KiB reserved partition /0/100/1.2 bridge Family 17h (Models 00h-0fh) PCIe GPP Bridge /0/100/1.2/0 bus 500 Series Chipset USB 3.1 XHCI Controller /0/100/1.2/0/0 usb1 bus xHCI Host Controller /0/100/1.2/0/0/2 bus USB2.0 Hub /0/100/1.2/0/0/3 communication ASUS USB-BT500 /0/100/1.2/0/0/5 input31 input Lenovo ThinkPad Compact USB Keyboard with TrackPoint /0/100/1.2/0/0/6 input43 input Logitech MX Vertical Advanced Ergonomic Mouse Keyboard /0/100/1.2/0/0/7 input7 input MSI MYSTIC LIGHT /0/100/1.2/0/1 usb2 bus xHCI Host Controller /0/100/1.2/0.1 scsi0 storage 500 Series Chipset SATA Controller /0/100/1.2/0.1/0 /dev/sda disk 128GB Samsung SSD 840 /0/100/1.2/0.1/0/1 /dev/sda1 volume 15MiB reserved partition /0/100/1.2/0.1/0/2 /dev/sda2 volume 119GiB Windows NTFS volume /0/100/1.2/0.1/1 /dev/sdb disk 2TB WDC WDS200T2B0A /0/100/1.2/0.1/1/1 /dev/sdb1 volume 1863GiB OS X ZFS partition or Solaris /usr partition /0/100/1.2/0.1/1/9 /dev/sdb9 volume 8191KiB reserved partition /0/100/1.2/0.1/0.0.0 /dev/sdc disk 2TB Samsung SSD 860 /0/100/1.2/0.1/0.0.0/1 /dev/sdc1 volume 1863GiB OS X ZFS partition or Solaris /usr partition /0/100/1.2/0.1/0.0.0/9 /dev/sdc9 volume 8191KiB reserved partition /0/100/1.2/0.2 bridge 500 Series Chipset Switch Upstream Port /0/100/1.2/0.2/0 bridge Advanced Micro Devices, Inc. [AMD] /0/100/1.2/0.2/0/0 /dev/nvme1 storage Samsung SSD 970 EVO Plus 500GB /0/100/1.2/0.2/0/0/0 hwmon0 disk NVMe disk /0/100/1.2/0.2/0/0/2 /dev/ng1n1 disk NVMe disk /0/100/1.2/0.2/0/0/1 /dev/nvme1n1 disk 500GB NVMe disk /0/100/1.2/0.2/0/0/1/1 /dev/nvme1n1p1 volume 1023MiB Windows FAT volume /0/100/1.2/0.2/0/0/1/2 /dev/nvme1n1p2 volume 364GiB EFI partition /0/100/1.2/0.2/0/0/1/3 /dev/nvme1n1p3 volume 99GiB EFI partition /0/100/1.2/0.2/6 bridge Advanced Micro Devices, Inc. [AMD] /0/100/1.2/0.2/7 bridge Advanced Micro Devices, Inc. [AMD] /0/100/1.2/0.2/8 bridge Advanced Micro Devices, Inc. [AMD] /0/100/1.2/0.2/9 bridge Advanced Micro Devices, Inc. [AMD] /0/100/1.2/0.2/9/0 enp42s0 network RTL8111/8168/8211/8411 PCI Express Gigabit Ethernet Con /0/100/3.1 bridge Family 17h (Models 00h-0fh) PCIe GPP Bridge /0/100/3.1/0 bridge Navi 10 XL Upstream Port of PCI Express Switch /0/100/3.1/0/0 /dev/fb0 bridge Navi 10 XL Downstream Port of PCI Express Switch /0/100/3.1/0/0/0 /dev/fb0 display Navi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT] /0/100/3.1/0/0/0.1 card0 multimedia Navi 10 HDMI Audio /0/100/3.1/0/0/0.1/0 input10 input HDA ATI HDMI HDMI/DP,pcm=7 /0/100/3.1/0/0/0.1/1 input11 input HDA ATI HDMI HDMI/DP,pcm=8 /0/100/3.1/0/0/0.1/2 input12 input HDA ATI HDMI HDMI/DP,pcm=9 /0/100/3.1/0/0/0.1/3 input13 input HDA ATI HDMI HDMI/DP,pcm=10 /0/100/3.1/0/0/0.1/4 input14 input HDA ATI HDMI HDMI/DP,pcm=11 /0/100/3.1/0/0/0.1/5 input9 input HDA ATI HDMI HDMI/DP,pcm=3 /0/100/7.1 bridge Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 /0/100/7.1/0 generic Zeppelin/Raven/Raven2 PCIe Dummy Function /0/100/7.1/0.2 generic Family 17h (Models 00h-0fh) Platform Security Processor /0/100/7.1/0.3 bus Family 17h (Models 00h-0fh) USB 3.0 Host Controller /0/100/7.1/0.3/0 usb3 bus xHCI Host Controller /0/100/7.1/0.3/0/3 card2 multimedia Blue Microphones Blue Snowball /0/100/7.1/0.3/1 usb4 bus xHCI Host Controller /0/100/7.1/0.3/1/2 card3 multimedia Logitech StreamCam /0/100/7.1/0.3/1/4 scsi7 storage DataTraveler 3.0 /0/100/7.1/0.3/1/4/0.0.0 /dev/sdd disk 495GB DataTraveler 3.0 /0/100/7.1/0.3/1/4/0.0.0/0 /dev/sdd disk 495GB /0/100/7.1/0.3/1/4/0.0.0/0/1 /dev/sdd1 volume 461GiB Windows NTFS volume /0/100/8.1 bridge Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 /0/100/8.1/0 generic Zeppelin/Renoir PCIe Dummy Function /0/100/8.1/0.2 storage FCH SATA Controller [AHCI mode] /0/100/8.1/0.3 card1 multimedia Family 17h (Models 00h-0fh) HD Audio Controller /0/100/8.1/0.3/0 input15 input HD-Audio Generic Front Mic /0/100/8.1/0.3/1 input16 input HD-Audio Generic Rear Mic /0/100/8.1/0.3/2 input17 input HD-Audio Generic Line /0/100/8.1/0.3/3 input18 input HD-Audio Generic Line Out Front /0/100/8.1/0.3/4 input19 input HD-Audio Generic Line Out Surround /0/100/8.1/0.3/5 input20 input HD-Audio Generic Line Out CLFE /0/100/8.1/0.3/6 input21 input HD-Audio Generic Front Headphone /0/100/14 bus FCH SMBus Controller /0/100/14.3 bridge FCH LPC Bridge /0/100/14.3/0 system System Board /0/100/14.3/1 system AT Real-Time Clock /0/100/14.3/2 system Motherboard registers /0/100/14.3/3 communication 16550A-compatible COM port /0/100/14.3/4 system Motherboard registers /0/101 bridge Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge /0/102 bridge Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge /0/103 bridge Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge /0/104 bridge Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge /0/105 bridge Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge /0/106 bridge Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge /0/107 bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /0/108 bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /0/109 bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /0/10a bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /0/10b bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /0/10c bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /0/10d bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /0/10e bridge Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Fu /1 input0 input Power Button /2 input1 input Power Button /3 input8 input PC Speaker[298775.999875] snd_hda_intel 0000:2d:00.1: Refused to change power state from D0 to D3hot [298786.053755] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring sdma0 timeout, signaled seq=1539785, emitted seq=1539787 [298786.054403] [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process pid 0 thread pid 0 [298786.054953] amdgpu 0000:2d:00.0: amdgpu: GPU reset begin! [298790.356036] amdgpu 0000:2d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x0000003A SMN_C2PMSG_82:0x00000000 [298790.356045] amdgpu 0000:2d:00.0: amdgpu: Failed to retrieve enabled ppfeatures! [298794.697586] amdgpu 0000:2d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x0000003A SMN_C2PMSG_82:0x00000000 [298794.697595] amdgpu 0000:2d:00.0: amdgpu: Failed to retrieve enabled ppfeatures! [298794.697684] amdgpu 0000:2d:00.0: amdgpu: Failed to disallow df cstateEdited by Simon Hafner
Please register or sign in to reply