[RX 5600M] IO_PAGE_FAULT leads to sdma0 timeout and system crash
Brief summary of the problem:
I try to open Civilization 6, and during the loading screen my system appears to freeze and then the screen goes blank, requiring a hard reset. Logs show many IO_PAGE_FAULT errors followed by an sdma0 timeout.
Hardware description:
- CPU: Ryzen 5 4600H
- GPU: RX 5600M
- System Memory: 8GB
- Display(s): integrated laptop
- Type of Display Connection: eDP
System information:
- Distro name and Version: Fedora 34
- Kernel version: 5.14.12 + PCI rebar patch from #1707, also with pci=noats boot option
How to reproduce the issue:
- Start Civilization 6
Relevant log messages:
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: amd_iommu_report_page_fault: 104 callbacks suppressed
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:48:56 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc06000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amd_iommu_report_page_fault: 1124793 callbacks suppressed
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: amd_iommu_report_page_fault: 1124783 callbacks suppressed
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:01 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amd_iommu_report_page_fault: 1126488 callbacks suppressed
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc07000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc08000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc05000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: amd_iommu_report_page_fault: 1126478 callbacks suppressed
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:06 apollo kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring sdma0 timeout, signaled seq=6047, emitted seq=6049
Oct 21 20:49:06 apollo kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process pid 0 thread pid 0
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: GPU reset begin!
Oct 21 20:49:06 apollo kernel: [drm] free PSP TMR buffer
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: MODE2 reset
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: GPU reset succeeded, trying to resume
Oct 21 20:49:06 apollo kernel: [drm] PCIE GART of 1024M enabled.
Oct 21 20:49:06 apollo kernel: [drm] PTB located at 0x000000F400900000
Oct 21 20:49:06 apollo kernel: [drm] VRAM is lost due to GPU reset!
Oct 21 20:49:06 apollo kernel: [drm] PSP is resuming...
Oct 21 20:49:06 apollo kernel: [drm] reserve 0x400000 from 0xf41f800000 for PSP TMR
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: RAS: optional ras ta ucode is not available
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: RAP: optional rap ta ucode is not available
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: SECUREDISPLAY: securedisplay ta ucode is not available
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: SMU is resuming...
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: SMU is resumed successfully!
Oct 21 20:49:06 apollo kernel: [drm] kiq ring mec 2 pipe 1 q 0
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: [drm:amdgpu_ring_test_helper [amdgpu]] *ERROR* ring sdma0 test failed (-110)
Oct 21 20:49:06 apollo kernel: [drm:amdgpu_device_ip_resume_phase2 [amdgpu]] *ERROR* resume of IP block <sdma_v4_0> failed -110
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: GPU reset(1) failed
Oct 21 20:49:06 apollo kernel: amdgpu 0000:07:00.0: amdgpu: GPU reset end with ret = -110
Oct 21 20:49:11 apollo kernel: amd_iommu_report_page_fault: 1053496 callbacks suppressed
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc05000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc08000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: amd_iommu_report_page_fault: 1053486 callbacks suppressed
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc06000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc05000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc07000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc08000 flags=0x0000]
Oct 21 20:49:11 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amd_iommu_report_page_fault: 1127672 callbacks suppressed
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: amd_iommu_report_page_fault: 1127662 callbacks suppressed
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc08000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc07000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc06000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc05000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:16 apollo kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring sdma0 timeout, signaled seq=6049, emitted seq=6049
Oct 21 20:49:16 apollo kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process pid 0 thread pid 0
Oct 21 20:49:16 apollo kernel: amdgpu 0000:07:00.0: amdgpu: GPU reset begin!
Oct 21 20:49:21 apollo kernel: amd_iommu_report_page_fault: 1126858 callbacks suppressed
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc08000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc05000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc06000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amdgpu 0000:07:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x0007 address=0xffffc02000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: amd_iommu_report_page_fault: 1126848 callbacks suppressed
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc07000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc04000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc01000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc00000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc08000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc03000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc06000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc07000 flags=0x0000]
Oct 21 20:49:21 apollo kernel: AMD-Vi: Event logged [IO_PAGE_FAULT device=07:00.0 domain=0x0007 address=0xffffc04000 flags=0x0000]