System Crashes Instantly under Specific OpenCL Load (BRP7 app) with RX 7900 GPU
Before submitting your bug report:
- Check if your bug has already been reported
not exactly. Closest is issue mesa #8227. But, my issue happens outside of games; doesn't seem related to GL at all. Maybe OpenCL, though.
Brief summary of the problem:
Video Card (7900 class) hangs, frequently, while running BOINC Einstein@Home.
Hardware description:
- CPU: AMD Ryzen 9 5900X 12-Core Processor
- GPU: PowerColor Red Devil RX 7900XTX
- System Memory: 64 GB
- Display(s): 1
- Type of Display Connection: DVI
System information:
- Distro name and Version: Fedora 38
- Kernel version: 6.3.5
- Custom kernel: n/a
- AMD official driver version: N/A (don't know how to version AMDGPU kernel module)
How to reproduce the issue:
- install BOINC & Einstein@Home project
- wait a few hours
I've been fighting this for two months. I've already had the card RMAed once. I'm truly desperate for help. System is completely unusable. 6800XT handles same load, same driver, no problems. Willing to do anything to help.
Attached files:
Screenshots/video files
N/A
Log files (for system lockups / game freezes / crashes)
First 150 lines from attached log file:
Jun 20 05:11:00 host kernel: [drm] Fence fallback timer expired on ring gfx_0.0.0
Jun 20 05:11:02 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:02 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:07 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:07 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:16 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:16 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:21 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:21 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:26 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:26 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:31 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:31 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:36 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:36 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:41 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:41 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:46 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:46 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:51 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:51 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:11:56 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:11:56 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:02 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:02 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:07 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:07 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:10 host kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx_0.0.0 timeout, signaled seq=1927441, emitted seq=1927442
Jun 20 05:12:10 host kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* Process information: process gnome-shell pid 43104 thread gnome-shel:cs0 pid 43128
Jun 20 05:12:10 host kernel: amdgpu 0000:0d:00.0: amdgpu: GPU reset begin!
Jun 20 05:12:10 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:10 host kernel: amdgpu: failed to remove hardware queue from MES, doorbell=0x1202
Jun 20 05:12:10 host kernel: amdgpu: MES might be in unrecoverable state, issue a GPU reset
Jun 20 05:12:10 host kernel: amdgpu: Failed to evict queue 2
Jun 20 05:12:10 host kernel: amdgpu: Failed to evict process queues
Jun 20 05:12:10 host kernel: amdgpu: Failed to suspend process 0x801e
Jun 20 05:12:10 host kernel: amdgpu: Failed to evict queue 3
Jun 20 05:12:10 host kernel: amdgpu: Failed to suspend process 0x801f
Jun 20 05:12:11 host kernel: amdgpu 0000:0d:00.0: amdgpu: IP block:gfx_v11_0 is hung!
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:12 host kernel: [drm:sdma_v6_0_ring_test_ib [amdgpu]] *ERROR* amdgpu: IB test timed out
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: IP block:sdma_v6_0 is hung!
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:32 vmid:0 pasid:0, for process pid 0 thread pid 0)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: in page starting at address 0x0000000000000000 from client 10
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00040A41
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: Faulty UTCL2 client ID: CPC (0x5)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MORE_FAULTS: 0x1
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: WALKER_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: PERMISSION_FAULTS: 0x4
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MAPPING_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: RW: 0x1
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:32 vmid:0 pasid:0, for process pid 0 thread pid 0)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: in page starting at address 0x0000000000000000 from client 10
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000000
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: Faulty UTCL2 client ID: CB/DB (0x0)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MORE_FAULTS: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: WALKER_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: PERMISSION_FAULTS: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MAPPING_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: RW: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:32 vmid:0 pasid:0, for process pid 0 thread pid 0)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: in page starting at address 0x0000000000000000 from client 10
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000000
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: Faulty UTCL2 client ID: CB/DB (0x0)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MORE_FAULTS: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: WALKER_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: PERMISSION_FAULTS: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MAPPING_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: RW: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: [gfxhub] page fault (src_id:0 ring:32 vmid:0 pasid:0, for process pid 0 thread pid 0)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: in page starting at address 0x0000000000000000 from client 10
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: GCVM_L2_PROTECTION_FAULT_STATUS:0x00000000
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: Faulty UTCL2 client ID: CB/DB (0x0)
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MORE_FAULTS: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: WALKER_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: PERMISSION_FAULTS: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: MAPPING_ERROR: 0x0
Jun 20 05:12:12 host kernel: amdgpu 0000:0d:00.0: amdgpu: RW: 0x0
Jun 20 05:12:13 host kernel: Failed to wait all pipes clean
Jun 20 05:12:13 host kernel: amdgpu 0000:0d:00.0: amdgpu: soft reset failed, will fallback to full reset!
Jun 20 05:12:17 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:17 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:22 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:22 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:27 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:27 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:32 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:32 host kernel: amdgpu 0000:0d:00.0: amdgpu: [SetDfCstate] failed!
Jun 20 05:12:32 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to disallow df cstate
Jun 20 05:12:32 host kernel: [drm:dc_dmub_srv_wait_idle [amdgpu]] *ERROR* Error waiting for DMUB idle: status=3
Jun 20 05:12:32 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:32 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:33 host kernel: [drm:mes_v11_0_submit_pkt_and_poll_completion.constprop.0 [amdgpu]] *ERROR* MES failed to response msg=3
Jun 20 05:12:33 host kernel: [drm:amdgpu_mes_unmap_legacy_queue [amdgpu]] *ERROR* failed to unmap legacy queue
Jun 20 05:12:34 host kernel: [drm:gfx_v11_0_hw_fini [amdgpu]] *ERROR* failed to halt cp gfx
Jun 20 05:12:37 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:37 host kernel: amdgpu 0000:0d:00.0: amdgpu: Failed to export SMU metrics table!
Jun 20 05:12:39 host kernel: [drm] psp gfx command DESTROY_TMR(0x7) failed and response status is (0x0)
Jun 20 05:12:39 host kernel: [drm:psp_suspend [amdgpu]] *ERROR* Failed to terminate tmr
Jun 20 05:12:39 host kernel: [drm:amdgpu_device_ip_suspend_phase2 [amdgpu]] *ERROR* suspend of IP block <psp> failed -22
Jun 20 05:12:39 host kernel: amdgpu 0000:0d:00.0: amdgpu: MODE1 reset
Jun 20 05:12:39 host kernel: amdgpu 0000:0d:00.0: amdgpu: GPU mode1 reset
Jun 20 05:12:39 host kernel: amdgpu 0000:0d:00.0: amdgpu: GPU smu mode1 reset
Jun 20 05:12:44 host kernel: amdgpu 0000:0d:00.0: amdgpu: SMU: I'm not done with your previous command: SMN_C2PMSG_66:0x00000012 SMN_C2PMSG_82:0x00000005
Jun 20 05:12:44 host kernel: amdgpu 0000:0d:00.0: amdgpu: GPU mode1 reset failed
Jun 20 05:12:44 host kernel: amdgpu 0000:0d:00.0: amdgpu: ASIC reset failed with error, -62 for drm dev, 0000:0d:00.0
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: amdgpu: GPU reset succeeded, trying to resume
Jun 20 05:12:48 host kernel: [drm] PCIE GART of 512M enabled (table at 0x0000008000300000).
Jun 20 05:12:48 host kernel: [drm] VRAM is lost due to GPU reset!
Jun 20 05:12:48 host kernel: [drm] PSP is resuming...
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: amdgpu 0000:0d:00.0: AMD-Vi: Event logged [IO_PAGE_FAULT domain=0x001e address=0x5dae1000 flags=0x0000]
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Jun 20 05:12:48 host kernel: AMD-Vi: IOMMU event log overflow
Edited by Porcelain Mouse