igt@gem_ctx_persistence@ subtests - abort - *ERROR* render: timed out waiting for forcewake ack request.
<6> [364.363404] i915 0000:03:00.0: [drm] GPU HANG: ecode 12:0:00000000
<5> [364.363683] i915 0000:03:00.0: [drm] GT0: Resetting chip for no heartbeat on rcs0
<6> [364.364115] i915 0000:03:00.0: [drm] GT0: GuC firmware i915/dg1_guc_70.bin version 70.5.1
<6> [364.364119] i915 0000:03:00.0: [drm] GT0: HuC firmware i915/dg1_huc.bin version 7.9.3
<7> [364.368607] i915 0000:03:00.0: [drm:intel_guc_fw_upload [i915]] GT0: GUC: init took 1ms, freq = 1100MHz, before = 1100MHz, status = 0x8002F0EC, count = 0, ret = 0
<7> [364.369136] i915 0000:03:00.0: [drm:guc_enable_communication [i915]] GT0: GUC: communication enabled
<6> [364.370622] i915 0000:03:00.0: [drm] GT0: HuC: authenticated for all workloads
<6> [364.371357] i915 0000:03:00.0: [drm] GT0: GUC: submission enabled
<6> [364.371361] i915 0000:03:00.0: [drm] GT0: GUC: SLPC enabled
<7> [364.945634] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [364.995873] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [364.996053] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [365.015912] i915 0000:03:00.0: [drm:i915_drop_caches_set [i915]] Dropping caches: 0x000001dc [0x000001dc]
<3> [365.384540] i915 0000:03:00.0: [drm] *ERROR* GT0: GUC: Engine reset failed on 2:0 (vecs0) because 0x00000000
<7> [365.566627] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [365.616787] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [365.616959] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [366.168450] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [366.218545] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [366.218574] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [366.769425] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [366.819509] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [366.819538] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [367.370883] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [367.421068] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [367.421236] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [367.421463] heartbeat vecs0 heartbeat {seqno:f37:112, prio:2147483646} not ticking
<7> [367.421468] heartbeat Awake? 6
<7> [367.421470] heartbeat Barriers?: no
<7> [367.421472] heartbeat Latency: 0us
<7> [367.972071] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [368.022174] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [368.022205] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [368.022378] heartbeat vcs1 heartbeat {seqno:f36:112, prio:2147483646} not ticking
<7> [368.022382] heartbeat Awake? 5
<7> [368.022384] heartbeat Barriers?: no
<7> [368.022386] heartbeat Latency: 0us
<7> [368.572993] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [368.623077] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [368.623106] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [368.623275] heartbeat Runtime: 4872ms
<7> [368.623278] heartbeat Forcewake: 0 domains, 0 active
<7> [368.623280] heartbeat Heartbeat: 4240 ms ago
<7> [368.623287] heartbeat Reset count: 0 (global 3)
<7> [368.623289] heartbeat Properties:
<7> [368.623291] heartbeat heartbeat_interval_ms: 2500 [default 2500]
<7> [368.623294] heartbeat max_busywait_duration_ns: 8000 [default 8000]
<7> [368.623296] heartbeat preempt_timeout_ms: 640 [default 640]
<7> [368.623298] heartbeat stop_timeout_ms: 100 [default 100]
<7> [368.623300] heartbeat timeslice_duration_ms: 1 [default 1]
<7> [368.623307] heartbeat Requests:
<7> [368.623310] heartbeat hungE 1550:2* prio=0 @ 4240ms: gem_ctx_persist<1330>
<7> [368.623313] heartbeat ring->start: 0xfed13000
<7> [368.623316] heartbeat ring->head: 0x00000000
<7> [368.623318] heartbeat ring->tail: 0x00000090
<7> [368.623320] heartbeat ring->emit: 0x00000098
<7> [368.623322] heartbeat ring->space: 0x00003f28
<7> [368.623324] heartbeat ring->hwsp: 0xfed12000
<7> [368.623326] heartbeat [head 0000, postfix 0068, tail 0090, batch 0x00000000_00040000]:
<7> [368.623362] heartbeat [0000] 02800101 13244002 000000d0 00000000 00000000 11020001 00004238 00000001
<7> [368.623365] heartbeat [0020] 0e01c003 00000000 00004238 00000000 00000000 02800100 10400002 fed12000
<7> [368.623369] heartbeat [0040] 00000000 00000001 00000000 02800000 04000001 18800101 00040000 00000000
<7> [368.623371] heartbeat [0060] 04000000 00000000 13000002 00000000 00000000 00000000 13004002 fed12004
<7> [368.623374] heartbeat [0080] 00000000 00000002 01000000 04000001
<7> [368.623381] heartbeat Logical Ring Context:
<7> [368.623389] heartbeat [0000] 00000000 11081019 001c8244 00090008 001c8034 00000000 001c8030 00000090
<7> [368.623398] heartbeat [0020] 001c8038 fed13000 001c803c 00003001 001c8168 00000000 001c8140 00000000
<7> [368.623407] heartbeat [0040] 001c8110 00000000 001c81c0 fed11005 001c81c4 fed10002 001c81c8 00000340
<7> [368.623416] heartbeat [0060] 001c8180 00000000 001c82b4 00000000 00000000 00000000 00000000 00000000
<7> [368.623425] heartbeat [0080] 00000000 11081011 001c83a8 00000000 001c828c 00000000 001c8288 00000000
<7> [368.623435] heartbeat [00a0] 001c8284 00000000 001c8280 00000000 001c827c 00000000 001c8278 00000000
<7> [368.623444] heartbeat [00c0] 001c8274 00000000 001c8270 fb632000 00000000 00000000 00000000 00000000
<7> [368.623453] heartbeat [00e0] 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<7> [368.623460] heartbeat *
<7> [368.623475] heartbeat [0140] 00000000 11081063 001c8588 00000000 001c8588 00000000 001c8588 00000000
<7> [368.623484] heartbeat [0160] 001c8588 00000000 001c8588 00000000 001c8588 00000000 001c8028 ffff0000
<7> [368.623493] heartbeat [0180] 001c809c ffff0000 001c80c0 ffff0000 001c8178 00000001 001c817c 00145855
<7> [368.623503] heartbeat [01a0] 001c8358 7853ff72 001c8170 00000000 001c8150 00000000 001c8154 00000000
<7> [368.623512] heartbeat [01c0] 001c8158 00000000 001c841c 00000000 001c8600 00000000 001c8604 00000000
<7> [368.623524] heartbeat [01e0] 001c8608 00000000 001c860c 00000000 001c8610 00000000 001c8614 00000000
<7> [368.623533] heartbeat [0200] 001c8618 00000000 001c861c 00000000 001c8620 00000000 001c8624 00000000
<7> [368.623542] heartbeat [0220] 001c8628 00000000 001c862c 00000000 001c8630 00000000 001c8634 00000000
<7> [368.623552] heartbeat [0240] 001c8638 00000000 001c863c 00000000 001c8640 00000000 001c8644 00000000
<7> [368.623561] heartbeat [0260] 001c8648 00000000 001c864c 00000000 001c8650 00000000 001c8654 00000000
<7> [368.623570] heartbeat [0280] 001c8658 00000000 001c865c 00000000 001c8660 00000000 001c8664 00000000
<7> [368.623579] heartbeat [02a0] 001c8668 00000000 001c866c 00000000 001c8670 00000000 001c8674 00000000
<7> [368.623530] intel_gt_set_wedged called from i915_drop_caches_set+0x1ab/0x2c0 [i915]
<7> [368.623588] heartbeat [02c0] 001c8678 00000000 001c867c 00000000 001c8068 04000001 00000000 00000000
<7> [368.623597] heartbeat [02e0] 00000000 1102100f 00004460 00000000 00004464 00000000 00004468 00000000
<7> [368.623606] heartbeat [0300] 0000446c 00000000 00004470 00000000 00004474 00000000 00004230 00000000
<7> [368.623615] heartbeat [0320] 00004234 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<7> [368.623624] heartbeat [0340] 05000001 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<7> [368.623635] heartbeat [0360] 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<7> [368.623642] heartbeat *
<7> [369.174809] i915 0000:03:00.0: [drm:fw_domain_wait_ack_with_fallback [i915]] render had to use fallback to set ack, 0x0 (passes 11)
<3> [369.224981] i915 0000:03:00.0: [drm] *ERROR* render: timed out waiting for forcewake ack request.
<5> [369.225149] i915 0000:03:00.0: [drm:add_taint_for_CI [i915]] CI tainted:0x9 by fw_domains_get_with_fallback+0x2b8/0x320 [i915]
<7> [369.225614] heartbeat active in queueE f37:112* prio=2147483646 @ 4842ms: [i915]