Enable Xorg with Amlogic/meson display

We have an ARM board AML-S905X-CC (Le Potato) equipped with Mali-450 GPU. Here are the related configs:

$ cat /etc/X11/xorg.conf.d/01-armbian-defaults.conf 
Section "Monitor"
	Identifier		"Monitor0"
	Option			"DPMS" "false"
EndSection
Section "ServerFlags"
	Option			"BlankTime" "0"
	Option			"StandbyTime" "0"
	Option			"SuspendTime" "0"
	Option			"OffTime" "0"
EndSection

$ cat /etc/X11/xorg.conf.d/02-driver.conf
Section "ServerFlags"
        Option  "AutoAddGPU" "off"
EndSection

Section "OutputClass"
        Identifier "Device_lima"
        Driver "modesetting"
        Option "PrimaryGPU" "true"
EndSection

According to the log:

• /dev/dri/card1 is PrimaryGPU.
• Have the display's EDID and resolution list

[   434.110] (**) OutputClass "Device_lima" setting /dev/dri/card1 as PrimaryGPU
...
[   434.878] (II) modeset(0): Printing probed modes for output HDMI-1
[   434.879] (II) modeset(0): Modeline "1920x1080"x60.0  148.50  1920 2008 2052 2200  1080 1084 1089 1125 +hsync +vsync (67.5 kHz eP)
[   434.879] (II) modeset(0): Modeline "1920x1080"x50.0  148.50  1920 2448 2492 2640  1080 1084 1089 1125 +hsync +vsync (56.2 kHz e)
[   434.879] (II) modeset(0): Modeline "1920x1080"x59.9  148.35  1920 2008 2052 2200  1080 1084 1089 1125 +hsync +vsync (67.4 kHz e)
...
[   434.882] (II) modeset(0): Output Composite-1 connected
[   434.882] (II) modeset(0): Output HDMI-1 connected
...
[   434.883] (II) LoadModule: "fb"
[   434.884] (II) Loading /usr/lib/xorg/modules/libfb.so
[   434.885] (II) Module fb: vendor="X.Org Foundation"
[   434.885]    compiled for 1.20.8, module version = 1.0.0
[   434.885]    ABI class: X.Org ANSI C Emulation, version 0.4
[   434.886] (EE) modeset(0): drmSetMaster failed: Invalid argument
[   434.886] (EE) 
Fatal server error:
[   434.886] (EE) AddScreen/ScreenInit failed for driver 0

Xorg.0.log But But get error drmSetMaster failed: Invalid argument