videoscale: Performance degradation from 1.16.2 -> 1.18.4

gst-launch-1.0 filesrc location=video-examples/person-bicycle-car-detection_1920_1080-2min.mp4 ! qtdemux ! avdec_h264 max-threads=1 ! videoscale n-threads=1 ! videoconvert n-threads=1 ! video/x-raw,format=BGRx,width=100,height=100 ! gvafpscounter ! fakesink async=false

Output with GStreamer 1.16.2: FPSCounter(average): total=251.41 fps, number-streams=1, per-stream=251.41 fps Execution ended after 0:00:10.338461396

Output with GStreamer 1.18.4: FPSCounter(average): total=238.40 fps, number-streams=1, per-stream=238.40 fps Execution ended after 0:00:10.899746688