video-converter: Set up matrix tables only once.
When configuring a multi-thread converter, only allocate the shared colour conversion matrices once for the first thread, to avoid allocating multiple times and leaking memory.
This is an extra fix on top of !1140 (merged)