It's tricky to merge XFB-outputs correctly, because we need there to not
be any overlaps when we get to
on. We currently trigger an assert there if we end up merging here.
So let's not even try. This is an optimization, and we can optimize this in safe cases later if needed. For now, let's play it safe.