Do not override user-defined CMAKE_C[XX]_FLAGS for clang
337585e3 unconditionnaly overrides any potential user-defined CMAKE_C[XX]_FLAGS. This for example breaks the GDAL oss-fuzz builds which build Poppler from source (see https://github.com/OSGeo/gdal/blob/master/gdal/fuzzers/build.sh#L54)