This follows the idea in this comment:
/* XXX
 * This test should probably go away.  Have the caller set/clear the
 * IMAGE_CLAMP_BIT as needed.
 */

We set IMAGE_CLAMP_BIT in the caller based on _ClampReadColor, where
the operation mandates it.

TODO: did I get the set of operations mandating it right?