Don't set pattern_offset by the current point. Perhaps we can eliminate pattern_offset altogether now?