annots: Do not update AP and AS entries if they are not present when invaliding the appaearance stream