If there is any ongoing CTL operation, avoid closing the device. We
want to make sure all are responses sent from the device are read
before we close the link.