Instead quit the main loop and properly cleanup behind ourselves
This stops us from not flushing "Fatal ..." messages to the log and is
a lot cleaner then just putting an fflush call before all exit() calls.