Some typical scenarios can cause KeyUp only on regular keys, which can be annoying (e.g pressing Esc to exit a configuration dialog ends up toggling pause)