The trigger to use a key can only become active by clicking on something else, unless I’m missing something (it defeats the purpose of a keyboard only design).

Example Below:

By clicking or tabbing Next from this slide to the next, it will act as a click on that slide allowing the key only feature to work. So, be sure to have a slide ahead of the activity.