Two options: One, bind the activate-bookmarks command to a key. Hint: In 12.0, it will be bound to Ctrl+Shift+N by default. When the toolbar is activatated, your focus will move to the toolbar, cursor up/down to select the item you want and hit Enter.
The second option is to bind the old goto-bookmark command to a key.