I have the feeling (might be imagination, though) that graphic settings play a role in this. Try to lower them and see if the buttons are more responsive.

For example: My game runs much smoother with Direct 11 enabled (likely also cause some of the graphic effects don't work there). In this mode buttons are much more responsive than in Direct 9 mode.