My sound-multimedia-key on my keyboard only mutes and unmutes xfce4-mixer but not pulseaudio-mixer. Sound keeps being turned off until Pulseaudio-mixer is unmuted by mouse.
xfce4-mixer versions before 4.9.0 did not handle keyboard shortcuts so this cannot be a bug in xfce4-mixer, maybe you have another application/mixer running which handles them.