It seems that button layout "Arrow" doesn't work, whereas the default "Icon" works as expected.
Fixed by https://git.xfce.org/xfce/xfce4-panel/commit/?id=ecf9bec4fa082e20b79ce037c5df7f7935e4396b