Using latest git version, the icon right after start displays the volume as muted (though it is not), until the first mouseover when the correct volume is displayed.

Steps to reproduce:
0) put pulseaudio plugin volume on panel
1) start xfce (with startxfce4 in my case)
2) the icon displays the volume as muted