Don't know if this is a feature or a bug :) When you enable icons in the desktop settings for xfdesktop, you'll get the new menu, which starts with 'Open in New Window'. When I disabled the desktop icons I get a different menu, namely the normal xfce4-menu which I can also access from the panel.
Why would you get a file context menu when file icons are disabled?