You can select multiple items with the mouse by dragging a rubber band around those items. Usually all icons become de-selected when you start dragging the rubber band. But you can prevent this by holding the ctrl button. Therefore it is possible to combine multiple select operations. However if you shrink the rubber band by moving the mouse cursor closer to the origin of the rubber band, even only a single pixel, all items outside of the rubber band become de-selected. This behavior is unwanted.
Created attachment 5113 Fix for CTRL + drag selections Good catch. This patch checks that the icon was apart of the rubber band area when the area changed and is not apart of it now. Should fix the issue.
Pushed to master: http://git.xfce.org/xfce/xfdesktop/commit/?id=bb9350184566231b0fbf1c03ff54d26d44dc7d8c
Fix is in master, closing.