Xfdesktop can't remember backgrounds i had to the list. I also can't remove backgrounds
Xfdesktop-settings has been changed in 4.11 to show all the backgrounds in the selected folder. Therefore there won't be any issues with background lists, you can just add or remove backgrounds (or symlinks to the backgrounds) from the folder. Closing bug report since it won't be an issue anymore.