When I added the window-buttons plugin for the first item all the existing windows appeared in it. But then I removed it and added it again, and since then (even if I removed/readd again) only newly created windows will appear.
Yes, that is because all the wnck data is shared between the plugins. Should be fixed now.