I just now experienced something that might not happen that often, but it does happen and if it does, it's very hard to solve. I moved and modified items, notably the task list, and particularly the "handle" option. So I ended up with no way to ever modify or remove the task list ever again. One could argue it is a usability bug in the plugin. But there are other circumstances where it happens that the user is unable or having trouble to open a context menu for a particular item. Another example is items overlapping, because an item grows so large that it overlaps other items. So I suggest, what about a list of items in the Configure panel dialog, or perhaps a different dialog, that allows for choosing any item and opening its configuration, removing it, if possible even moving it. For what I want, being able to remove an item, so that I can add it again afterwards, should be good enough, anything more would be nice, but not essential.
Devel branch has been merged in master. A 4.7.0 release will follow soon. If you think this bug is not fixed? Feel free to reopen the bug.