On Fedora 25, XFCE, Orage will continuously generate pop-up alarm messages for a single alarm event. Attempting to close each one is fruitless as more can be generated than can be manually closed.
The orage project is not maintained anymore and has been archived. Closing bugs.