I prefer to have the window close/minimize/maximize controls on the left, and have placed them there with Customize Look and Feel.
However, catfish places its own window controls on the right (with a different Theme, as well).
I checked the Preferences, in case (as with Chromium) there were an option to "Use System Title Bar and Borders", but found none.
[This seems to be the same bug as with eog (Gnome Image Viewer),
and I have filed a bug report for that as well (Bug #1511616)
In case it is useful, I here quote a comment for that bug, that states:
"That has to do with the use of CSD/GtkHeaderBar that doesn't work great out of gnome-shell"
On that bug report page, it states that it apparently is an "upstream bug" and I ought to report it upstream as well.
If that is so here as well (as seems likely), tell me, and I will do the same for catfish as I will do for eog.]
Sean Davis referenced this bugreport in commit 75dce159cb602d9d2c6f23d937a2e10e8080e613
Add DE detection for headerbar usage: use headerbar for Budgie, GNOME, and Pantheon; titlebar for all others (bug #14486)
This issue should be resolved with the above commit. LXDE will now use the titlebar layout by default.