Then I found in this support forum that you can switch off in Admin Tools the Joomla! Feature Hardening Options "Monitor Super User accounts".
This silenced the email flood. So I wanted to go and create a new super user in administration and I got the 403 error again.
I then created a simple registered user and that works.
So is there anything else that I am missing?
Thank you