What you need to do is transfer this manager's direct reports to another manager.
In order to do that, navigate to the manager's direct reports profiles > Actions > Change work details > Change Reports to
If you go on the manager's profile (that is not a manager anymore), and look in the Work category, it should say "Is a manager: No"
This should also automatically remove the employee from the default "Managers" group.