One of those little normally closed thermostats that are used in all kinds of appliances would work well if it was put in series with the field supply (ignition on input) to the alternator. The problem is it may be difficult to find a mounting spot and those thermostats aren’t water proof. The rectifier may be one of the first things to go in an over loaded alternator.