Toyotas are well known for wearing out their starter solenoid contacts, resulting in these symptoms. Google ‘Toyota starter solenoid’, you can read more. If this is the problem, the cheapest solution is to pull the starter and replace the contacts, both the 2 side ones and the round center disc (the Toyota dealer should have them). Or you can replace the whole starter.