As my grandfather went downhill in his later years my father just finally had to take the keys away from him. After that the car had to be physically removed from the premises (he was a clever and crafty guy, my grandfather was. Unfortunately better at hiding keys than driving safely).
This is not an easy thing to do. But sometimes it has to be done.