I'm nearly 70, I've had one ablation for paroxysmal atrial fibrillation, and I've taken Warfarin for ten years with good INR control and no problems from the Warfarin as far as I know. If I was told to stop taking it, I would be anxious about the lack of protection against stroke.
But I am starting to get unsteady which has been diagnosed as due to a damaged vestibular nerve. I have not had any significant falls, but I have to be careful. I suspect I will have a bad fall one day, it might not be until I am 80, but if I am still on Warfarin at the time, a head injury would likely have worse consequences.
I accept that we should take an anticoagulant if we have AF but I don't fully understand the benefit and risk of doing so as we move in to old age. I don't know how strong the evidence is.
I think the only doctors able to give good advice on this are geriatricians. Most hospital consultants know little of medicine beyond their own specialty leaving GPs as the only generalists. And they can't be expected to make complex decisions in the little time available if they don't know the patient well.