Nigel Havers "hates" having to have a phone and managed to "survive" perfectly well without one when he was growing up.