It's about knowing when to jump, as delightful eccentric Lord Longford found