Ex-Barclays chairman feared execs would resign during financial crisis: ‘This wasn’t what I signed up for, how do I get out of here?’