Virgin Money CEO Jayne-Anne Gadhia says customers find it hard to switch banks because they are "worried" about consequences.