Former White House press secretary says he is answering a “higher loyalty” than his affection for Bush.