I don't see why anyone would be pissed off at him. He was fired from TCU. The Current Management showed him the door, then shoved him out of it, and off he went. While he still has love for the institution, I seriously doubt he has any love for the folks running it.
Baylor has a lot of problems. They evidently figured that having someone who was a longtime fixture elsewhere would allow them some sage advice, and they'll probably get it. After all, Patterson didn't do anything awful to Baylor other than call them out for all the crap Warden Art was pulling. They got the unvarnished truth then, too. They just chose not to act on it until it was too late. In effect, they're putting Cassandra on the payroll. Smart move on their part.