Colleges Only Care About Diversity When It’s Convenient