Using a linear stability analysis and two and three-dimensional nonlinear simulations, we study the physics of buoyancy instabilities in a combined thermal and relativistic (cosmic ray) plasma, motivated by the application to clusters of galaxies. We argue that cosmic ray diffusion is likely to be slow compared to the buoyancy time on large length scales, so that cosmic rays are effectively adi...