Conditional t-SNE (ct-SNE) is a recent extension to that allows removal of known cluster information from the embedding, obtain visualization revealing structure beyond label information. This useful, for example, when one wants factor out unwanted differences between set classes. We show ct-SNE fails in many realistic settings, namely if data well clustered over labels original high-dimensiona...