Existing forensic techniques for image manipulation localization crucially assume that probe pixels belong to one of exactly two classes, genuine or manipulated. This letter argues that this convention fuels mis-labeling particularly in unsupervised settings, where singular but genuine content or the presence of multiple distinct manipulations may easily induce non-optimal partitions of the feature space. We propose to relax constraints via a greedy