Inhomogeneity in the ground state is an intriguing, emergent phenomenon in magnetism. Recently, it has been observed in the magnetostructural channel of the geometrically frustrated α-NaMnO2, for the first time in the absence of active charge degrees of freedom. Here we report an in-depth numerical and local-probe experimental study of the isostructural sister compound CuMnO2 that emphasizes and provides an explanation for the crucial differences between the two systems.