Do labels constrain knowledge?