4 million people didn’t suddenly become supporters of a racist Thatcherite party.