The country’s view of the EU referendum could prove very relevant at the next election. Labour should take heed.