Peter Higgs' conjecture of a radically different fundamental particle lead to a fifty year search which in 2012 resulted in the discovery of a new particle - one which has so far matched precisely the predictions from 1964. What have we learnt about the properties of this new particle and why are particle physicists agreed that detailed studies are the highest priority for the next decades? What does it teach us about the role of mathematics in the Universe?