Interpreting the continuum parabolic Anderson model on a bounded domain, a naïve attempt leads to a solution theory in which all Robin (including homogeneous Dirichlet or Neumann) solutions coincide. The resolution of this is a boundary renormalisation, which we also discuss in the context of other singular equations such as the KPZ or stochastic quantisation equations. Joint work with Martin Hairer.