The interplay between long-range structural distortions and orbital order, and local short-range phenomena such as polarons, are key for understanding the properties of the manganites. In this work, we examine the role of local and long-range physics in relation to orbital ordering in the single-layered manganite ~ with a combination of optical reflection anisotropy and ultrafast broadband pump-probe spectroscopy. We find that the reflection anisotropy, measured in equilibrium, is strongly sensitive to charge and orbital-ordering transition only. However, the ultrafast response, measuring the non-equilibrium state, is sensitive to a range of phenomena in the material, including delocalized (long wavelength) phonons as well as localized polarons. In particular, we find that a strong sensitivity to electronic and structural changes give rise to apparent nonlinearities when probed at specific wavelengths, despite the key degrees of freedom remaining linear. These observations point to the important role of orbital–lattice couplings and polarons dressing the electronic states across the Pr${}_{0.5}$Ca${}_{1.5}$MnO${}_4$ phase diagram.