Primordial magnetic fields (PMFs), potentially generated during cosmic inflation or early-universe phase transitions, can modify cosmic structure formation by enhancing the post-recombination matter power spectrum. In this work, we investigate the impact of PMFs on galaxy formation using a suite of high-resolution cosmological hydrodynamical simulations evolved to $z=0$. Our simulations are initialized with PMF-induced enhancements to the matter power spectrum and include more comprehensive baryonic subgrid models than previous work, incorporating both stellar and AGN feedback. We find that PMFs systematically accelerate early structure formation, producing more abundant halos and galaxies, higher baryon fractions, enhanced star formation rates, and rapid growth of supermassive black holes at high redshifts ($z\sim 10$). However, the resulting enhanced stellar and AGN feedback efficiently processes and expels gas, reducing the late-time differences between PMF and standard $\Lambda$CDM models. The PMF signatures are therefore strongest at high redshift and gradually weaken toward low redshift as nonlinear evolution and baryonic feedback dominate over the initial PMF-induced enhancements. The impact of PMFs depends strongly on the characteristic peak scale, $k_{\rm peak}$, of the initial power enhancement, with models yielding similar non-linear evolution if they share a similar $k_{\rm peak}$, even when other PMF parameters differ. Our results highlight the critical role of comprehensive baryonic physics in accurately quantifying PMF signatures.