The path optimization method is applied to the Stephanov model and the chiral random matrix model, both of which share several properties with QCD, to mitigate the sign problem caused by the fermion determinant. The Stephanov model serves as a prototypical model of finite-density QCD, while the chiral random matrix model represents an ideal system featuring the Silver Blaze phenomenon. We show that the path optimization successfully improves the average phase factor in the Stephanov model at high chemical potential, reproducing the analytical results with reduced statistical errors. However, it fails to improve the average phase factor in the Stephanov model at low chemical potential, as well as in the chiral random matrix model. This tendency in the phase factor behavior seems to be closely related to the global sign problem.