We construct and discuss nucleon-nucleus optical potentials at low energies for ${}^{3,4,6}$He targets. In this work, we use the SA-NCSM/GF approach that combines the symmetry-adapted no-core shell model with the Green’s function technique to construct optical potentials, and extend this formulation to proton scattering and targets with nonzero spin. We show that these optical potentials reproduce experimental differential cross sections and phase shifts for proton and neutron elastic scattering remarkably well. The SA-NCSM/GF approach provides nonlocal, energy dependent and dispersive optical potentials, suitable for the astrophysically relevant regime of low energies and for exotic nuclei, where experiments are difficult and data is often unavailable.