Parallel (P) and antiparallel (AP) configurations are widely applied in magnetic heterostructures and have significant impacts on the spin-wave transmission in magnonic devices. In the present study, a theoretical investigation was conducted into the transmission of exchange-dominated spin waves with nanoscale wavelengths in a type of heterostructure including two magnetic media, of which the magnetization state can be set to the P (AP) configuration by ferromagnetic (antiferromagnetic) interfacial exchange coupling (IEC). The boundary conditions in P and AP cases were derived, by which the transmission and reflection coefficients of spin waves were analytically given and numerically calculated. In the P configuration, a critical angle always exists and has a significant influence on the transmission. Spin waves are refracted and reflected when the incident angle is smaller than the critical angle (), while total reflection occurs as . In the AP configuration, the spin-wave polarizations of mediums 1 and 2 are inverse, that is, right handed (RH) and left handed (LH), leading to the total reflection being independent of . As demonstrated by the difference in spin-wave transmission properties between the P () and AP cases, there is a polarization-dependent scattering. However, as exceeds , the P () case exhibits similarities with the AP case, where the transmitted waves are found to be evanescent in medium 2 and their decay lengths are investigated. In both the P () and AP cases, the Goos-Hänchen (GH) shift of the total reflection waves are calculated and shown as a function of the frequency and incident angle. The relationship between the decay lengths and GH shifts is also explored. Furthermore, as the number of media exceeds two, spin waves are scattered by multiple interfaces, resulting in the resonant transmission effect in the P () case. At the same time, there is a tunneling effect and a resonant tunneling effect in the P () and AP cases, which are attributed to the evanescent waves. The influences of the IEC strength on all of the aforementioned findings are investigated in detail. The present study provides a comprehensive guide for the transmission of spin waves in the magnetic systems with either P or AP configuration and is helpful for the design of future magnonic devices.