Characteristics of Josephson junctions with to 3 are reported. Here, S is a superconductor (Nb), F is a magnetic material (nickel), N is a nonmagnetic metal (aluminum), and I is an insulator . The devices with and display critical current versus magnetic field dependences that imply the appearance of fractional magnetic vortices in the junction, corresponding to a half of the flux quantum. Stochastic switching between the two half-vortex polarities with emission of an integer vortex was observed. In the devices with , a typical dependence consists of a background current with a large modulation period, and a Fraunhofer-like pattern with a small modulation period on top of the background current. The Fraunhofer-like pattern may be completely or partially inverted; in these states, there is a component of the Josephson current flowing against the bias current, indicating the presence of the phase in the junction. The experiments give evidence that switching between the zero and states can, potentially, be magnetically controlled.