The precise characterization of dynamics in open quantum systems often presents significant challenges, leading to the introduction of various approximations to simplify a model. One commonly used strategy involves Markovian approximations, assuming a memoryless environment. In this study, such approximations are not used and an analytical dynamical depiction of an open quantum system is provided. The system under consideration is an oscillator that is surrounded by a bath of oscillators. The resulting dynamics are characterized by an integrodifferential equation, which can be solved numerically. Remarkably, an exactly analytical solution exists when its reservoir spectral density is Lorentzian. Furthermore, this analytical solvability remains when rectangular pulse control is applied to the system, though with different parameters due to the pulses. Moreover, distinct dynamical regions emerge, depending on certain parameter values. Notably, the steady-state average excitation number (AEN) of the system shows rapid escalation with increasing non-Markovianity, reflecting the intricacies of real-world dynamics. In cases where there is detuning between the system frequency and the environmental central frequency within a non-Markovian regime, the AEN maintains its initial value for an extended period. Interestingly, the exact analytical solution with pulse control inherently protects the quantum system from decoherence effects without using approximations, while this protection fades as the system approaches the Markovian regime. The pulse control can not only prolong the relaxation time of the oscillator, but can also be used to speed up the relaxation process, depending on the specifications of the pulse.