Fickian yet non-Gaussian diffusion (FnGD), a most intriguing open issue in soft matter, is generically associated with some dynamical and/or structural heterogeneity of the environment. Here we investigate the features of FnGD in glass-forming liquids, the epitome of dynamical heterogeneity, drawing on experiments on hard-sphere colloidal suspensions and simulations of a simple model of molecular liquid. We demonstrate that FnGD strengthens on approaching the glass transition, by identifying distinct timescales for Fickianity, , and for restoring of Gaussianity, , as well as their associated length scales, and . We find with for both systems. In the deep FnGD regime, the displacement distributions display exponential tails. We show that, in simulations, the time-dependent decay lengths at different temperatures all collapse onto a power-law master curve , with . A similar collapse, if less sharp, is also found in experiments, seemingly with the same exponent . We further discuss the connections of the timescales and length scales characterizing FnGD with structural relaxation and dynamic heterogeneity.