We study the continuity of space translations on non-parametric exponential families based on the exponential Orlicz space with Gaussian reference density.