In this paper we study the behavior of a family of implicit numerical methods applied to stochastic differential equations with multiple time scales. We show by a combination of analytical arguments and numerical examples that implicit methods in general fail to capture the effective dynamics at the slow time scale. This is due to the fact that such implicit methods cannot correctly capture non-Dirac invariant distributions when the time step size is much larger than the relaxation time of the system.