What happens when you stop taking probiotics? You will probably notice more gradual changes in your gut health, if anything, once you discontinue probiotics.