When do you decide to stop prescribing controlled substances in patients who are also using cannabis?

The only controlled substance I prescribe is stimulants. If patients are using cannabis more than at bedtime or recreationally on the weekends, I will wean them off stimulants, as their effects will be limited by the significant cannabis use. I will do the same with alcohol.