Is there a point where it is unsafe to remove a retrievable IVC filter?

e.g. after a certain amount of time has passed, certain imaging findings that influence the surgeon or radiologist not to do the procedure, certain comorbidities, etc?