Communicating well is a key component of outgrowing someone, explain that there's simply just a difference of compatibility between you two and give explanation that you're going to make a change. Set boundaries around what you're doing instead of just cutting the relationship off, that way, you kind of drift apart gracefully without any negative feelings.