Control your privacy settings.
When your account is private, only people you approve can see your photos and videos. Your existing followers won't be affected.