just turn it off or uninstall it
remove port 3101 on firewall
call it a day unless you want to remove the service account too but most use the same one for BES 12
also
How to decommission a BlackBerry Enterprise Server or component and remove it from the BlackBerry Administration Service console