yes, you will. You are not turning off the wifi connection for data in mobile network. You are only turning it off for voice/sms. Just try it.
Either that or you'll need to do some trouble shooting of the UMA problem. Could be a router problem, router setting problem, ISP problem.
Go to
Main Page - BlackBerryFAQ.com and read up on the wifi info there.