And you have been syncing with the Windows Calendar not Outlook right or any other calendar?
No you shouldn't have to remove your battery everytime. Typically a battery pull forces the BlackBerry to re-scan the Media Card which is faster then letting the BlackBerry do it on it's on (which might be required when adding alot of files to the Media Card, I rarely have that problem anymore though, might be due to 4.5
).