Sounds like it might be a faulty BB. Also depends on what you are doing other than calls.
What other things do you use while on battery power?
How much Internet activity is going on?
Does it fully recharge?
This might help, from our FAQ:
Maximum Battery Life - BlackBerryFAQ