Well, This is what happened with BlackBerryforums this past week:
The server was leased from a datacenter, the planet, and all was well, there was a smooth transistion onto the new server, with no downtime. The server had been run a few days to see if was stable, and again, all was good.
I monitored the server further for two days, and sometime on early in the week, the server crashed, and wouldnt go back online, I had no access to it, I requested a physcial reboot, so it was done, 5 minutes later the server crashes once more.
This kept happening for a solid 3 days, and I kept requesting the issue to be repaired.
The data center first said it was a router, then told me it was the operating system, I suspected neither.. but I went with the datacenter, as it was my only choice.
The server was brought online in safe mode, and I managed to backup blackberryforums and all onto the backup drive of the server (since only the operating system drive was being rebuilt) All was succesful, except I wasnt able to download a copy of the database. I continued with the OS reload, and specified to the datacenter not to touch the backup drive, they complied.
A few hours later I get a email stating the server is back online, and it needs to be setup to get it running, but thusfar all is smooth.
A few hours pass as I set up the server and optimize everything, I go to rebuild the database from a backup, and low and behold! I find the backup drive unmounted.. Meaning it was completely wiped.
I reverted to the only backup I had of the board, unfortunately it was a few months old :(
Thats the story.