Comments on: My search for data storage http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/ seize the dome Sun, 20 Jul 2008 03:32:10 +0000 http://wordpress.org/?v=MU By: mjsouth http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-34 mjsouth Mon, 25 Feb 2008 00:40:51 +0000 http://mike.texasdomes.com/?p=14#comment-34 Like I said, I haven't gone into a lot of detail about my plans for many reasons. But I will tell you that you are wrong about Time Machine. Time machine isn't limited to internal or external drives, it can also backup to network shares (as long as both computers are running Leopard). My plan is to have our server use Time Machine to do an incremental, fully restorable backup, to a computer that is on our network but out of our office. Backing up to an off site location, like you said, is pretty much the only protection from fire, theft, etc. In our office, we have 5 MacBooks, a MacBook Air, and a MacBook Pro. All of these laptops are using Time Machine, and are backing up to a Mac Mini with 2 500Gb drives hooked to it. We bought our lead draftsman a new MacBook Pro and it took it about 2 hours to restore about 30 Gb of data over our Gigabit network. When it was done, it was exactly like he had left it. Time Machine works. One more quick note: The reason I am so excited about Time Machine, is that if my server room burned to the ground, it would be simple to restore. Just buy a new server, turn it on, point it to the network shared Time Machine Backup, and let it do the work. If I were to restore it from a standard backup, I would be able to restore all the data, but the preferences, users, groups, shares, etc. would have to be restored by hand. Jeff, you have triggered a lot of questions in my mind about exactly how well the xServe would restore. I got a new xServe yesterday, and I am going to do some Time Machine tests and post them online. Then we can see if my theory is right or if I will run into some other problems. Thanks for the comment. Like I said, I haven’t gone into a lot of detail about my plans for many reasons. But I will tell you that you are wrong about Time Machine. Time machine isn’t limited to internal or external drives, it can also backup to network shares (as long as both computers are running Leopard). My plan is to have our server use Time Machine to do an incremental, fully restorable backup, to a computer that is on our network but out of our office. Backing up to an off site location, like you said, is pretty much the only protection from fire, theft, etc.

In our office, we have 5 MacBooks, a MacBook Air, and a MacBook Pro. All of these laptops are using Time Machine, and are backing up to a Mac Mini with 2 500Gb drives hooked to it. We bought our lead draftsman a new MacBook Pro and it took it about 2 hours to restore about 30 Gb of data over our Gigabit network. When it was done, it was exactly like he had left it. Time Machine works.

One more quick note: The reason I am so excited about Time Machine, is that if my server room burned to the ground, it would be simple to restore. Just buy a new server, turn it on, point it to the network shared Time Machine Backup, and let it do the work. If I were to restore it from a standard backup, I would be able to restore all the data, but the preferences, users, groups, shares, etc. would have to be restored by hand.

Jeff, you have triggered a lot of questions in my mind about exactly how well the xServe would restore. I got a new xServe yesterday, and I am going to do some Time Machine tests and post them online. Then we can see if my theory is right or if I will run into some other problems. Thanks for the comment.

]]> By: jeff http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-33 jeff Sun, 24 Feb 2008 23:15:40 +0000 http://mike.texasdomes.com/?p=14#comment-33 I know a tiny amount about Time Machine. It isn't a real backup solution. It is a 'oops I deleted some files I really didn't mean to' solution. A backup solution will copy your data <i>elsewhere</i>. If your machine fail, the backup is separate. If the hard drives fail, the backup is separate. You need something that holds the data, that you can pick up and move elsewhere. Personally, I store my backups in my fireproof safe. Think about what you would do to secure your data if someone <i>stole</i> your xServe. Think about the computers in the twin towers at 9/11. The companies that didn't have offsite backup, all went out of business. One solution, is to buy another xServe, and copy all the data from one to another, and store the second one in a safe location. Not the cheapest solution, but perhaps the simplest one. jeff I know a tiny amount about Time Machine. It isn’t a real backup solution. It is a ‘oops I deleted some files I really didn’t mean to’ solution. A backup solution will copy your data elsewhere. If your machine fail, the backup is separate. If the hard drives fail, the backup is separate. You need something that holds the data, that you can pick up and move elsewhere. Personally, I store my backups in my fireproof safe. Think about what you would do to secure your data if someone stole your xServe. Think about the computers in the twin towers at 9/11. The companies that didn’t have offsite backup, all went out of business.

One solution, is to buy another xServe, and copy all the data from one to another, and store the second one in a safe location. Not the cheapest solution, but perhaps the
simplest one.

jeff

]]> By: TerryG http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-28 TerryG Sun, 17 Feb 2008 16:23:13 +0000 http://mike.texasdomes.com/?p=14#comment-28 Hi Mike, I recently built a workstation and discovered that there are actually different classes/grades of hard drives, consumer and enterprise. Consumer drives are not intended to be run 24/7 while enterprise drives are specifically designed and engineered to be used 24/7. They are more tolerant of vibration and environmental temperatures. I'd guess that the xRaid server is equipped with the enterprise class hard drives. Good Luck! TerryG Hi Mike,

I recently built a workstation and discovered that there are actually different classes/grades of hard drives, consumer and enterprise. Consumer drives are not intended to be run 24/7 while enterprise drives are specifically designed and engineered to be used 24/7. They are more tolerant of vibration and environmental temperatures. I’d guess that the xRaid server is equipped with the enterprise class hard drives. Good Luck!

TerryG

]]> By: Rebecca http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-27 Rebecca Tue, 12 Feb 2008 20:12:14 +0000 http://mike.texasdomes.com/?p=14#comment-27 Nice blog, Mike! Nice blog, Mike!

]]> By: David http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-23 David Thu, 07 Feb 2008 18:10:37 +0000 http://mike.texasdomes.com/?p=14#comment-23 The XServe RAID is a good choice. We did a study of their performance for a government agency and were generally quite pleased. At the time they had performance approaching that of (much) more expensive devices. We opted not to use them but that had to do with the need for offsite block level realtime replication of data. I've personally used "personal NAS" devices that hold 4 drives whih put them in a RAID array attached to an Ethernet. Performance just isn't there. I've also built my own. Again, you can save money with a roll-it-yourself or another vendor but for OS X integration and performance the XServe RAID fits a sweet spot. Time machine and portable home directories really make an easy environment to administer. I still use both since PHDs give a very quick "oops, laptop is dead... walk over to the mac mini and get back to work instantly (well, save time for the system to automatically copy my home directory)" Time machine has already saved me once when I inadvertently deleted the wrong files, purged the trash, and didn't realize it for a few days. The XServe RAID is a good choice. We did a study of their performance for a government agency and were generally quite pleased. At the time they had performance approaching that of (much) more expensive devices. We opted not to use them but that had to do with the need for offsite block level realtime replication of data. I’ve personally used “personal NAS” devices that hold 4 drives whih put them in a RAID array attached to an Ethernet. Performance just isn’t there. I’ve also built my own. Again, you can save money with a roll-it-yourself or another vendor but for OS X integration and performance the XServe RAID fits a sweet spot.

Time machine and portable home directories really make an easy environment to administer. I still use both since PHDs give a very quick “oops, laptop is dead… walk over to the mac mini and get back to work instantly (well, save time for the system to automatically copy my home directory)” Time machine has already saved me once when I inadvertently deleted the wrong files, purged the trash, and didn’t realize it for a few days.

]]> By: mjsouth http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-22 mjsouth Wed, 06 Feb 2008 03:19:16 +0000 http://mike.texasdomes.com/?p=14#comment-22 No, this picture was taken very early, probably 20 min after inflation, and we hadn't put it up to 2 inches of pressure yet. The airform starts out like that so when it stretches it looks normal. I am going up there tomorrow and I will take some more pictures. No, this picture was taken very early, probably 20 min after inflation, and we hadn’t put it up to 2 inches of pressure yet. The airform starts out like that so when it stretches it looks normal. I am going up there tomorrow and I will take some more pictures.

]]> By: Mike Carr http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-21 Mike Carr Wed, 06 Feb 2008 01:23:07 +0000 http://mike.texasdomes.com/?p=14#comment-21 Mike, Greetings! I noticed the sharp point to the airform. Is this a new design? Mike Carr Mike,
Greetings! I noticed the sharp point to the airform. Is this a new design?

Mike Carr

]]> By: mjsouth http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-16 mjsouth Sun, 03 Feb 2008 23:23:39 +0000 http://mike.texasdomes.com/?p=14#comment-16 Well, I really haven't gone into a lot detail about exactly how I have set up my computer system for security reasons, but this is what I can tell you. We are going to start backing our server up with Leopards built in tool called Time Machine. Time Machine does an incremental backup once an hour for 24 hours, every day for a month, and once a week for as many weeks as the drive can hold. The only thing I wish Time Machine would do is allow me to change the every hour backup to be once a day, but again, its so easy to use that we are going to give it a shot. I have also been involved with setting up some of our own Linux servers, but when you build your own server, you own the server. My goal with this setup is to make a server that is so easy to manage, and that I can easily teach some of the people in my office to do the maintenance. If I can train others to manage the upkeep, then I can focus my energy into other aspects of the company. You have also confirmed what I was saying about off the shelf hard drives. Thanks for the comment. Well, I really haven’t gone into a lot detail about exactly how I have set up my computer system for security reasons, but this is what I can tell you.

We are going to start backing our server up with Leopards built in tool called Time Machine. Time Machine does an incremental backup once an hour for 24 hours, every day for a month, and once a week for as many weeks as the drive can hold. The only thing I wish Time Machine would do is allow me to change the every hour backup to be once a day, but again, its so easy to use that we are going to give it a shot.

I have also been involved with setting up some of our own Linux servers, but when you build your own server, you own the server. My goal with this setup is to make a server that is so easy to manage, and that I can easily teach some of the people in my office to do the maintenance. If I can train others to manage the upkeep, then I can focus my energy into other aspects of the company.

You have also confirmed what I was saying about off the shelf hard drives. Thanks for the comment.

]]> By: jeff http://mike.texasdomes.com/2008/02/03/my-search-for-data-storage/#comment-15 jeff Sun, 03 Feb 2008 18:01:42 +0000 http://mike.texasdomes.com/?p=14#comment-15 Sounds like a great storage solution. Personally I build my own file servers. It is pretty inexpensive, and very flexible. Recently, I bought 4 hard drives. I found one went bad after being powered for 11 hours. The second one went bad after 57 hours. They were replaced under warrantly. The third one, though it passed all of the manufacturers tests, still read back data incorrectly about once ever 4 gigabytes. I have sent it back for replacement. It sure would be nice to buy drives that have been more throughly burned-in, like the Apple Drive Modules. It took me many hours to track down these bad hard drives. In the past I have had very few hard drives fail. On another note, fileservers have nothing to do with backing up data. I recommend backing up data often, and storing the backups either in a fireproof, media safe, or offsight, or both. Sounds like a great storage solution.

Personally I build my own file servers. It is pretty inexpensive, and very flexible.
Recently, I bought 4 hard drives. I found one went bad after being powered for 11 hours. The second one went bad after 57 hours. They were replaced under warrantly.
The third one, though it passed all of the manufacturers tests, still read back data incorrectly about once ever 4 gigabytes. I have sent it back for replacement. It sure would be nice to buy drives that have been more throughly burned-in, like the Apple
Drive Modules. It took me many hours to track down these bad hard drives. In the past I have had very few hard drives fail.

On another note, fileservers have nothing to do with backing up data.
I recommend backing up data often, and storing the backups either in a fireproof,
media safe, or offsight, or both.

]]>