« Thanks to everyone who came to "Earth from Below" at UPR | Main | Access to Life: Magnum Exhibit at the UN »

October 25, 2010

TrackBack

TrackBack URL for this entry:
http://www.typepad.com/services/trackback/6a00e551a5897b88330133f54e4ee0970b

Listed below are links to weblogs that reference Bad things happen to good photographers; be prepared:

Comments

Feed You can follow this conversation by subscribing to the comment feed for this post.

Stephen Alvarez

@Fred,
I do check them every now and then, probably not often enough. They are on standard esata drives.

Fred

Hi Stephen,
and are you sure that your offsite archive drives (2004, 2005, 2006,..) will still be readable when you will need them ? do you do check them regularly like the A & B drives?
I strongly recommend to scan them once in a while.
Fred

Stephen Alvarez

Bernard,
RAW data doesn't really compress so the Time Machine back up ends up being larger than the original. Remember it is keeping all the changed versions of a file. My RAW catalog is currently around 5 terabytes, the back up is close to 6.

Bernard van Dierendonck

Stephen

that's great! thanks for your information.

After a nights sleep and rethinking my system I figured that file corruption hasn't been an issue because I don't use RAID (so far). My structure is very archaic and manually organized. But now, confronted with a fast growing archive it's good to think about reorganization. Your strategy seems like a very good solution.

A question about your time machine backup: is time machine compressing the data? If you have 8 TB of photographs, does the time machine backup have the same size or is it bigger/smaler?

Best regards
Bernard

Stephen Alvarez

Bernard,
Thanks for the links.
The HP card is actually a raid controller that is doing the raid calculations so that your os is freed up to do other things. The drives in each array have to be identical, but different arrays can have different drive/PM box combinations. I suggest this route if you really need the speed. A RAID 5 array run off one of these SATA cards is very very quick. While the array is outside the machine, it appears internal.
There are a bunch of different raid controllers some of them are reviewed here
http://www.hptesata.com/review_contents.html

Bernard van Dierendonck

Dear Stephen

thanks! Now it starts to make a lot of sense (before I startet feeling a bit like a digital analphabete ;-)): So the HP 2522 is managing the PM and acts like a hub for more units. with array you say: in your case all have to be PM and inside those PMs the drives have to be identical too? Or only identical inside the PM and you can add other Raids to it?

I'll do some research to see if I can find this or a similar system in Switzerland. What I really like that you have a fast connection to your RAWs, so you can work directly of your external Drives. (also my MacPro is filling with data)
I guess the rest of your system (like mails, letters, texts...) goes also with time machine backup.

It's interesting because some other photographers also blogged about their backup strategies, like
http://blog.chasejarvis.com/blog/2010/06/workflow-and-backup-for-photo-video/

and vincent laforet

or this one (Drew Gardener) who had lots of issues with his Drobo Pro:
http://photography-thedarkart.blogspot.com/2010/09/end-of-my-tether-with-drobo-iscsi.html

But so far I missed the notion of the data corruption

So thanks again - it's been great to follow you on your blog and on twitter and I'm looking forward to the Paris article in a future ngm

Best regards

Bernard

Stephen Alvarez

Bernard,

Time Machine runs across the entire picture library. The first backup took the better part of a week. But subsequent ones do not slow down the machine noticeably as each incremental backup is rather small.

The way my RAID array works is the HP 2522 card is in a PCI slot in my MacPro. It is just above the graphics card. There are 8 cables that come out of the back of the card and each one will plug into a Port Multiplier enclosure. The Radon enclosure that I use holds 5 x 2TB drives. At RAID 5 it is formatted to just under 8 TB. I say it is expandable because I can continue to add enclosures (up to 8 off of the same card). The downside of RAID 5 is that all the drives in each array have to be the same manufacturer, size and model.

let me know if this makes sense.

-Stephen

Bernard van Dierendonck

Dear Stephen
thank you very much for your information! Very helpfu. First time I noticed the three dangers mechanical, physical and file corruption.
After looking up the links to the High Points 2522 and Radon Port multiplier I still don't understand this completely. If time allows could you explain this system or show a picture of it. Thanks!
And the time machine is running over your complete picture library? Is this not slowing your computer down a lot? Or is time machine only running over night?

Best regards from Switzerland

Bernard

The comments to this entry are closed.

meter