File Storage

Newer members often state that they think their question is too basic, or stupid, or whatever, to be posted. Nothing could be further further from the truth in any section at DSLRUsers.com, but especially here. Don't feel intimidated. The only stupid question is the one that remains unasked. We were all beginners at one stage, and even the most experienced amongst us will admit to learning new stuff on a daily basis. Ask away! Please also refer to the forum rules and the portal page

Moderators: Greg B, Nnnnsic, Geoff, Glen, gstark, Moderators

Forum rules
Please ensure that you have a meaningful location included in your profile. Please refer to the FAQ for details of what "meaningful" is. Please also check the portal page for more information on this.

File Storage

Postby NikonUser on Mon Mar 13, 2006 4:07 pm

Hi there,

Although I've been shooting now for 2 years I still haven't come up with a satisfactory way to keep all of my files on my hard drive and am hoping that someone with more experience than me can help me come up with a 'fail-safe' method.

I have three versions of everything (RAW + PSD + JPG) and don't know how to organise them on the HDD in a logical and easy to find/use manner.

Should I keep them all in seperate folders? ie

/Photos/2006/Birds/Finches/RAW --> All the RAW files go in here
/Photos/2006/Birds/Finches/PSD --> All the PSD files go in here. Filenames are the same as the RAW
/Photos/2006/Birds/Finches/JPG --> All the JPEGs go here. Filenames the same as the RAW

or stick them all in the same folder

/Photos/2006/Birds/Finches --> All RAW + PSD + JPG files go in the same folder

.... I'm sure there are MUCH better soloutions than that... just looking for how you guys organise all your files

I do have a copy of iMatch that I keep meaning to learn how to use to organise things as well but I've never gotten around to learning how to do more than import the pics (I currently just import the JPEG files)

Paul
http://www.australiandigitalphotography.com

Living in poverty due to my addiction to NIKON... Is there a clinic that can help me?
User avatar
NikonUser
Senior Member
 
Posts: 1064
Joined: Tue Jul 12, 2005 6:18 pm
Location: Canberra - **D2X**

Postby kipper on Mon Mar 13, 2006 4:20 pm

I'm still trying to work out a decent file structure myself.

At the moment I have the following:

Originals
db
photos
2004
01
02
etc
2005
etc
2006
etc

Unsorted
db
photos

Processing


All my raw files out of the camera go into Unsorted/photos, here they get smart renamed by iMatch to YYYYMMDD_HHDDSS_INDEX. Once done they get placed in the appropriately dated folder. If I want any additional information such as them being a finch or whatever I can add a properties field for my image or add a category and mark the photograph being associated with that category. Something I need to do is add back all my categories. In processing I have no sub directories as yet (might change when it gets big) the files named the same as the NEF except for extension. So I'd have:

20060120_070000_00001.PSD

Which would be the cropped NEF file with any postprocessing done (eg. wb adjustment, shadow/highlight, noise reduction etc).

Then the resized image and selective sharpened with black border and copyright tag would be:

20060120_070000_00001_web.PSD

I don't even bother keeping the JPG files as they can easily be regened from the PSD file.
Last edited by kipper on Mon Mar 13, 2006 4:23 pm, edited 1 time in total.
Darryl (aka Kipper)
Nikon D200
kipper
Senior Member
 
Posts: 3738
Joined: Thu Nov 04, 2004 9:23 pm
Location: Hampshire, UK

Postby xerubus on Mon Mar 13, 2006 4:22 pm

i do something very similar but with dates..

e.g.

2006\060313_housefire\nef
2006\060313_housefire\tif
2006\060313_housefire\jpg

that way it's very easy for me to sort through and get the exact images I am searching for. with the date in that format it's organised quite nicely for my needs.

i am very interested in getting my teeth stuck into the adobe lightroom at some stage soon.. just need to set aside the time.

cheers
http://www.markcrossphotography.com - A camera, glass, and some light.
User avatar
xerubus
Senior Member
 
Posts: 2740
Joined: Fri Oct 22, 2004 3:33 pm
Location: Nth Brisbane

Postby stubbsy on Mon Mar 13, 2006 4:27 pm

Paul

I have two top level folders - PP and No PP for pics I've decided to do PP on and those I don't. The No PP are basically those I've taken, but decided weren't good enough for whatever reason. Inside each of these top level folders I then file my images by date (eg 2006-03-13).

I then use iMatch to manage the images. So if I have a pic of a finch taken today that I've PP'd it'll be in My Pictures/PP/2006-03-13 physically as say _DSC1234.NEF, _DSC1234.JPG and _DSC1234.PSD. In iMatch I tell it to only import the .NEFs and further I've told it that .JPG and .PSD are buddy files to .NEF. What the buddy file thing means is if I move a .NEF file within iMatch to a different physical location it will also move the .JPG and .PSD versions automatically.

So as discussed above my pic is now in iMatch as _DSC1234.NEF. I then assign the image to a parent category of Animals, with a sub cetegory of Bird and a sub sub category of Finch. I might also put the same image in a parent category called Location and a sub category called Victoria with a sub sub category called Mornington. Additionally I have an iMatch script I've wriiten that will also assign the image to various categories based on EXIF data eg by lens, focal length, shutter speeed etc.

Once all that's done I have a multitude of ways of getting at what is a single file on my hard disk. If I want pics of finches taken in Victoria I'll find by specifying those values in a search. If I want animal pics taken with my 70-200VR same story. Likewise if I want all shots taken using a focal length of 90mm I can search on that. I'm sure you get the idea.

So basically iMatch becomes a giant searchable repository of all sorts of image metadata. At the same time the file itself is in one single location.

Finally, one other point when the file is first moved to my hard disk from CF it goes to the No PP area. When I decide to PP it I move it to the PP area using iMatch so it can keep track of things.

There's lot's more, but this probably gives an idea of what I do. If you want more I can go into more detail (eg iMatch let's me archive this stuff to DVD and tracks that too).
Peter
Disclaimer: I know nothing about anything.
*** smugmug galleries: http://www.stubbsy.smugmug.com ***
User avatar
stubbsy
Moderator
 
Posts: 10748
Joined: Wed Dec 08, 2004 7:44 pm
Location: Newcastle NSW - D700

Postby kipper on Mon Mar 13, 2006 4:27 pm

Mark, you actually made me look into seeing if it was possible for iMatch to only process certain file types. The reason I'd seperated the RAWS from the processed files before was because iMatch was adding in everyfile. However I can specify Nikon NEF only :)

Ok so my new structure will be:

Photos
db
files
2004
01
NEF PSD
JPG
etc
2005
etc
2006
etc

Unsorted
db
files


Mark, thanks for making me refine mine :)
Darryl (aka Kipper)
Nikon D200
kipper
Senior Member
 
Posts: 3738
Joined: Thu Nov 04, 2004 9:23 pm
Location: Hampshire, UK

Postby kipper on Mon Mar 13, 2006 4:30 pm

Peter, that's a nice idea with the PP and No PP. With everything starting off in the No PP area.

Also out of interest Peter, can you buddy files in sub directories eg.

Code: Select all
NEF
  _DSC1000.NEF PSD
  _DSC1000.PSD
JPG
  _DSC1000.JPG
Last edited by kipper on Mon Mar 13, 2006 4:31 pm, edited 3 times in total.
Darryl (aka Kipper)
Nikon D200
kipper
Senior Member
 
Posts: 3738
Joined: Thu Nov 04, 2004 9:23 pm
Location: Hampshire, UK

Postby xerubus on Mon Mar 13, 2006 4:30 pm

kipper wrote:Mark, thanks for making me refine mine :)


:D
http://www.markcrossphotography.com - A camera, glass, and some light.
User avatar
xerubus
Senior Member
 
Posts: 2740
Joined: Fri Oct 22, 2004 3:33 pm
Location: Nth Brisbane

Postby NikonUser on Mon Mar 13, 2006 4:33 pm

Thanks stubbsy for that.... that sounds exactly what I want to be doing with mine.

I didn't realise you could do the 'Buddy file' thing in iMatch. That will help a great deal!

Any reason you get iMatch to show only the .NEF files? I think for me I'd want to see the finished JPG files so I know exactly what I'm looking at.

Sounds like I'm going to have to do some serious research on iMatch. I recently upgraded it to the latest version and knew that I am only using a tiny part of it's functionality but have never sat down and learned exactly what it can do.

Paul
http://www.australiandigitalphotography.com

Living in poverty due to my addiction to NIKON... Is there a clinic that can help me?
User avatar
NikonUser
Senior Member
 
Posts: 1064
Joined: Tue Jul 12, 2005 6:18 pm
Location: Canberra - **D2X**

Postby kipper on Mon Mar 13, 2006 4:34 pm

With iMatch when you create the DB you can specify what file types you want it to process.
Darryl (aka Kipper)
Nikon D200
kipper
Senior Member
 
Posts: 3738
Joined: Thu Nov 04, 2004 9:23 pm
Location: Hampshire, UK

Postby kipper on Mon Mar 13, 2006 4:36 pm

Personally I don't think you should need to view the JPGs at all when browsing in iMatch. If you name the files the same as I do, and they're buddied (which I haven't done yet). All you need to do when later wanting to reference the original raw file that was associated with the JPG is look for the filename.
Darryl (aka Kipper)
Nikon D200
kipper
Senior Member
 
Posts: 3738
Joined: Thu Nov 04, 2004 9:23 pm
Location: Hampshire, UK

Postby NikonUser on Mon Mar 13, 2006 4:38 pm

The info on how to backup to DVD would also be very helpful Peter...

Probably a little much for me to take in at this point but it's something I really need to learn.

My image collection is growing larger all the time and I'm starting to get paranoid about loosing stuff :roll:

Paul
http://www.australiandigitalphotography.com

Living in poverty due to my addiction to NIKON... Is there a clinic that can help me?
User avatar
NikonUser
Senior Member
 
Posts: 1064
Joined: Tue Jul 12, 2005 6:18 pm
Location: Canberra - **D2X**

Postby sheepie on Mon Mar 13, 2006 4:40 pm

stubbsy wrote:Paul...

[lot's of info goes here]

...There's lot's more, but this probably gives an idea of what I do. If you want more I can go into more detail (eg iMatch let's me archive this stuff to DVD and tracks that too).

Feeling better I see Peter? ;)

That's a very good summary of some what Imatch is capable of, and one day I really am going to sort out how to use it! Perhaps you can run a workshop on "Efficient use of Imatch / digital workflow" at the Annual Meet in August!
*** When getting there is half the fun! ***
User avatar
sheepie
Key Member
 
Posts: 3029
Joined: Sun Aug 08, 2004 11:56 am
Location: Picnic Point, Sydney Australia *** Nikon D200/D70 ***

Postby stubbsy on Mon Mar 13, 2006 5:00 pm

kipper wrote:Also out of interest Peter, can you buddy files in sub directories eg.

Code: Select all
NEF
  _DSC1000.NEF PSD
  _DSC1000.PSD
JPG
  _DSC1000.JPG

Darryl - No. Buddy files muct be at the same level

NikonUser wrote:Any reason you get iMatch to show only the .NEF files? I think for me I'd want to see the finished JPG files so I know exactly what I'm looking at.

Paul
No reason at all, I don't look at the final version in iMatch. If you have iMatch do both .NEF and .JPG then you'll have two of every image showing in iMatch (inless you filter by file type). This would also complicate things like categories since you'd need to assign both bersions of a file to the same categories.
Peter
Disclaimer: I know nothing about anything.
*** smugmug galleries: http://www.stubbsy.smugmug.com ***
User avatar
stubbsy
Moderator
 
Posts: 10748
Joined: Wed Dec 08, 2004 7:44 pm
Location: Newcastle NSW - D700

Postby NikonUser on Mon Mar 13, 2006 5:10 pm

Thanks for the info so far. Guess what I'll be doing this afternoon? :)

Now this is probably pushing it...

But can I set it up so that:

1) I have iMatch only display the JPEG version of the file (easy)
2) I setup so that I have the PSD and NEF files as buddies (easy)
3) Somehow choose an option within iMatch that will allow me to open the NEF or PSD file for editing?

That way I could look at the final JPEG versions in the database and if I wanted to change or edit anything I could open it in Photoshop or Nikon Capture from within iMatch and not have to go hunting around my harddisk for the NEF and PSD files?

Paul
http://www.australiandigitalphotography.com

Living in poverty due to my addiction to NIKON... Is there a clinic that can help me?
User avatar
NikonUser
Senior Member
 
Posts: 1064
Joined: Tue Jul 12, 2005 6:18 pm
Location: Canberra - **D2X**

Postby kipper on Mon Mar 13, 2006 5:16 pm

The problem I see with your method NikonUser is that you're getting iMatch to show the end result which is the JPEG instead of it showing the starting point which is the NEF file. What happens if there is no JPEG yet because you haven't PP it from a NEF into a JPEG? This means you will have no entry for that NEF file.

To me the logical thing would be to show the NEF because from there you can have things like user tools setup such as NC4 or CS2 and then you look at the NEF and go "hey I like that, I'm going to add that one to my site" and you right click fire up CS2 and convert it to a JPEG. To me the way you described sounds a bit arse about??
Darryl (aka Kipper)
Nikon D200
kipper
Senior Member
 
Posts: 3738
Joined: Thu Nov 04, 2004 9:23 pm
Location: Hampshire, UK

Postby NikonUser on Mon Mar 13, 2006 5:20 pm

I only really want my database to show me files that I've processed and have JPEG's for.

For the files I haven't yet processed they are in a seperate folder

/Unedited/2006-13-03/

and I use Adobe Bridge to browse through them.

My idea is to have the iMatch database setup so I can find and browse all of my finished/edited images.

Paul
http://www.australiandigitalphotography.com

Living in poverty due to my addiction to NIKON... Is there a clinic that can help me?
User avatar
NikonUser
Senior Member
 
Posts: 1064
Joined: Tue Jul 12, 2005 6:18 pm
Location: Canberra - **D2X**

Postby NikonUser on Mon Mar 13, 2006 5:24 pm

kipper wrote:To me the logical thing would be to show the NEF because from there you can have things like user tools setup such as NC4 or CS2 and then you look at the NEF and go "hey I like that, I'm going to add that one to my site" and you right click fire up CS2 and convert it to a JPEG.


I want to be able to look at the final file and say "Hey, I like that, I would like to print it out" and then be able to open the PSD file in CS2 to prepare it for printing.
http://www.australiandigitalphotography.com

Living in poverty due to my addiction to NIKON... Is there a clinic that can help me?
User avatar
NikonUser
Senior Member
 
Posts: 1064
Joined: Tue Jul 12, 2005 6:18 pm
Location: Canberra - **D2X**

Postby kipper on Mon Mar 13, 2006 5:34 pm

Fair enough, you could always setup two DBs. One unprocessed (all NEFS), one processed (all JPEGS)?
Darryl (aka Kipper)
Nikon D200
kipper
Senior Member
 
Posts: 3738
Joined: Thu Nov 04, 2004 9:23 pm
Location: Hampshire, UK

Postby stubbsy on Mon Mar 13, 2006 7:08 pm

sheepie wrote:
stubbsy wrote:Paul...

[lot's of info goes here]

...There's lot's more, but this probably gives an idea of what I do. If you want more I can go into more detail (eg iMatch let's me archive this stuff to DVD and tracks that too).

Feeling better I see Peter? ;)

That's a very good summary of some what Imatch is capable of, and one day I really am going to sort out how to use it! Perhaps you can run a workshop on "Efficient use of Imatch / digital workflow" at the Annual Meet in August!

Or I could get my finger out and write something.
Peter
Disclaimer: I know nothing about anything.
*** smugmug galleries: http://www.stubbsy.smugmug.com ***
User avatar
stubbsy
Moderator
 
Posts: 10748
Joined: Wed Dec 08, 2004 7:44 pm
Location: Newcastle NSW - D700

Postby stephen on Mon Mar 13, 2006 8:21 pm

I wish i took the computing course at school instead of welding 1.1.Technology can get away from you sooo easily :cry:
stephen
Member
 
Posts: 232
Joined: Mon May 23, 2005 10:10 pm
Location: Perth WA


Return to Absolute Beginners Questions