Film-Tech Cinema Systems
Film-Tech Forum ARCHIVE


  
my profile | my password | search | faq & rules | forum home
  next oldest topic   next newest topic
» Film-Tech Forum ARCHIVE   » Community   » Film-Yak   » Academy Warning on Digital Preservation (Page 2)

 
This topic comprises 3 pages: 1  2  3 
 
Author Topic: Academy Warning on Digital Preservation
Frank Cox
Film God

Posts: 2234
From: Melville Saskatchewan Canada
Registered: Apr 2011


 - posted 02-06-2012 01:22 AM      Profile for Frank Cox   Author's Homepage   Email Frank Cox   Send New Private Message       Edit/Delete Post 
I know of a guy who makes a rather good living out of reading obscure and obsolete magnetic media. He has a huge collection of everything from early word processors to tape drives and you-name-it. It's my understanding that he does work mostly for forensic accountants, law enforcement and private investigators.

It's not particularly difficult to read a card deck "manually", just by looking at it and doing some plotting. The data density is obviously very low, and if you know what kind of a computer it came off of (if you're lucky it's noted on the deck somewhere) you can probably figure out if it's 9-left, Chinese binary or something else. A bit of amateur cryptography will probably get you there if nothing else -- if 9-left doesn't provide sensible output, it's probably not encoded that way.

Many years ago, when dinosaurs roamed the earth, the police in the town I lived in at the time seized a lawyer's office and discovered that he had all of his records on a computer. Nobody knew anything about it, in fact they were afraid to touch it for fear of losing evidence. They called me to look at it, and I spent two days there figuring out how he did what he did and printing out records on paper.

It is possible but obviously not cheap to read hard drives and tapes with an electron microscope. There are also several outfits around who do data restoration; again, none of them are cheap. (And if they are, don't deal with them.)

 |  IP: Logged

Joe Redifer
You need a beating today

Posts: 12859
From: Denver, Colorado
Registered: May 99


 - posted 02-06-2012 01:50 AM      Profile for Joe Redifer   Author's Homepage   Email Joe Redifer   Send New Private Message       Edit/Delete Post 
quote: Randy Stankey
That is the problem, right there. How can you read any digital file if you don't have a machine that can read it and interpret it?
That was my whole point. They need to make sure that they have stuff that can read it. The machine is irrelevant, the software is what is needed. They need to have software that can read it and when they change hardware they need to update their software so that their new machines have the software that can read it. If that sounds too complex for the studios to handle, I weep for humanity's idiocy. Likewise, they need to make lots and lots of copies of their files. When new storage media comes out, copy that shit over! Someday it will be all solid state and the only way it won't work is if it gets physically damaged (fire, flushed, etc) thus taking the media storage format out of the equation.

 |  IP: Logged

Manny Knowles
"What are these things and WHY are they BLUE???"

Posts: 4247
From: Bloomington, IN, USA
Registered: Feb 2002


 - posted 02-06-2012 02:06 AM      Profile for Manny Knowles   Email Manny Knowles   Send New Private Message       Edit/Delete Post 
Tom Holman often used the term "bit slinging" to describe the work of migrating digital files.

As far as the major studios... I recall seeing job postings for this kind of work all the time. I suspect they are investing in the preservation of their assets. Especially given that we now understand that there's money to be made by repackaging previously-released material.

It's the independent filmmakers that are at risk of losing their stuff. Not so much because of expense but, as the article points out, because archiving hasn't typically been integrated into the "independent" workflow.

 |  IP: Logged

Randy Stankey
Film God

Posts: 6539
From: Erie, Pennsylvania
Registered: Jun 99


 - posted 02-06-2012 02:45 AM      Profile for Randy Stankey   Email Randy Stankey   Send New Private Message       Edit/Delete Post 
It isn't just software that is needed to read a computer file from a disk drive or other storage medium.

What if you had to read a hard drive with a SCSI interface or a PATA interface? Your computer has SATA. How are you going to get that data?

A teletype doesn't even have software. It's entirely electromechanical and it transmits its data with current detector loops. To interface that with your computer, you need to build a circuit that connects to the current loops on the teletype and puts out some sort of bit code that the computer can understand. Then, assuming you got that far, how do you even figure out what software to use to interpret the information you get?

As Frank said, if you are reading Hollerith cards, how will you know whether the data is in 9-Left format, Chinese binary or something else? Then, once you have that data, what do you do with it?

It it a text file? Is it some kind of binary data file? Is it a program? What? Is it a digital video file? Is it MPEG? Is it raw binary data taken from a camera sensor? Even if you know that, how are you going to translate that data from that format to something you can use?

The only way to ensure that your data can be read in the future is to store a complete, working machine which can read that data back along with the data you want to archive. Then you'll have to include printed instructions on how to use it.

Again, the whole reason for this problem is because digital data isn't tangible. You can't see it. Even if you can see it how can you understand it? You can see a box of Hollerith cards and, in theory, you could manually read each card, one by one, and translate the punched code into symbols to type into a computer but that is mind-numbingly boring, tedious and fraught with possibility for error.

With film, you can see the image. You could still project it years from now but, if you couldn't find a projector, you could probably scan it and digitize it using current technology.

BTW, Manny, 50 years was a was nice round number. I bet you could play a 100 year old movie. Even so, you'll often have a hard time reading a computer file that's only ten years old.

While using film is not as convenient, I don't think "practical" is the correct way to characterize the difference. A thing can be practical for one purpose but not another. Digital video might be more practical for lazy movie executives but not necessarily so for theater owners who have to replace all the equipment in the complex.

 |  IP: Logged

Mark Ogden
Jedi Master Film Handler

Posts: 943
From: Little Falls, N.J.
Registered: Jun 99


 - posted 02-06-2012 04:16 AM      Profile for Mark Ogden   Email Mark Ogden   Send New Private Message       Edit/Delete Post 
quote:
Now is a great time to figure this out, Hollywood.

Congrats on that!

Go back and re-read the original article, which is addressed to smaller independent and documentary film-ma . . . oh, uh, excuse me, data stream makers, who probably haven't given the issue much thought.

Hollywood and the big players figured this out years ago,and the proof is on every screen that is showing Beauty and the Beast right now. This was a film that was produced on the old, long obsolete Disney CAPS system. They got rid of all that stuff years ago, but kept a few systems around to read archival material and were thus able to resurrect the original files and transfer them.

I tried to make the point years ago that anyone with important digital assets is obliged by common sense to either keep equipment around that can read them, or to migrate them to another format. The pros know this and are doing it. The key is the whole "active management" thing. Everything needs to be actively managed, film included. How many horror stories have been heard about film-makers going back to the vaults and finding their negatives in shit shape, too tightly wound, falling apart, mislabeled, mishandled? Look at the horrors that befell My Fair Lady, which we recently discussed in another thread. Here is a movie shot on 65mm that was in such shit condition that everything had to digitized in order to save it. Even the original b/w separations were screwed.

Anything film or digital that is handled with care, forethought, and common sense will outlive all of us.

 |  IP: Logged

Joe Redifer
You need a beating today

Posts: 12859
From: Denver, Colorado
Registered: May 99


 - posted 02-06-2012 04:53 AM      Profile for Joe Redifer   Author's Homepage   Email Joe Redifer   Send New Private Message       Edit/Delete Post 
quote: Randy Stankey
What if you had to read a hard drive with a SCSI interface or a PATA interface? Your computer has SATA. How are you going to get that data?
If you'd take care to read my ENTIRE posts, you'd know that I had already covered that.

Exhibit A:
quote: Joe Redifer
Likewise, they need to make lots and lots of copies of their files. When new storage media comes out, copy that shit over!
The bottom line is that they can't sit on their thumbs. If they do, they have nobody to blame but themselves. Technology isn't the enemy here, stupidity is. I still have files from 20 years ago on formats that weren't even comprehended back then. Doesn't seem to be a problem for me. But then again I just don't sit around passively and then later wonder why my stuff doesn't work.

Also, they make IDE/PATA/whatever adapters. I can read an EIDE drive (or PATA as you call it) on my SATA computer just fine. I can run SATA drives in my IDE PC. Crazy thing, technology.

 |  IP: Logged

Louis Bornwasser
Film God

Posts: 4441
From: prospect ky usa
Registered: Mar 2005


 - posted 02-06-2012 06:47 AM      Profile for Louis Bornwasser   Author's Homepage   Email Louis Bornwasser   Send New Private Message       Edit/Delete Post 
I guess they will just have to do what they have been doing: 35mm separations. Works good, lasts a long time. Louis

 |  IP: Logged

Mark J. Marshall
Film God

Posts: 3188
From: New Castle, DE, USA
Registered: Aug 2002


 - posted 02-06-2012 07:09 AM      Profile for Mark J. Marshall     Send New Private Message       Edit/Delete Post 
quote: Mark Ogden
Hollywood and the big players figured this out years ago
I'm not convinced. Come see me in 10 years and we'll see where we're at. If you're right, I'll buy you a nice steak dinner.

 |  IP: Logged

Paul Gordon
Jedi Master Film Handler

Posts: 580
From: Ottawa, Ontario, Canada
Registered: Aug 2005


 - posted 02-06-2012 07:25 AM      Profile for Paul Gordon   Author's Homepage   Email Paul Gordon   Send New Private Message       Edit/Delete Post 
Its the small players we have to worry about... not so much the big studio films. Thats what the report is all about. In the appx there is a interview with one of the post crew for David Fincher films. He went digital early on. But check out how the film is saved after post.

Q: The rendered DI, the digital master that is the result of all your hard work, must
obviously be protected. How do you insure that?

PM: When a movie is completed, assuming it is finished as a digital intermediate, it becomes
standard operating procedure for us to make the following:

LTOs of the final rendered DI files – at least two sets
Negative made directly from the DI files – sometimes as many as six
Interpositives – often as many as four
Dupe negatives – many
Digital Cinema Package master
High Defi nition video master
Digital YCM 35mm separations
From the above elements are made:
Hundreds, if not thousands, of 35mm prints
Hundreds, if not thousands, of Digital Cinema Package files, although these are erased
at the end of a theatrical run
Many thousands of DVDs and Blu-ray discs
Dozens, if not hundreds, of TV broadcast masters in Hi Def and Standard Def

The point is that in our modern media-addicted world, it becomes nearly impossible to wipe a
movie’s existence off the face of the earth.

 |  IP: Logged

Martin McCaffery
Film God

Posts: 2481
From: Montgomery, AL
Registered: Jun 99


 - posted 02-06-2012 09:24 AM      Profile for Martin McCaffery   Author's Homepage   Email Martin McCaffery   Send New Private Message       Edit/Delete Post 
Yeah, the small guys are most threatened, but I would not bet my life on Hollywood's preserving its history as a indication of enlightened self-interest.

Studios as corporate institutions may have an interest in preservation, but the suits that run the corporations are only interested in making as much money as they can as quickly as they can. That's why they have the bean counters to say they can't afford to maintain dual inventories, or strike new prints or whatever profit trimming expense that gets in their way.

Hollywood's history of preservation - with the exception of Disney - has been dismal, as the above post re: My Fair Lady shows. If they can't be trusted to preserve the big films, they certainly will not be interested in their lesser performing catalog.

Obviously, they have vaults and libraries and some preservation plans, but how much of a priority they are is still questionable.

 |  IP: Logged

Manny Knowles
"What are these things and WHY are they BLUE???"

Posts: 4247
From: Bloomington, IN, USA
Registered: Feb 2002


 - posted 02-06-2012 12:19 PM      Profile for Manny Knowles   Email Manny Knowles   Send New Private Message       Edit/Delete Post 
Randy, by "practical" I was referring to what we actually get on-screen, as opposed to what is theoretically possible with perfect prints and projection, which the industry was willing to abandon long ago. That's all.

 |  IP: Logged

David Buckley
Jedi Master Film Handler

Posts: 525
From: Oxford, N. Canterbury, New Zealand
Registered: Aug 2004


 - posted 02-06-2012 09:29 PM      Profile for David Buckley   Author's Homepage   Email David Buckley   Send New Private Message       Edit/Delete Post 
Clifford Stoll (known as the author of The Cuckoo's Egg) in his subsequent book, Silicon Snake Oil, notes:

 -

The list of media types we can no longer read gets longer by the year.

Like Randy, all my data has moved with me as time has changed, but we're beginning to store really large amounts of data now...

 |  IP: Logged

Joe Redifer
You need a beating today

Posts: 12859
From: Denver, Colorado
Registered: May 99


 - posted 02-07-2012 02:21 AM      Profile for Joe Redifer   Author's Homepage   Email Joe Redifer   Send New Private Message       Edit/Delete Post 
I think you mean "like Joe". Anyway, the size of the data is irrelevant. NASA was foolish. They have absolutely no one or nothing to blame but themselves. Storing digital movies on film will do no good.

Also, I still use paper tape. Stuff is awesome. I used it all of the time to write the titles and format on my 35mm prints and have found many other uses for it as well.

 |  IP: Logged

Paul Gordon
Jedi Master Film Handler

Posts: 580
From: Ottawa, Ontario, Canada
Registered: Aug 2005


 - posted 02-07-2012 05:52 AM      Profile for Paul Gordon   Author's Homepage   Email Paul Gordon   Send New Private Message       Edit/Delete Post 
Regarding David's Article.

Most of those formats he lists are still available and can still be played back. 78's! lots of turn tables play 78's. 8mm, there are loads of projectors out there, and Kodak still makes super 8 film. Reel to Reel 1/4" thousands of playback decks exist. 2 inch Quad is getting hard to service but they are still around, and BTW a broadcast image from a quad looks great.

NASA should have just saved the info to a standard LP record. Even if all the record players in the world suddenly disappear I'm sure someone on the planet is smart enough to make one.

 |  IP: Logged

Mark Hajducki
Jedi Master Film Handler

Posts: 500
From: Edinburgh, UK
Registered: May 2003


 - posted 02-07-2012 08:05 AM      Profile for Mark Hajducki   Email Mark Hajducki   Send New Private Message       Edit/Delete Post 
The data most at risk of being unreadable will be that stored in obscure file formats on equipment made in limited quantities.

The 1986 BBC Domesday Project was an example of this. Stored on laserdisk, accessed using a modified (Acorn) BBC Master computer.

quote:
Domesday Reloaded producer Alex Mansfield explained that transferring the data from Laserdisc to the web was problematic because none of the data was stored in recognisable file formats.

"It was pre-digital photography, so all those pictures are analogue, even though they are on a Laserdisc. There is no compression," said Mr Mansfield.

Each individual photograph, satellite image or map page was stored as a single frame of video on the disc.

While the system appears to function like a modern-day website, with pictures loading when they are clicked on, the playback head is constantly jumping between 50,000 video stills.

Each of these images had to be digitised from the original one inch video tape.

Domesday's many written articles proved easier to recover because they were created in a digital format.

Although, with no data storage capability, the thousands of pages of text had to be encoded and stored on one of the Laserdisc's spare audio tracks.

source

 |  IP: Logged



All times are Central (GMT -6:00)
This topic comprises 3 pages: 1  2  3 
 
   Close Topic    Move Topic    Delete Topic    next oldest topic   next newest topic
 - Printer-friendly view of this topic
Hop To:



Powered by Infopop Corporation
UBB.classicTM 6.3.1.2

The Film-Tech Forums are designed for various members related to the cinema industry to express their opinions, viewpoints and testimonials on various products, services and events based upon speculation, personal knowledge and factual information through use, therefore all views represented here allow no liability upon the publishers of this web site and the owners of said views assume no liability for any ill will resulting from these postings. The posts made here are for educational as well as entertainment purposes and as such anyone viewing this portion of the website must accept these views as statements of the author of that opinion and agrees to release the authors from any and all liability.

© 1999-2020 Film-Tech Cinema Systems, LLC. All rights reserved.