This is topic 'UNBROKEN' 4K file size... in forum Digital Cinema Forum at Film-Tech Forum ARCHIVE.


To visit this topic, use this URL:
https://ft-forum.com/ft/cgi-bin/ubb/ultimatebb.cgi?ubb=get_topic;f=16;t=002173

Posted by John Wilson (Member # 269) on 01-11-2015, 10:24 PM:
 
Anyone in the States playing a 4K version of UNBROKEN...what is the size of the file? Our 4K is 137 minutes for a piddly 93GB. Why did they bother?
 
Posted by Adam Martin (Member # 641) on 01-11-2015, 11:53 PM:
 
Yup. Same here.
 
Posted by John Wilson (Member # 269) on 01-12-2015, 02:06 PM:
 
Thanks Adam.

How very odd. Haven't had one this compressed since one of the Harry Potters came in around 78GB for 148mins...but it was only 2K.
 
Posted by Bobby Henderson (Member # 840) on 01-12-2015, 02:36 PM:
 
I would figure that kind of severe compression level would be business as usual for Warner Bros., except that WB didn't release this movie. Universal did.

JPEG 2000 isn't very file size efficient when it comes to encoding and compressing imagery meant to view as video. If decision makers are going to put more emphasis on shrinking file sizes instead of preserving image quality then they might as well just dump JPEG 2000 for d-cinema use and adopt HEVC H.265 instead. That video codec would likely preserve a hell of a lot more detail of a two hour 4K movie inside a 93GB file size than JPEG 2000.

I don't even know why some studios have to crank up the compression levels on some of these DCPs when an external hard disc is giving them more than enough space to go in the opposite direction (bigger file sizes, less compression). Do they think they're getting a head start on some of the encode work for various home video/streaming formats by making DCP video sizes absurdly small?
 
Posted by James Westbrook (Member # 3690) on 01-12-2015, 02:53 PM:
 
This explains why the ingest from the DCDC to the library server was quick...
 
Posted by Frederick Lanoy (Member # 5416) on 01-12-2015, 03:33 PM:
 
Same size for the DCP in France.

Yet, i though the image looks very good on screen. Did not see any issues that suggest it was severely compressed.
 
Posted by John Wilson (Member # 269) on 01-12-2015, 04:04 PM:
 
Imagine what it could have looked like at around 250 - 280GB though...
 
Posted by Joe Redifer (Member # 3) on 01-12-2015, 04:39 PM:
 
quote: Bobby Henderson
JPEG 2000 isn't very file size efficient when it comes to encoding and compressing imagery meant to view as video.
Video or still, it doesn't matter as JPEG2000 is just a bunch of stills anyway since it's an intraframe codec but I understand the point you're making. I don't know why the studios would put any emphasis at all on smaller file sizes. Can someone clue me in to how this could possibly be advantageous for a studio? Because I sure as hell can't figure it out. Maybe they think the hard drives will be lighter if they have less data on them? Or maybe they don't want to spend a long time transmitting via satellite? Trying to save on bandwidth costs perhaps? Don't wanna spend that extra $20 per month for higher bandwidth?

quote: Bobby Henderson
If decision makers are going to put more emphasis on shrinking file sizes instead of preserving image quality then they might as well just dump JPEG 2000 for d-cinema use and adopt HEVC H.265 instead.
Agreed. But that's an interframe codec and I dunno... to me that just doesn't seem like something that should be used in a professional application like a movie theater. But it would definitely keep those file sizes down and reduce the cost to ship the hard drives!
 
Posted by Bobby Henderson (Member # 840) on 01-12-2015, 07:50 PM:
 
With file sizes squeezed smaller than they should be H.265 might deliver a more professional looking end result than JPEG 2000 even if JPEG 2000 seems more professional by avoiding interframe compression methods.

It certainly would make sense to data compress a movie more severely to make more efficient use of satellite bandwidth, but it doesn't make any sense if the movie is just being shipped on hard discs.

I also wonder if the increased severity of data compression is meant to draw greater separation between the studio masters and DCPs, perhaps as a security measure to protect their intellectual property. That's probably a reach, but I'm just trying to make sense of it. One thing is certain, a DCP weighing in at under 100GB is a hell of a lot closer to a Blu-ray disc in terms of image quality than its uncompressed studio master.
 
Posted by Brad Miller (Member # 2) on 01-12-2015, 08:46 PM:
 
quote: Bobby Henderson
It certainly would make sense to data compress a movie more severely to make more efficient use of satellite bandwidth, but it doesn't make any sense if the movie is just being shipped on hard discs.
It is entirely possible the hard drive duplication costs are in various brackets based upon the amount of GB put onto them. After all 500GB of data on a hard drive only takes half the time of putting 1000GB of data on that drive to duplicate.
 
Posted by Carsten Kurz (Member # 5396) on 01-13-2015, 09:23 AM:
 
Well, first of all, it is in CS AR, that means, less pixel to beginn with. Second, compression ratio of real material depends on the spatial resolution and high-frequency signal components of the source footage. An exceptional soft, monochromatic, dark, etc. movie will 'naturally' compress to smaller file sizes without anyone pulling the strings especially towards that direction.

That said - 93GBytes certainly still seems a bit on the low side.

I would think that normally the only valid decision towards filesize would be made based on the aspect of harddisc single inventory. That is, a typical multi-format package with 2D, language versions, different 3D grades, etc. should fit on the commonly found distribution disks. But with a feature like 'unbroken', this could hardly play a role (first of all, no 3D).

Unfortunately, hard-disk distribution can no longer be considered the norm. As the DCDC takes up pace, I would think that satellite or broadband distribution cost will play a larger role for future features. It is possible that in this case, this was the decision factor.

- Carsten
 
Posted by Joe Redifer (Member # 3) on 01-13-2015, 02:41 PM:
 
Even with no compression at all, hard drive duplication costs would be MUCH more cost efficient than than striking a bunch of prints, right? So why are they pinching pennies?
 
Posted by John Wilson (Member # 269) on 01-13-2015, 03:32 PM:
 
As a comparison, our 2K version of AMERICAN SNIPER which runs a comparable 132mins is 235GB.

Go figure... [Roll Eyes]
 
Posted by Monte L Fullmer (Member # 2797) on 01-15-2015, 06:13 PM:
 
And, you get the count up to 126Gb if you're doing ATMOS 7.1 for the same 4K resolution.
 
Posted by Owen Morgan (Member # 7854) on 01-17-2015, 09:35 PM:
 
This topic has me intrigued....

I am in a position to actually ask the people who actually mastered the DCP (UK/EU/Other releases) questions, and I wonder why it is soo small..

I see no real reason other than to save duplication time, digital delivery time (both IP and Satellite based)...

I have a suspicion that the guys who worked on this were simply working with the source materials they had (which may have been source DCP or .j2c files from universal, or uncompressed .tif...) and that decisions based on how much compression to use etc would have been already down the line.

I can but ask..
 
Posted by Antonio Casado (Member # 7592) on 01-18-2015, 04:14 AM:
 
I can answer about that, because I professionally make DCPs and I have done a lot of test regarding this...

Well, first of all, the tool you use can be more or less efficient. For example, at the same bitrate, OpenJPEG is more heavy in size, but EasyDCP (kadaku encoder) is less weight.

You can think that less size is less quality. Not in JPEG2000, that have a very optimized algorithm.

I use a tool that use other Jpeg2000 encoder and the results are really amazing.

Second, the bandwidth. The maximum Mbit/sec for DCP is 250 Mbit/sec (including audio tracks). Really, no one make DCPs to that Mbit/sec because is not needed.

In fact, more that 150Mbit/sec is considered garbage and there is NOT difference visually with a 250Mb/sec DCP. When you low to 100 mbit/sec is when you can loss some high frequency textures, so not recommended at all. 25Mbit/sec cause severe degradation in the image, and the image look like plains colors, really funny :-D

Third, the use of VBR Encoding. When you use it, is when you make the "magic". Prior to the use of VBR, you mark a target Mbit/sec and ALL Jpeg2000 files will be compressed at this Mbit/sec. So a black image will size like a full detailed pic. This is a nonsense.

The VBR encoding can lower A LOT the final size, as a black image can be as low as 2Kb, and that is very good.

Also, if the original image is NOT HD (DVD Scaled to HD, for example, or something similar), the size will be much lower, by using VBR encoding (equal pixels surronding will be compressed and the final image will be lower in size, but retaining the original Quality).

I have done a lot of projections of very high frequency images (with a lot of detail), and when you compare a 150Mbit/sec DCP with a 250Mbit/sec DCP, there is NO difference. Itīs the same.

Of course, a final cause is the duplication time. Itīs not the same copy a 200GB DCP that a 100GB DCP. You can lower the time, and make more copies in the same time. And the quality is the same. So, why to spent useless bytes?.

About H265, I donīt think that H265 will be used in DCP. H265 is a very good codec, I have done test at 4K and using the same bitrate of Bluray at 1080P the quality blow away. Imagine a 1080P H265 Feature weighting only the half of the size but the same quality. Really cool!. This is intended to use for streaming and Digital Download, not Cinema.

But who knows how can be the Digital Projection in 10 or 15 years from now...

I only know that Jpeg2000 is one of the best codecs to use in delivery, much better that anyone other...
 
Posted by Steve Guttag (Member # 268) on 01-18-2015, 08:14 AM:
 
Thanks Antonio! Very informative. Do you have a suggested bit-rate when encoding DVDs and Blu-Rays that retain as much quality of the original but without wasting space?
 
Posted by Antonio Casado (Member # 7592) on 01-19-2015, 02:04 AM:
 
Thanks Steve!

About Bluray and DVD, as these media is compressed in origin, a 140 Mbit Bitrate will be fine.

The SAME movie in DVD will compress A LOT (because the image need to be scaled and the pixels repeats, so a lot of optimization will occur).

I do not recommend to transfer to DCP from a DVD, itīs really crappy, but I understand that sometimes is the only source, unfortunately.

I receive A LOT of compressed, interlaced, resized, pulldown material, the clients doesnīt know anything about DCinema and thinks that "all is good" to project in DCinema. What a mess!
 
Posted by Marco Giustini (Member # 4544) on 01-19-2015, 10:17 AM:
 
quote: Antonio Casado
I have done a lot of projections of very high frequency images (with a lot of detail), and when you compare a 150Mbit/sec DCP with a 250Mbit/sec DCP, there is NO difference. Itīs the same.
Hi Antonio,
May I ask you on what screen size you run your tests?

If I did my calculations right, the CPL we're talking about has been mastered at an average of 92Mbit/S

I believe one of the reasons for the small size is satellite/online delivery. The smaller, the faster/cheaper to transfer. I know of some countries where the satellite version is actually smaller than the DCP counterpart.

Personally I feel that considering the money a feature costs, a little less compression for the big screen is not going to hurt! I trust your observations Antonio, 150Mbit sounds good to me.

Let's say that if you say that 150 is very good, if I were a studio I'd choose 160 to be on the safe side. Not 92! [Smile]

That said as you noted nobody knows about that stuff and it's likely the higher compression was just a result of random events.
 
Posted by Lyle Romer (Member # 1266) on 01-19-2015, 12:00 PM:
 
Antonio,

Thank you for the detailed explanations you have posted. Does your 150 Mbps maximum necessary bitrate apply to 4k? My non-expert thought would be that with 4X the information to start with, it would require a higher bitrate than 2k to get to where you don't notice a difference with more bandwidth. I'm specifically referring to JPEG2000 compression.
 
Posted by Antonio Casado (Member # 7592) on 01-19-2015, 12:38 PM:
 
Marco:

I have projected in a 300 meters square screen, so trust me, 150/160Mbits is fine and the quality is very good (but at these levels of screen we need 4K)

92Mbit/sec is really a low low bitrate!. The Scope format also helps to lower the bitrate (as the pixel count is lower that Flat/Full), but that is not the point. I NEVER lower from 125mbit/sec. I use 125mbit/sec for ads, because they are "temporal", but for Features and other things, I set mainly 150/160mbit/sec.

Of course, the final size varies in function of the type of images, I have a rule of 1 min = 1GB, so 90 minutes will size 90GB or more (suggested more, of course)

Lyle:

About 4K, as the maximum bitrate is 250mbits for both format I suggest to up to 170/180 mbits, not more. And even 160Mbits will be fine too, as the "degradation" in a 4K image is less noticeable, and ONLY the very near seats can "see" the true 4K resolution (and you need a reasonably big screen too).

This apply too to 3D and HFR, where the FPS will be doubled and the size of the files are lower too.

Thatīs because HFR 3D need 500Mbit/sec, to make the really good quality needed, as 250Mbit/sec will be insuficient (but possible!)
 
Posted by Carsten Kurz (Member # 5396) on 01-19-2015, 01:13 PM:
 
As I mentioned before, there are some differences between common J2K encoders. The Dolby encoder e,g, manages lower bitrates very well, while OPENJPEG does not.
I talked so someone dealing with DCP mastering and disc & satellite distribution professionally. He did confirm that, though rarely, sometimes the rights owner/distributor do in fact instruct the mastering companies to lower the bitrate in favour of certain distribution channels and cost. Some distribution companies actually charge per GB, so they actually do save with smaller files.

I hope they will not overdo this in the future as more and more satellite and broadband distribution taking over.

J2K/Wavelets deal very well with higher resolution content. That's one of the reasons DCI chose this codec. You can add a lot more detail without having to increase the datarate significantly.

When recompressing DVD or BluRay, J2k as intraframe also does not pile up more motion artifacts as with most other interframe codecs. These would show up badly on the big screen. So, it is relatively easy to conserve at least the original BluRay quality using J2K. BluRay also has only 8Bit 4:2:0. These 'flatter' files will compress a lot higher than DCPs 12Bit 4:4:4 as they contain a lot more redundancy.

Proper color/gamma conversion is more important than bitrate settings when doing DCP conversions - even for DVD.

- Carsten
 
Posted by Antonio Casado (Member # 7592) on 01-19-2015, 01:22 PM:
 
I agree with Carsten ;-)
 
Posted by Steve Guttag (Member # 268) on 01-19-2015, 01:49 PM:
 
Carsten,

Your rule of thumbs on DVDs and Blu-Ray conversions? I have also heard that for them, particularly DVD...100Mbit/sec is sufficient to not lose anything.

I would presume the path the "ripping" occurred would make some difference as to what colorspace one should select on the DCP conversion. Blu-Ray should be REC709.

In other threads I've heard the discussion on the Gamma...there is the theoretical and what seems to work well in the theatre. Again, Rec 709 stuff is normally in the 2.2-2.3 range but some claim it is a bit too much on the "light" side.
 
Posted by Carsten Kurz (Member # 5396) on 01-19-2015, 02:07 PM:
 
Steve,

actually I have set my DCP datarate at 150 and hardly ever touch it. I usually do not care if one of these conversions has a couple of GB more or less. Yes, DVD could probably be set well below 100MBit/s, but I really do not care. You do know that different discs can have very different resolution/quality, so, while you could take an edge with one disc, it may not work with a different one. So I just play safe with 150MBit/s. That would still be sufficient with high quality 4:4:4 10/12Bit source footage.

REC709 is right for both DVD and Bluray. The problem is that there is a strange gamma uncertainty, discussed at various places, claiming that there is not a single gamma setting that fits all media.

http://dcinemaforum.com/forum/index.php?topic=451.0

I have actually seen strange lifted blacks on some BluRay conversions, but not others. I have a hard time to understand why these differences do not show up as drastically in their original intended playback environment - home cinema, etc. I can only advise to keep a close look at the blacks/colored shadows and keep the issue in mind. All DCP converters with support for REC709 should do gamma correction from 2.4 to 2.6 (2.2 to 2.6 for sRGB sources) while converting to xyz color. But sometimes this simple scheme fails. When I did my first full lenght Bluray-DCP conversion two years ago, I only noticed too late that in some scenes there were torn up blocky blacks and strange clipped saturated dark colors. At the time I did not have the time for a new conversion, let alone thorough testing. So I had to adjust the projector settings to fix it. Best of course would be to have an A/B comparion between disc and DCP on the DCI machine. But who has the time to do that for every conversion?

- Carsten
 
Posted by Owen Morgan (Member # 7854) on 01-19-2015, 07:02 PM:
 
Hi,

For the record the FR-FR_FR-TL_71_4K has a JP2K bandwidth of 80.90MB/s.

I doubt that they are using any 'open' JP2K encoders..

But that goes a long way to explain the size.
 
Posted by Carsten Kurz (Member # 5396) on 01-20-2015, 03:46 AM:
 
If you can, look up the metadata files for any hints on the encoder/mastering system used.

-Carsten
 
Posted by Marcel Birgelen (Member # 6801) on 01-20-2015, 04:36 AM:
 
quote: Owen Morgan
I doubt that they are using any 'open' JP2K encoders..
The open JPEG2000 encoders are OK, but not extremely great. I think there is just limited interest in improving those open tools and libraries for JPEG2000, compared to open libraries for formats like H.264 or H.265.

A more refined encoder can definitely make a whole lot of difference and get better quality out of the same bitrate.
Also, keep in mind if you're coming from Blu-Ray and going to JPEG2000, you're going from one lossy format to the other. You should always take a safe margin here, or else you're layering lossy compression artifacts of one format on top of the other.
quote: Carsten Kurz
I have actually seen strange lifted blacks on some BluRay conversions, but not others. I have a hard time to understand why these differences do not show up as drastically in their original intended playback environment - home cinema, etc.
I've dealt with the same issues, but I'm not entirely sure it's really a REC.709 to XYZ conversion error, but rather a production error that somehow doesn't get noticed or production companies don't really care about it.

I've seen the same "blocky" MPEG artifacts when playing back the non-transcoded Blu-Ray rip on a computer screen. Obviously this computer screen was in no way calibrated and probably too bright. But it shows that it doesn't need much of a "miscalibration" to get those obviously shoddy encoding artifacts into visual levels.

Another explanation could be some rendering defect in the H.264 decompression library off course.
 
Posted by Bobby Henderson (Member # 840) on 01-20-2015, 09:03 AM:
 
Adobe Photoshop has a built in JPEG 2000 image encoder. I don't know if Adobe has updated it lately. I wasn't very impressed with it the last time I messed with it. I didn't see much difference over the standard Photoshop JPEG filter. Fireworks, a program Adobe acquired from Macromedia, can compress JPEG images more efficiently. But Adobe is not developing that program any further.

quote: Antonio Casado
Third, the use of VBR Encoding. When you use it, is when you make the "magic". Prior to the use of VBR, you mark a target Mbit/sec and ALL Jpeg2000 files will be compressed at this Mbit/sec. So a black image will size like a full detailed pic. This is a nonsense.

The VBR encoding can lower A LOT the final size, as a black image can be as low as 2Kb, and that is very good.

It sounds like your encoder is using techniques similar to those used in GIF and PNG images, where large fields of solid color can be compressed very efficiently and even lossless compressed in some cases.

quote: Antonio Casado
About 4K, as the maximum bitrate is 250mbits for both format I suggest to up to 170/180 mbits, not more. And even 160Mbits will be fine too, as the "degradation" in a 4K image is less noticeable, and ONLY the very near seats can "see" the true 4K resolution (and you need a reasonably big screen too).
What viewers can and cannot see in 4K really depends on a number of factors. 4K done right should be noticeable on a big screen to more than just the first few rows of people.

Some imagery, such as low depth of field imagery and imagery deliberately shot a little out of focus (to hide pancake makeup, wrinkles on faces, etc.), isn't going to look much different in 2K or 4K. Imagery that is heavily processed in post production may have a lot of its native detail killed through over zealous filter tweaks.

Then you have all the movie theaters that, for various reasons, dial their projectors slightly out of focus. They don't want viewers seeing that electronic pixel grid. Or they have a moiré issue between the perforations of their movie screen and the projector's pixel grid. Or maybe their projector's lens just isn't very good.

Graphics items with hard edges, such as lettering and logos, can reveal the pixel grid in a very obvious way. Likewise, if the projector is slightly out of focus those items are going to look soft.

I have seen tack sharp imagery many times in film presentations of the past, especially with 70mm film. I have never seen tack sharp imagery with any digital show. It's all been various levels of softness. The sad thing is I've seen razor sharp image quality on 4K UHDTV sets showing 4K demo material. So I guess as 4K TV sets grow more popular and 4K content starts becoming more common we can look forward to a whole new round of home viewers talking about how much better the home viewing experience is than the theater.
 
Posted by Antonio Casado (Member # 7592) on 01-20-2015, 09:19 AM:
 
The Jpeg2000 encoder of Adobe Photoshop is NOT DCinema compliant. There is some branches into the Jpeg2000 encoding, lossy and lossless, and DCinema is one of them, with his own particularities...

Jpeg2000 is NOT Jpeg, they cannot compare as both have very big differences. In fact, the Wavelet encoding used in Jpeg2000 is the same used un Cineform and others high-end codecs.

"My" encoder use the same algorithms of the high end encoders, such as Dolby, EasyDCP and so on. The use of VBR is very common right now and itīs the best option to make a DCP with high quality but weighting less. Think that type of compression like ZIP or RAR does over a image with large areas of solid colors. Itīs the same approach.

About 4K...well..is long to talk. Better in another thread, really...
 
Posted by Bobby Henderson (Member # 840) on 01-20-2015, 01:03 PM:
 
Regarding Adobe Photoshop's JPEG 2000 save as filter, it's a pretty old plug-in. What I find odd is Adobe apparently hasn't updated it even though applications like Premiere Pro CC and Adobe Media Encoder have bundled DCP creation options (via the lite 2K-only version of Wraptor DCP).

quote: Antonio Casado
About 4K...well..is long to talk. Better in another thread, really...
It is, but I know what I have seen in the past with Film Done Right versus what I'm seeing with Digital. IMHO, Digital is being done wrong.

Out of focus imagery and the 'scope degraded into a low resolution format are both huge digital-specific problems that can be corrected with some specific steps.
 
Posted by Antonio Casado (Member # 7592) on 01-20-2015, 01:12 PM:
 
If you want a GOOD Dcinema J2K codec for Premiere/After Effects and Photoshop, use this:

http://www.fnordware.com/j2k/

I use it a lot, and the quality is TOP.

The DCP Wraptor is like crap. And makes faulty DCPs.
 




Powered by Infopop Corporation
UBB.classicTM 6.3.1.2