Hanno Basse, Fox Filmed Entertainment (FFE) Chief Technology Officer and chairman of the Ultra HD Alliance, said 20th Century Fox Home Entertainment continues to push the envelope on production of 4K Ultra HD content with high dynamic range (HDR), but the creative license of filmmakers using the format can sometimes be limited by the inability of digital movie theaters to produce the same HDR performance levels as today’s premium 4K UHD TVs.
Filmmakers now getting involved with HDR productions are restrained from adding certain HDR elements viewable on new TVs that can not be reproduced on movie theater screens.
Meanwhile, theaters that are already playing Dolby Vision and Dolby Cinema content with Dolby’s flavor of HDR don’t achieve the same parameters as TVs conforming to the Ultra HD Alliance’s Premium certification specifications for high-performing 4K Ultra HD TV, Basse said.
Fox is hopeful that professional digital theaters will one day be able to handle all of the extra luminance and contrast benefits produced on 4K UHD TVs that conform to the new UHDA Premium format for home-based 4K UHD TVs.
Basse and Samsung recently entertained HD Guru and a group of technology reviewers at the Fox Innovation Lab in Century City, CA to get an update on how his studio and others are loading up supplies of HDR-enabled movies and programs for Ultra HD Blu-ray and Vidity digital download distribution.
Hanno Basse: The purpose of the Fox Innovation Lab is to catch technology trends very early when they are just about to emerge or maybe even when they are still in people’s minds or on the drawing board, and make sure that our content creation strategy is aligned with whatever other trends are out there.
We knew HDR was coming. We wanted to turn it into a consumer product. Our artists needed to understand how to use this new format and what the right ways are to prepare the motion picture content for this new medium and how do we preserve the creative intent of the director? At the same time we wanted to help them utilize the right cameras and so forth. So we worked with Samsung on the specifications for the consumer display and we worked with all of the creators on figuring out how to create the content. When the first HDR TVs hit the market in the spring of last year, we actually had content available to go with them.
We are doing similar things now, and have projects related to Virtual Reality (VR) and new distribution methods including robust delivery of our content into the mobile space, because there is obviously a lot of consumption now that is migrating into mobile. And also, when we create these new experiences like HDR — and Virtual Reality is a big new technology in the lab here as well — how do you actually deliver this to consumers in a meaningful way?
So we are working with major consumer electronics and technology companies around the globe to figure out how our content strategy should be aligned with the emerging technologies that we are seeing.
So 5G, for example as the next generation of mobile communications, is going to open up new possibilities for us as content providers, since we are trying to figure out how to work in that space, and then we try to look one or two years out from there.
In our living room set up, we try to replicate a high-end consumer viewing environment. We have a 7.1-channel audio system that is Dolby Atmos capable to create an immersive experience. In addition, we have a standard dynamic range (SDR) display on one side and a high dynamic range (HDR) display on the other side. The facility also has a viewing room designed to accompany consumer focus research groups in an observation environment that allows people to interact with the technology and content in a typical focus group atmosphere. Our focus group subjects comprise representative samples of different demographics. We walk them through each experience, so we walk them through the Ultra HD Blu-ray experience, the Vidity experience, and HDR vs. SDR.
Many of the tools needed for HDR display calibrations are still in development. How do you have your monitors here at the lab calibrated?
Basse: For the displays we use both Samsung’s people for calibrations and our own. In the beginning, when we were working primarily with prototypes, we were using Samsung’s people exclusively, but now we are to a point where even a high-end consumer needs to be able to calibrate these displays, so we use our own people.
For our calibrations we go by the recommendations that Samsung has given us, and it is the same thing for the retailers right now. They communicate with us, and there are measurement tools to figure out what is specifically a very high level of performance as a consumer would buy it.
What standard is Fox using for HDR mastering?
The Fox Lab also has an Ultra HD Blu-ray mastering room, where Ultra HD Blu-ray titles are mastered for HDR peak luminance. The room is equipped with a Samsung Ultra HDTV with a peak luminance of about 1,000 nits, as specified by the UHD Alliance in the Ultra HD Premium certification, and an SDR display. In the UHD Alliance we have now developed what we consider to be a high quality standard for high dynamic range in consumer televisions and content. Without a standard in the past it was hard for anyone to know exactly what HDR is. The UHD Alliance now has over 40 members who are working together to help establish a standard for the next generation of audio and visual entertainment.
From an artist’s standpoint, if you look at an HDR vs. an SDR display, it isn’t about it being just brighter. It’s really about more contrast, more detail and much better saturation in colors.
It’s also that the color space is wider. So we were using the Rec. 709 color space for decades, and now we are using the DCI P3 color space, which is the same one that we are using for digital theatrical distribution. Again, this is something that the artists like because it is now much closer the theatrical original than the Blu-ray was ever able to do. Because there are certain limits in what standard Blu-ray allows you to do.
Who makes the decisions on the production side about whether a movie is going to be made in HDR and is it pre planned when the movie is green lighted?
Basse: Over a year ago, Fox became the first Hollywood Studio to take the step to assure that all of its major releases would be produced in high dynamic range. Ever since Kingsmen came out in the spring of 2015, all of our new releases that exceeded certain box office thresholds, which we cannot disclose, would come out in high dynamic range. It’s not just the tent poles, either. Eddie The Eagle, for example, has an HDR release, and that obviously wasn’t the most widely viewed movie in the theaters. It’s just really, really small movies that hardly anyone has seen that won’t be produced in HDR.
What helps us in general is that whether you shoot in film or you shoot with digital cinema cameras like Red Dragon, the Arri Alexa and others, they all are capable of a lot more dynamic range than these TVs have. They all have the color gamut coverage that we need. And also for visual effects, the power formats that we are using and the entire workflow that we are using are accommodating high dynamic range. But we are typically not pushing all theatrical releases in HDR. They are still done in the theatrical environment at 48 nits or 14 ft. lamberts peak brightness, but P3 color space. The first grading is all that happens on a theatrical projector, but then in post-production we make a different version up of the raw files that are HDR.
Because our theatrical distribution today isn’t in high dynamic range, our filmmakers don’t necessarily think about HDR when they shoot it. They are starting to think about it now. It depends on the filmmaker. So for example, for our new Ultra HD Blu-ray Deadpool, the director, Tim Miller, did not go out to shoot for HDR [it was added in post-production], but for Deadpool 2 they will take the HDR input into account.
deadpoolcostume The Deadpool costume on display at Fox Studios.
By the way, Tim Miller and the star of Deadpool, Ryan Reynolds, saw this and are big fans of HDR.
The only thing is that because our distribution [into digital theaters] is not in high dynamic range, you can’t do everything you would want to do in HDR, because you can’t do something at the expense of the theatrical distribution. If there is a key plot point that you need to get across that’s done with lighting or with showing some detail or whatever, you have to make sure that the same element gets across in the theatrical release. Long term I think that is going to change when we have a similar HDR experience in the theater, which we don’t have today.
But bottom line, which cameras they use, how do you light it?, how do you shoot it,? what the look of the film is?, that’s up to the creative team and especially the director. We don’t really influence that. So even when they do the push process to create the high dynamic range version, still, the director rules. Whatever the look they are going to get out of a TV like this, that’s the look we are going to put in the market. We do try to explain to them that there is a big difference between [SDR and HDR displays], and that’s something they should pay attention to, and they typically do. But at the end of the day the last word is with the director.
When you say you are producing a movie in HDR does that automatically imply that they are also 4K?
Basse: For us it is. All of our HDR releases will come in 4K.
So, even if they don’t go out looking to shoot for HDR, they are using a camera that captures all of that information that’s needed to add it in post-production?
Basse: Yes. There are several aspects of this. There is shot composition, so that elements in the background and so forth that need to be in the shot are put there intentionally. That’s a decision they need to plan ahead of time. Then, a lot of these elements come out in the grading process. So what we found since we’ve been doing this is that a lot of the information that we need is in the raw camera file, in the raw negative. We just need to pull it out in the post-production process. So we are very fortunate to have this ability in these new cameras.
You say that you have no theatrical releases in HDR, but there are some. Dolby Vision, for example, comes out in theaters all of the time. Does Fox do any of that?
Basse: Yes we do. The Martian for example was done in Dolby Cinema [HDR, Dolby Atmos and other features], and The Revenant also had a Dolby Cinema release. But when you look at the parameters for Dolby Cinema and you look at this [points to an HDR-10 display], there is still quite a bit of difference in terms of peak brightness and a few other things. So, we are working with Dolby and a few other companies to try and figure out how do we get this experience in the theater?
Clearly, Dolby Cinema is a good step in the right direction, but we would like to expand it a little further. We also need a solution that fits in thousands and thousands of movie theaters and we don’t think that Dolby really has plans to do that at this point. It all comes down to the cost of this. It is a very expensive solution.
I’m not saying that we can’t get there from here, but we need something that is scalable and closer to this [Ultra HD Premium parameters]. Because, if there is too much of a difference between what this medium can do and what happens in the theater we will always have to go for the lower denominator in terms of artistic expression. It’s the same thing with high frame rate. Why would we want to do high frame rate, because there are certain shots that you cannot have today in 24 fps, such has fast pans, especially in 3D, impossible at 24 fps. But if a majority of your distribution is in 24 fps, which it is, then you still can’t have those shots.
I had a 5 minute discussion with Hano about 3D over under/side by side at 10 bits in the uhdbd...
Filmmakers now getting involved with HDR productions are restrained from adding certain HDR elements viewable on new TVs that can not be reproduced on movie theater screens.
Meanwhile, theaters that are already playing Dolby Vision and Dolby Cinema content with Dolby’s flavor of HDR don’t achieve the same parameters as TVs conforming to the Ultra HD Alliance’s Premium certification specifications for high-performing 4K Ultra HD TV, Basse said.
Fox is hopeful that professional digital theaters will one day be able to handle all of the extra luminance and contrast benefits produced on 4K UHD TVs that conform to the new UHDA Premium format for home-based 4K UHD TVs.
Basse and Samsung recently entertained HD Guru and a group of technology reviewers at the Fox Innovation Lab in Century City, CA to get an update on how his studio and others are loading up supplies of HDR-enabled movies and programs for Ultra HD Blu-ray and Vidity digital download distribution.
Hanno Basse: The purpose of the Fox Innovation Lab is to catch technology trends very early when they are just about to emerge or maybe even when they are still in people’s minds or on the drawing board, and make sure that our content creation strategy is aligned with whatever other trends are out there.
We knew HDR was coming. We wanted to turn it into a consumer product. Our artists needed to understand how to use this new format and what the right ways are to prepare the motion picture content for this new medium and how do we preserve the creative intent of the director? At the same time we wanted to help them utilize the right cameras and so forth. So we worked with Samsung on the specifications for the consumer display and we worked with all of the creators on figuring out how to create the content. When the first HDR TVs hit the market in the spring of last year, we actually had content available to go with them.
We are doing similar things now, and have projects related to Virtual Reality (VR) and new distribution methods including robust delivery of our content into the mobile space, because there is obviously a lot of consumption now that is migrating into mobile. And also, when we create these new experiences like HDR — and Virtual Reality is a big new technology in the lab here as well — how do you actually deliver this to consumers in a meaningful way?
So we are working with major consumer electronics and technology companies around the globe to figure out how our content strategy should be aligned with the emerging technologies that we are seeing.
So 5G, for example as the next generation of mobile communications, is going to open up new possibilities for us as content providers, since we are trying to figure out how to work in that space, and then we try to look one or two years out from there.
In our living room set up, we try to replicate a high-end consumer viewing environment. We have a 7.1-channel audio system that is Dolby Atmos capable to create an immersive experience. In addition, we have a standard dynamic range (SDR) display on one side and a high dynamic range (HDR) display on the other side. The facility also has a viewing room designed to accompany consumer focus research groups in an observation environment that allows people to interact with the technology and content in a typical focus group atmosphere. Our focus group subjects comprise representative samples of different demographics. We walk them through each experience, so we walk them through the Ultra HD Blu-ray experience, the Vidity experience, and HDR vs. SDR.
Many of the tools needed for HDR display calibrations are still in development. How do you have your monitors here at the lab calibrated?
Basse: For the displays we use both Samsung’s people for calibrations and our own. In the beginning, when we were working primarily with prototypes, we were using Samsung’s people exclusively, but now we are to a point where even a high-end consumer needs to be able to calibrate these displays, so we use our own people.
For our calibrations we go by the recommendations that Samsung has given us, and it is the same thing for the retailers right now. They communicate with us, and there are measurement tools to figure out what is specifically a very high level of performance as a consumer would buy it.
What standard is Fox using for HDR mastering?
The Fox Lab also has an Ultra HD Blu-ray mastering room, where Ultra HD Blu-ray titles are mastered for HDR peak luminance. The room is equipped with a Samsung Ultra HDTV with a peak luminance of about 1,000 nits, as specified by the UHD Alliance in the Ultra HD Premium certification, and an SDR display. In the UHD Alliance we have now developed what we consider to be a high quality standard for high dynamic range in consumer televisions and content. Without a standard in the past it was hard for anyone to know exactly what HDR is. The UHD Alliance now has over 40 members who are working together to help establish a standard for the next generation of audio and visual entertainment.
From an artist’s standpoint, if you look at an HDR vs. an SDR display, it isn’t about it being just brighter. It’s really about more contrast, more detail and much better saturation in colors.
It’s also that the color space is wider. So we were using the Rec. 709 color space for decades, and now we are using the DCI P3 color space, which is the same one that we are using for digital theatrical distribution. Again, this is something that the artists like because it is now much closer the theatrical original than the Blu-ray was ever able to do. Because there are certain limits in what standard Blu-ray allows you to do.
Who makes the decisions on the production side about whether a movie is going to be made in HDR and is it pre planned when the movie is green lighted?
Basse: Over a year ago, Fox became the first Hollywood Studio to take the step to assure that all of its major releases would be produced in high dynamic range. Ever since Kingsmen came out in the spring of 2015, all of our new releases that exceeded certain box office thresholds, which we cannot disclose, would come out in high dynamic range. It’s not just the tent poles, either. Eddie The Eagle, for example, has an HDR release, and that obviously wasn’t the most widely viewed movie in the theaters. It’s just really, really small movies that hardly anyone has seen that won’t be produced in HDR.
What helps us in general is that whether you shoot in film or you shoot with digital cinema cameras like Red Dragon, the Arri Alexa and others, they all are capable of a lot more dynamic range than these TVs have. They all have the color gamut coverage that we need. And also for visual effects, the power formats that we are using and the entire workflow that we are using are accommodating high dynamic range. But we are typically not pushing all theatrical releases in HDR. They are still done in the theatrical environment at 48 nits or 14 ft. lamberts peak brightness, but P3 color space. The first grading is all that happens on a theatrical projector, but then in post-production we make a different version up of the raw files that are HDR.
Because our theatrical distribution today isn’t in high dynamic range, our filmmakers don’t necessarily think about HDR when they shoot it. They are starting to think about it now. It depends on the filmmaker. So for example, for our new Ultra HD Blu-ray Deadpool, the director, Tim Miller, did not go out to shoot for HDR [it was added in post-production], but for Deadpool 2 they will take the HDR input into account.
deadpoolcostume The Deadpool costume on display at Fox Studios.
By the way, Tim Miller and the star of Deadpool, Ryan Reynolds, saw this and are big fans of HDR.
The only thing is that because our distribution [into digital theaters] is not in high dynamic range, you can’t do everything you would want to do in HDR, because you can’t do something at the expense of the theatrical distribution. If there is a key plot point that you need to get across that’s done with lighting or with showing some detail or whatever, you have to make sure that the same element gets across in the theatrical release. Long term I think that is going to change when we have a similar HDR experience in the theater, which we don’t have today.
But bottom line, which cameras they use, how do you light it?, how do you shoot it,? what the look of the film is?, that’s up to the creative team and especially the director. We don’t really influence that. So even when they do the push process to create the high dynamic range version, still, the director rules. Whatever the look they are going to get out of a TV like this, that’s the look we are going to put in the market. We do try to explain to them that there is a big difference between [SDR and HDR displays], and that’s something they should pay attention to, and they typically do. But at the end of the day the last word is with the director.
When you say you are producing a movie in HDR does that automatically imply that they are also 4K?
Basse: For us it is. All of our HDR releases will come in 4K.
So, even if they don’t go out looking to shoot for HDR, they are using a camera that captures all of that information that’s needed to add it in post-production?
Basse: Yes. There are several aspects of this. There is shot composition, so that elements in the background and so forth that need to be in the shot are put there intentionally. That’s a decision they need to plan ahead of time. Then, a lot of these elements come out in the grading process. So what we found since we’ve been doing this is that a lot of the information that we need is in the raw camera file, in the raw negative. We just need to pull it out in the post-production process. So we are very fortunate to have this ability in these new cameras.
You say that you have no theatrical releases in HDR, but there are some. Dolby Vision, for example, comes out in theaters all of the time. Does Fox do any of that?
Basse: Yes we do. The Martian for example was done in Dolby Cinema [HDR, Dolby Atmos and other features], and The Revenant also had a Dolby Cinema release. But when you look at the parameters for Dolby Cinema and you look at this [points to an HDR-10 display], there is still quite a bit of difference in terms of peak brightness and a few other things. So, we are working with Dolby and a few other companies to try and figure out how do we get this experience in the theater?
Clearly, Dolby Cinema is a good step in the right direction, but we would like to expand it a little further. We also need a solution that fits in thousands and thousands of movie theaters and we don’t think that Dolby really has plans to do that at this point. It all comes down to the cost of this. It is a very expensive solution.
I’m not saying that we can’t get there from here, but we need something that is scalable and closer to this [Ultra HD Premium parameters]. Because, if there is too much of a difference between what this medium can do and what happens in the theater we will always have to go for the lower denominator in terms of artistic expression. It’s the same thing with high frame rate. Why would we want to do high frame rate, because there are certain shots that you cannot have today in 24 fps, such has fast pans, especially in 3D, impossible at 24 fps. But if a majority of your distribution is in 24 fps, which it is, then you still can’t have those shots.
I had a 5 minute discussion with Hano about 3D over under/side by side at 10 bits in the uhdbd...