Neat Tools Are Needed to Help Creatives Deliver Fantastic Films, Shows

Content Insider #863 – Friendly Foe

By Andy Marken –  andy@markencom.com

“Turns out, in my Matrix, the worse we treat you, the more we manipulate you, the more energy you produce. It’s nuts. I’ve been setting productivity records every year since I took over. And, the best part, zero resistance.” – The Analyst, “The Matrix Resurrections,” Warner Bros, 2021

For a technology that has been around since the ‘40s, it’s really hard to understand all of the noise – cheering and hand wringing – that has grown around AI over the past couple of years especially in the content creation, production, distribution industry.

Every morning, you wake up and someone has developed the perfect AI tool that’s going to change the way we live and work.

Then you hear “experts” explain how it’s going to be the second coming or the devil incarnate.

It’s not a new prophecy … the automatic loom created a panic in the 19^th century, but it ended up creating more and better jobs.

The typewriter was going to wipe out jobs for secretaries but it expanded and enhanced work opportunities for millions. Yes, it did totally sc*** up our ability to write cursive but …

Back in 1952, Arthur Samuel built a rudimentary AI checkers program that went on to beat the best players around. 

Then an AI package was developed that could beat leading chess masters.

But the technology met it’s match when a human beat AI at the ancient abstract Chinese board game Go – https://tinyurl.com/699xxpf9 – a game that is almost impossible to master.

Governments the world over have rushed to develop laws and guidelines to protect us from AI world and mankind domination. 

That’s tough because we don’t know what we don’t know.  

In the film industry, AI will probably replace some people (executives?), but will help others advance to more responsible jobs. Ironically, will probably least affect those in the trades – key grips, electricians, craft services.

Many in the industry are already using AI tools, others will have to adapt or …

Brothers Strong – Christopher Nolan, who swept the Acadamy Awards with his film Oppenheimer, had some spare time during the Hollywood creatives strike so he joined his brother, screenwriter Jonathan Nolan, on the picket line.  Now that’s brotherly love/support.  

WGA, SAG/AFTRA spent weeks/months hammering out guardrails with AMPTP to limit AI uses to protect writers, actors and others in the film/show industry.

Depending on which side of the table you’re sitting on, it’s either the saving grace for the visual entertainment industry or the worst d*** thing that has ever been introduced for the industry.

It’s neither and it’s both!

Good people are already using it to do some spectacular work. Bad people are using it to sc**w up things.

Both sides will get better at what they do.

AI tools progressively made The Planet of the Apes franchise films better and better.

When Kingdom of the Planet of the Apes was released, it all felt natural  … even more real.  You could see every hair on Ceasar (and the others)

Healthy 70 – Godzilla may be 70 years old, but he never looked better, thanks to the creative work of the Toho Studios VFX team.

Godzilla Minus One earned an Oscar for its VFX work.

Godzilla is one of the few lead cast members that has gotten better with age.

 And Toho Studios did the whole thing on a total budget of $15M, thanks to the very creative work of 65 artists, their AI-enabled VFX tools in addition to their attention to detail and the budget (time/money). 

Go ahead, compare it to Dune: Part 2 that cost around $200M ++ and other recent two +++ hour blockbusters producers/directors who reshoot again and again and then have talented folks fix it in post.

There are dozens of AI-enabled tools already being used throughout a project’s development, production, post and delivery.

But maybe the most important application is at the front end of the front end of a project … before writers, cinematographers, actors and crew members get involved.

So, perhaps before a studio or backer commits to the video story’s time, people and financial budget, AI should be used to test and see if the idea is worth a d***.

It can be used to antiseptically determine if the premise/storyline will appeal to an audience and how big that target audience could be compared to the cost.

Prequels, sequels, spinoffs and franchise extensions can seem safe bets, but folks can get tired – fast – with the same old same old. 

Every series, every film, every genre has its day and then …

Take an atypical family as an example.

Film Appeal – Even award-winning films/shows don’t appeal to everyone because we tend to like certain genres.  In addition, tastes change over time.  

Our daughter loved Barbie.

Our son liked Dune: Part 2.

The wife enjoys nearly all of the easy-to-digest cops/robbers and good people/bad folks shows that alternate between traditional TV and streaming.

The few times we get the controller to stream something, we’re partial to sci fi, thriller, action and documentary films.

As film data researcher Stephen Follows points out, there may be genre spillover; but folks have a built-in bias toward certain genres, and they change over time.

Audience Targeting – People in countries around the world also have varying genre interests.  One type of project doesn’t appeal to people in the same way.  

In addition, Bruce Nash, international box office tracker and Follows note that what puts seats in theater seats and people in front of their big screen sets varies by interest level around the globe.

In other words, AI can be a valuable tool by using it to wade through all of the data of the projects – past and present – to give producers, directors and studio heads a good idea if the project is going to resonate with most of their target audience beyond a gut feeling.

It can help determine the film’s strengths/weaknesses, where it needs to be reinforced and help in zeroing in on locations, cinematographer(s) and actors who can best deliver audience entertainment. 

Yes, we understand that all that stuff is dull; but it can make it easier for someone to greenlight the project beyond just saying, “yeah, we’re going to do a different, better film than Fall Guy, Quiet Place, Twister, Alien, Smile, Lion King or another doll knock-off.”

It also makes it more difficult for some studio heads to shelf the project (especially if it’s in final post), just because she or he needs another tax write-off.

Not impossible, but more difficult. 

Streamlining Production – Virtual production studios have cropped up around the globe because they make film production faster, better, easier and more “real.”  The quality is increasing and the costs are coming down.  

“The industry took a giant leap forward when VP (virtual production) LED screens were meshed with Unreal’s gaming engine and Nvidia’s GPU (graphics processing unit),” said Allan McLennan, President of 2G Digital Post. “They deliver tools and capabilities we almost take for granted today.

“Virtual camera systems, real-time rendering, photo-realistic CG (computer generated) backgrounds and AI-assisted production software is now fairly integrated in the production workflow and commonplace, whether you’re creating a 30-sec spot or a two-hour film,” he continued.  “I’m sure some greenscreen work is being done, but every production facility in operation or in construction has varying VP sets and automated systems because they can dramatically improve the development of the project while helping to reduce the time and cost.

“As with the AI-enabled tools, they help crews be more effective and efficient,” he added.  “More people are able to break set and go home for dinner in the evening rather than being tied down, sometimes working seven days a week. It helps them achieve a better balance in their personal/professional lives.”

AI in Post – Nearly every tool editors and post production experts use today has AI components that help raise the quality of the project and significantly reduce the tedious parts of the work.  

The first wave of AI tools is already being used extensively in video editing and post-production where folks have been able to pass off the time-consuming, tedious, mind-numbing and yes, boring but vital tasks. 

These teams have been hit with a double-whammy – the need for dramatically reduced production times and reduced budgets – while executives still expect them to deliver flawless, eye-popping creativity.

Adobe, Avid, Autodesk and other leading creative tool producers have delivered some great tools post professionals are using in their workflow for color grading and editing as well as analyzing/enhancing visuals, sounds and compositions.  

Firefly Flies – Adobe has woven their AI tool into all of their production/post products to reduce/eliminate boring work while improving the output and minimizing the budget impact.  

Adobe’s Firefly AI image and text generator works inside the company’s products to help filmmakers, editors and post professionals unleash a new wave of creativity.

Tools like Adobe’s After Effects have opened a new wave of production/post possibilities, putting resources and tools that were once only available for budget-busting projects in the hands of folks working on nearly every size of film/show. It turns “here’s what I’d like” into “BAM!”

It does this without editors, CGI experts and other post professionals having to spend hours making and tweaking pixel and sound adjustments.

One of perhaps the best applications of AI is in one of the most important and often overlooked portions of a project … the creation of film/show trailers.

It really is a unique art in itself that can produce a clarion call to people to absolutely have to see a project on the screen – theater/home – or result in “modest” results.

Previously, trailer magicians used to spend days, weeks and months getting the best of actors, action, sentiment and impact packed into the three- to five-minute mini-shows to influence the potential audience.

With AI tools guided by their professional’s expertise, they are able to efficiently and effectively develop a larger number of trailers to convince people that they absolutely, positively have to see the film/show.

One of the best AI advancements we appreciate has been the rapid rollout of AI subtitling and dubbing tools.  It opens up the entire world of shows/movies for people to see/enjoy no matter where they live or their native language.

The most dramatic example of this, according to McLennan, was that James Cameron’s Avatar: The Way of Water. It was created in over 1000 versions so it could be seen, followed and appreciated in theaters around the world.

“English may be the most commonly used language around the globe by nearly 1.5B people, but there are more than 7,139 languages spoken/read around the globe with 30 being the most widely used,” he noted.

“People in these areas want to enjoy a film/show in their language or, as with my preference, like to hear it in its native language but be able to follow/understand the storyline by reading the subtitles,” he continued.

Breaking Barriers – The success of Parasites was instrumental in making theater/home viewers more comfortable in seeing and enjoying films where people spoke in their native language and the dialogue was translated into local language.  

“When Bong Joon Ho surprised people everywhere by winning an Oscar for Parasites,” he emphasized, “it broke the one-inch tall barrier of subtitles being only ‘good enough’ for art theater showings and opened up new opportunities for every filmmaker, regardless of whether he produced the project in Atlanta, Toronto, Los Angeles, Mumbai, Shandong, Warsaw, Manila, Lagos or Osaka.

“With the use of AI-enabled subtitling and language dubbing, the industry really has reduced the barrier between the film/show developer and the project consumer,” he added.

In other words, good video stories show that the more we’re different, the more we’re the same.

Of course, as with any improvement, there are also unforeseen side effects.

Unhealthy Attachment – Psychologists around the globe have been voicing their concerns that some people may become over reliant on AI and even become strongly attached to the technologies.  

One that concerns us was best exemplified back in 2013 when Spike Jonze created Her.

You know, where a dude develops an unhealthy relationship/reliance with Apple’s Siri.  

Okay, it was a hilarious deviant relationship, but many psychologists are worried about (and studying) the reliance, attachment and need for AI to make them complete and follow the technology down the rabbit hole.  

As the Analyst in The Matrix Resurrection, noted, “Quietly yearning for what you don’t have, while dreading losing what you do. Desire and fear.”

A number of AI cheerleaders are even saying that it won’t be long before AI will be cranking out really good films and shows.

We find that thought repulsive because the project may have all the technical features but it can’t have the empathy, sensitivity and yes, mind-jolting realism that only real people can imagine, develop and deliver at this time.

Anything can simply be seen as a waste of people’s viewing time.

Andy Marken – andy@markencom.com – is an author of more than 800 articles on management, marketing, communications, industry trends in media & entertainment, consumer electronics, software, and applications. An internationally recognized marketing/communications consultant with a broad range of technical and industry expertise especially in storage, storage management and film/video production fields; he has an extended range of relationships with business, industry trade press, online media, and industry analysts/consultants.