Voice Conversion for Children's Voices: Additional Dialogue Recording (ADR) and Animation Dialogue

Jan 12, 2021 9:18:40 AM

Child actors have the power to make movies unique. But making a major motion picture with children can be difficult, especially when it comes to additional dialogue recording (ADR) for multiple scenes and characters. Let's talk about the price paid by sound engineers when dubbing and how speech-to-speech (STS) synthesis technology can make production easier.

A short history of Additional Dialogue Recording (ADR)

Voice replication was never easy. Until the late 20s, audio technology capable of re-recording a film simply didn’t exist. Only in the 1930s, studios started dubbing their movies in foreign languages to reach a greater audience.

In those years, the position of dubbing director was the responsibility of the film’s chief director. Not because the production process was so complicated. But because sound engineers had to record a loop of a movie that would play repeatedly.

Background sounds such as city noise, off-screen crowd conversations, and others, are translated into loops. Then, voices with the actors' dialogues are layered on top of them.

Today, producers rely on computers to create loops. This significantly speeds up the dubbing preparation process and facilitates the work of audio engineers. However, the dubbing process is still highly dependent on the willingness of the actors to complete the work demanded of them while in the studio.

Traditional ADR vs Speech-to-Speech synthesis technology?

As you already know, additional dialogue recording (ADR) is the process of dubbing the original dialogue of a movie after filming has wrapped.

Traditionally, audio engineers meet with an actor in a studio for re-recording. The desired scene is replayed in front of the actor dozens of times over and over. The actor is then able to perform the dialogue in a way that most resembles the original scene's time frames.

But there is another way that is faster and less expensive. By using Respeecher, sound engineers can re-record an unlimited amount of audio content without having to resort to bringing the original actors. The benefits of using Respeecher's AI-powered technology include:

1. Synthesizing unlimited authentic audio content without involving any actors

Simply feed one hour of the original actor's dialogue into the AI system. Then, the system can convert that speech to the desired speech of the actor.

2. Recreating the original actor's voice using the speech of any person as its point of reference

Just imagine that you can read a dialogue and Respeecher makes it sound like it was read by Tom Hanks or Angelina Jolie. All this while maintaining the original intonation and emotion that you used while reading the text.

3. For the first time in history, dubbing films into foreign languages while retaining the actor's authentic voice

This is because artificial intelligence (AI) is not affected by the language in which speech should be synthesized. As long as a person can speak clearly, Respeecher can transform their voice into the original actor's voice.

Why is ADR so different for children and how can it be made easier?

Working with children on set is both easy and challenging at the same time. Sincere child emotions and acting combine with fickle moods and problems with concentration. The smaller the child, the more challenges the crew will face filming the child in the way their film demands.

When it comes to re-dubbing episodes of a film that has already wrapped shooting, even seasoned actors often encounter difficulties. With children, things are even more difficult.

Typical production frictions are not only limited to the issues of young actors. Here are some of the most common issues sound engineers face when organizing the ADR process:

1. Legal requirements

In most European countries, you cannot have a child work for more than 1 hour per day. When scheduling is tight (and ADR can take hours of work for a 60-second scene), this can be a major show stopper.

2. Parents are sometimes not as pleasant as their children

Understand correctly, we are all human. And when it comes to our children's work, we don't compromise. This is why audio engineers are under additional pressure from parents attending a recording session.

While audio engineers understand and respect parents and their children, they would rather minimize their role in order to speed up the production.

3. Changes in voice as a child grows up

Typical production cycles for a movie can take anywhere from 9 months to a couple of years. If you decide to re-record something, be prepared for an unpleasant surprise - the young actor's voice could have changed during this time. This means that the dubbing will contrast strongly with the remaining audio track.

4. Acting skills

Young movie stars who have perfectly revealed themselves on a set often cannot enter the role while in a studio. This can be problematic even for adults and even more difficult for children.

Sometimes the sound engineering team has to act out entire scenes so that children can again demonstrate their skills at their best. All these factors combined contribute toward stagnating the process of ADR even further.

Is synthetic speech technology (STS) a game-changer for ADR and children?

In STS technology, children may not be present in the studio for additional dialogue replacement (ADR). It is enough to record one hour of a child actor’s voice so that an adult can then read the dialogue for them.

Using an hour-long recording as a reference, any voice can be synthesized into the child's while retaining all shades of emotion, accent, and characteristics of speech. This means that sound directors no longer have to drag actors to the studio with their parents.

Instead of a child, a professional dubbing actor can dub the scene, thereby saving the nerves of parents, children, and the entire production team.

STS technology has its limitations and a host of possible issues. Nevertheless, these all are technical matters and can almost always be resolved by engineers without involving actors. 

Likewise, STS technology is of absolute importance for animated films and animation dialogues. First, it is completely possible to create a synthesized voice that is based entirely on the hero's identity, completely from scratch.

That voice can then be used for the entire length of the movie and even modified to fit for every character interaction, and not just for the purpose of re-dubbing individual roles or scenes.

Secondly, unlike film movies, animation characters never age. Hiccup from the How to Train Your Dragon franchise has to remain the same age, no matter how many years passed between the first movie to the third.

Respeecher’s voice cloning tech empowers producers to create and maintain the unique identity of a ten-year-old hero throughout an entire movie franchise cycle. This is far more convenient and cost-effective than using traditional actors for dubbing.

If you're looking to replicate a child's voice, create multi-language dubs, or create animation dubbing for an entire movie, we encourage you to give Respeecher a try. You will quickly lose track of how many hours, headaches you’ll manage to save, along with greatly reduced production costs. Contact us for more details and to find the best option for you.

author
Alex Serdiuk
Related Articles

Mar 12, 2021 7:46:40 PM

Technology is a disruptor for many industries, especially when it comes to...

Mar 24, 2021 10:44:14 AM

While video game developers create stories and plots for virtual characters, until...

May 5, 2021 12:31:02 PM

If you've been following our journey, you may already know that we've launched some...

Ready to Replicate Voices?

Want to see our technology in action? Get a demo today.

REQUEST A DEMO