Freaky or fantastic? Amazon’s Alexa could turn dead loved ones’ voices into digital assistant

Technology promises ability to ‘make the memories last’ by mimicking the voice of anyone it hears

Echo Dot: Amazon previously demonstrated how the reanimated voice of an older woman was used to read her grandson a bedtime story
Echo Dot: Amazon previously demonstrated how the reanimated voice of an older woman was used to read her grandson a bedtime story

Amazon plans to let people turn their dead loved ones’ voices into digital assistants, with the company promising the ability to “make the memories last”.

The company is developing technology that will allow its Alexa digital assistant to mimic the voice of anyone it hears from less than a minute of provided audio, Rohit Prasad, its senior vice-president and head scientist, said on Wednesday. He added that during the coronavirus paramedic “so many of us have lost someone we love”.

Although no timescale was given for the launch of the feature, the underlying technology has existed for several years. The company gave a demonstration where the reanimated voice of an older woman was used to read her grandson a bedtime story, after he asked Alexa, “Can Grandma finish reading me The Wizard of Oz?”

Prasad said: “The way we made it happen is by framing the problem as a voice-conversion task and not a speech-generation path.”

READ MORE

Beyond the initial demonstration, details were scarce. The technology was announced at the company’s re:Mars conference, focusing on its “ambient computing” achievements in the realms of machine learning, automation, robots and space.

Amazon’s aim for its voice assistant is “generalisable intelligence”, Prasad added, contrasting it with “all-knowing, all-capable, uber-artificial general intelligence” of science fiction. But other technology companies have been cautious about making digital voice doubles so easy to produce: hours before Amazon announced its plans, Microsoft published new artificial-intelligence (AI) ethics rules that would put strict limits on who could create synthetic voices and how they could be used.

“It is … easy to imagine how it could be used to inappropriately impersonate speakers and deceive listeners,” said Natasha Crampton, the company’s chief responsible AI officer.

Microsoft will require companies to apply for permission to make artificial voices, and last month began watermarking them with an inaudible signal that would allow it to identify misuse.

The concept of using AI to revive the dead – or appear to – is not a new one, even outside the realm of science fiction. In 2020 Joshua Barbeau trained a version of the GPT-3 chatbot on conversation logs with his late fiancee, Jessica, who had died eight years earlier. And in 2018 Eugenia Kuyda built a chatbot out of her partner Roman Mazurenko’s old text messages. “I didn’t expect it to be as impactful. Usually I find showing emotions and thinking about grief really hard, so I was mostly trying to avoid it. Talking to Roman’s avatar was facing those demons,” she said at the time. — Guardian