In an intriguing exploration of artificial intelligence capabilities, Joanna Stern from The Wall Street Journal embarked on a unique challenge to see if an AI clone could replace her for a day. Utilizing advanced AI tools from startups Synthesia and ElevenLabs, Stern created a digital avatar and voice clone to perform tasks ranging from phone calls to creating social media content. Despite mixed results in fooling humans across various challenges, the experiment shed light on the potential and limitations of current AI technology in mimicking human interactions and raised important questions about security and authenticity in the digital age.
Joanna Stern utilized AI tools to create a digital avatar and voice clone resembling herself, intending to explore if AI could replace her for a day.
The AI avatar was created by Synthesia, requiring Stern to record various head movements and scripts, while ElevenLabs provided a more realistic voice clone after processing hours of Stern’s audio recordings.
The challenge included four tests: making phone calls, creating a TikTok video, bypassing bank biometrics, and participating in video calls, with varying degrees of success.
While the AI managed to pass as Stern in phone calls and tricked a bank’s voice verification system, it failed to create a convincing TikTok video and was easily identified as artificial in video calls.
The experiment highlighted the potential of AI in replicating human-like interactions but also pointed out the current limitations, such as lack of natural body movements and facial expressions in avatars.
Concerns were raised about the misuse of such technology, especially in scenarios involving personal security and fraud, prompting discussions on the need for vigilance and regulatory measures.
Synthesia and ElevenLabs stress the importance of consent and ethical use of their technologies, with mechanisms in place to prevent unauthorized use of digital voices and avatars.
The Wall Street Journal is an American business and economic-focused international daily newspaper based in New York City. The Journal is published six days a week by Dow Jones & Company, a division of News Corp.
The Wall Street Journal is an American business-focused international daily newspaper headquartered in New York City and published by Dow Jones & Company, a division of News Corp. It is one of the most widely circulated newspapers in the United States, renowned for its comprehensive financial journalism, deep market analysis, and corporate reporting. Alongside its objective news gathering, the WSJ is also well-known for its separate editorial board, which generally advocates for free markets and conservative economic policies.
