Ciao from Italy! This issue of AI Elixir is being penned (errr….typed) on a train bound for Florence. My Italian vacation has me thinking a lot about language, communication and translation and how we can make our customers’ experiences better and more seamless using some of the new AI tools that are becoming available.

Andiamo al dunque!

GenAI for Language Translation

GenAI chatbots like ChatGPT and Google Gemini are great starting points for exploring text based language translation. (In most cases you can just create a simple prompt asking the AI to translate the text you paste in to your desired language.)

But, when asked directly, even ChatGPT understands that language translation is tricky and in most cases a human is still a necessary part of the solution. (See below.)

Experiment now! It very important to be knowledgeable of current capabilities so you can track their progress against your specific needs. Remember that the proficiency we are seeing today from these tools is the worst they are every going to be.

“Text to Speech” and “Speech to Speech”

ElevenLabs is an advanced GenAI audio platform specializing in voice synthesis and speech technology. It enables users to generate high-quality, natural-sounding speech from text (or audio) in various languages. The platform is widely known for its ability to produce realistic voices, allowing for custom voice creation, cloning, and modification, making it a popular choice for content creators. Whether for advertising, blog content, or media production, ElevenLabs delivers fast, accurate, and lifelike voiceovers that enhance user engagement and content accessibility.

Tools like ElevenLabs that offer Text to Speech and Speech to Speech capabilities are making it easier than ever to produce audio content in a large variety of languages allowing marketers to serve a wider audience more efficiently thus enhancing your consumer experience and your customers’ opinion of your brand.

Term of the Week

Better Video Dubbing

Lipdub.ai ensures that the lip movements in videos are perfectly matched with the chosen audio, creating the illusion that the subject is speaking natively in the selected language. It is ideal for content creators and marketers attempting to produce natural looking video content in multiple languages with minimal effort.

In the past there was no easy way to sync a second (or third or fourth) audio track to specific video content without very careful voice acting (or reshooting the material with different actors). Tools like Lipdub.ai will allow marketers the ability to create more natural looking content for all consumers and not just those who speak the most popular language in the area. This is especially important when dealing sensitive health & wellness topics.

What’s Next?

Here’s an Upcoming Event to Check Out!

Arrivederci! See you next week.

A graphic designer by training, Dan’s career includes pivotal roles leading teams through every major advertising and marketing technology sea change of the last 30 years from the origins of interactive media and the world wide web to ecommerce, mobile, spatial computing and now artificial intelligence, Dan thrives on bringing new and never-been-done-before solutions to his clients.

Dan’s impressive client portfolio includes collaborations with industry giants and pioneers such as Apple, Barnes & Noble, Burton Snowboards, Ford Motor Company, Home Depot, Nike, P&G, Sherwin Williams, and Walmart.

Parallel Path is the proven guide for leading health and wellness brands who are ready to explore inventive and high-performing marketing strategies. We’re dedicated to working with brands who pursue wellbeing and defy conventions.