Shinhan Bank’s AI-powered bank teller
Shinhan Bank
In South Korea, AI avatars are everywhere. They offer detailed product information in supermarkets, conduct lessons for students, and provide in-depth explanations of insurance products, including personalized investment advice.
DeepBrain AI — a Seoul-based company specializing in hyper-realistic AI avatars — has implemented its technology across diverse sectors in the country. DeepBrain’s avatars, appearing in retail, education, banking, and financial investment sectors, are enabling the public to see and experience AI more directly, thereby bringing the average consumer closer to the latest generative AI advancements.
Also: Want to clone yourself? Make a personal AI avatar – here’s how
However, the rapid growth of AI avatars raises concerns about job loss due to automation and privacy risks from data misuse. Experts warn that these technologies — without proper safeguards — could increase job insecurity and compromise personal data. Responsible development and regulation are essential to address these challenges.
Let’s look at how the implementation of AI avatars is playing out in each sector.
An AI avatar greets customers from a large touch screen at a store entrance.
DeepBrain AI
AI avatars transform shopping in unstaffed markets
Since 2022, DeepBrain AI has been pioneering an unmanned convenience store in the nation’s capital. The store’s AI avatars — engaging in real-time, two-way communication — provide customers of the Seoul 7-Eleven with a service experience that aims to mirror human interaction.
DeepBrain AI has integrated voice synthesis, video synthesis, natural language processing (NLP), and speech recognition to create an advanced “conversational AI technology.”
The process is straightforward. When a customer enters the unstaffed store, an AI avatar greets them from a large touch screen at the entrance. If asked, the avatar can provide customers with detailed information about all products available in the store. Shoppers can browse items ranging from beverages and snacks to ready-to-eat meals and daily necessities. The avatar also informs customers about ongoing promotions, discounts, and special offers. Additionally, the avatar can provide practical information like the weather, directions to nearby restrooms, the nearest subway station, and the current time.
According to DeepBrain, the AI avatar-powered convenience store offers value to customers and store owners. For customers, it offers a streamlined shopping experience, helping them find products without the need to wander through aisles. The avatar delivers promotional information, aiming to reduce the chances of miscommunication that can occur with human employees.
For store owners, the AI avatar can help mitigate concerns about inconsistent employee performance. It can also cut labor costs by more than tenfold compared to traditional staffing. Also, the AI avatar helps avoid customer complaints that might arise from interactions with human staff, although there may also be new complaints about AI interactions.
AI bank tellers serve customers
Increasingly, in major banks across South Korea, AI avatar technology is taking over roles traditionally performed by human workers. These avatars manage a variety of tasks at busy bank counters. Korean customers are relying on AI avatars to help manage their finances — from answering financial questions to receiving personalized loan recommendations.
This July, Shinhan Bank introduced AI-powered bankers designed to closely resemble their human counterparts. To create these avatars, DeepBrain AI employed its deep learning-based “AI Human Technology,” which combines voice, video synthesis, and financial data.
Unlike generic virtual models, these AI bank tellers are based on actual Shinhan Bank employees. Five staff members, including those recognized for outstanding customer service, were chosen as models. This approach enhances the realism of interactions; customers feel as though they’re speaking with real people, DeepBrain says, thereby elevating the quality of customer service.
Also: These AI avatars now come with human-like expressions
The selected employees were filmed at DeepBrain AI’s “AI Human Studio”; the process captured their detailed appearance and lip movements to create high-quality virtual avatars that exhibit a variety of gestures — like greetings and smiles — tailored to different conversation topics. Even the employees’ voices have been enhanced to sound as friendly and approachable as possible
Currently, these AI bank tellers are deployed across Shinhan Bank branches nationwide in two forms: Digital Desks and Smart Kiosks. Digital Desks can handle 64 types of customer interactions, including opening savings accounts, applying for credit loans, and executing loans secured by deposits. Smart Kiosks provide 70 kinds of guidance on using the machines, introduce financial products, and offer directions to other kiosk locations.
Samsung Securities
AI analysts deliver real-time investment insights
Samsung Securities has introduced an AI analyst that delivers real-time investment information, now featured on the company’s YouTube channel. This virtual analyst was developed — in collaboration with DeepBrain AI — by training an AI model with the appearance and voice of an actual company analyst.
Also: Synthesia 2.0 reinvents AI video creation for businesses
The AI analyst relays investment data during broadcasts, with Samsung Securities feeding it the necessary information. To help ensure a natural and polished delivery, Samsung Securities employs a patented voice synthesis model, enhancing the overall quality of the broadcasts. Currently, Samsung Securities’s AI analyst offers YouTube content on domestic and international market conditions.
The process is straightforward: When a person inputs financial data or investment information, the AI analyst understands it and automatically generates a script, delivering it as if a real analyst were presenting. The virtual analyst explains the investment details in a natural, human-like manner. In other words, in response to a text prompt. the AI analyst can provide investment insights.
In this way, human analysts can focus more on their core tasks, such as market research and institutional client seminars, while the AI analyst handles timely YouTube broadcasts, thereby improving research efficiency and customer satisfaction.
AI tutors enable learning anytime, anywhere
AI avatars have entered the Korean education sector, offering a more affordable alternative to traditional learning methods. These AI educators can teach any subject, anytime, anywhere. SpeakNow, an English language education company, has integrated DeepBrain AI’s technology into its platform.
Also: 88% of US parents see AI as essential to their children’s education – survey
Catering to beginning, intermediate, and advanced learners, the platform offers more than 350 topics, ranging from everyday conversations to business communication Learners engage in one-on-one conversations with an AI tutor. SpeakNow recommends the AI tutor for those who feel uncomfortable speaking with native speakers or have faced cost barriers in their English-learning journey.
AI tutors are teaching a variety of subjects beyond English, including math, history, and science. In an effort to make the teaching process engaging and entertaining, some popular Korean YouTubers have been transformed into AI tutors.
KyoWon has integrated AI tutors into its teaching environment.
KyoWon
KyoWon, one of Korea’s leading education companies, has also integrated AI tutors into its teaching environment, including AI versions of the popular YouTuber “Dotty.” KyoWon’s AI tutor combines voice synthesis, video synthesis, NLP, and speech recognition capabilities, enabling real-time, two-way communication with students.
Also: Have a global audience? This AI video platform translates your content in one click
In virtual classrooms, AI tutors welcome students, offering personalized, one-on-one learning experiences. If a student asks a question via text or voice during the lesson, the AI tutor can respond immediately. By featuring celebrities as AI tutors, the platform enhances student engagement and immersion.
Challenges and ethical concerns
While AI avatars offer numerous benefits, their rapid proliferation in South Korea also raises several challenges and ethical concerns. One major issue is the potential loss of jobs due to automation. The use of AI avatars in supermarkets and banks could lead to significant layoffs, particularly in roles traditionally filled by entry-level or customer-facing employees.
“This trend might increase job insecurity and inequality, disproportionately affecting those less able to transition into new types of employment,” notes Mihye Kim, a freelance AI developer based in South Korea. “It’s important for companies like DeepBrain AI to consider how they can help create new opportunities for these workers as they advance the technology.”
Also: Google’s VLOGGER AI model can generate video avatars from images – what could go wrong?
The widespread use of AI avatars also raises privacy concerns. These avatars can process and store vast amounts of personal data to provide tailored services. However, this data collection poses risks if not managed with stringent security measures, as malicious actors could exploit it.
“Companies using AI should establish AI ethics committees to prevent such unfortunate incidents,” stated Taeuk Kang, an attorney with Bae, Kim & Lee LLC. “These days, some are creating frameworks of principles that must be followed when employing AI. However, the details are still lacking. Collaboration between business leaders and legal professionals could help prevent these mishaps.”
Addressing these challenges is crucial to ensuring that AI avatars are developed and deployed responsibly. South Korea’s rapid adoption of this technology must be balanced with thoughtful regulations and safeguards to protect workers, ensure data privacy, and maintain public trust.
