It is often said that the digital revolution will affect radical changes in the way people live and work, hinting at future trends. However, in Shenzhen, that future is already happening.

Shenzhen, a city of around 13 million people, last year celebrated its 40th birthday as China’s first special economic zone. The young metropolis has emerged as a world leader in the ongoing technological revolution, driven by its nascent energy.

For a glimpse into the future, a visit to the city’s Ping An Finance Center is a must. At 599 meters high, the headquarters of Ping An Insurance is the second tallest building in China and towers over all the other skyscrapers in Shenzhen. Behind the glittering glass facade, more than 20,000 people are employed, all playing their part in helping to shape tomorrow.

Voice Recognition

Wayne Hu is deputy director of Ping An Smart City Development Office as well as co-president and chief technology officer (CTO) of Ping An Smart City, a subsidiary of the group. Hu said that since its founding in 1988, Ping An has always offered much more than just insurance. The 32-year-old Fortune Global 500 Chinese enterprise recognized about a decade ago that the future will merge finance and technology.

Today, Ping An employs over 30,000 scientists and engineers worldwide, including more than 3,000 leading experts entrusted with research and development (R&D) of emerging technologies. The company’s eight research institutes and 58 laboratories are primarily engaged in fields of artificial intelligence (AI), financial technology (fintech), health technology, smart cities, blockchain, cloud computing, the digital economy, and biology.

Traditionally known for providing insurance services by much of the public, Ping An has rocketed into becoming a world-leading hi-tech company in just 10 years. Its numerous innovations will likely play a decisive role in shaping the future world, if the large volume of international patents filed by the company in recent years is any indicator. In the sector of digital health alone, Ping An now ranks second globally in terms of its quantity of published patent applications.

The company’s showroom gives an early look at what work and life in tomorrow’s metropolises may look like through displays of Ping An’s flagship products. A common feature is the organic integration of familiar things, with the new possibilities created by new technologies.

An example of this organic integration is how an AI-based customer service system can interact with customers. In a simulated demonstration, an irate customer is firmly but professionally dealt with by an AI service robot with a voice and reactions amazingly similar to a real human.

The robot is able to understand and speak a wide variety of local dialects, and can also automatically adjust its communication strategy in seconds based on customer’s reactions. According to the public relations staff, a 10-second voice sample in any language is enough for the robot to accurately imitate it and store it in the system. This new technology has revolutionized Ping An’s customer service.

“About 90 percent of over 2 million customer service calls every day are processed through our AI system,” says Hu. “Customers can request to speak to a human at any time, but surveys showed that our customers are more satisfied with the AI system than with human employees. Customers care most about whether or not their problem is solved. It doesn’t matter whether a robot or a live person is on the other end of the line,” he added.

Using AI technology in customer service has several advantages. First, unlike humans, robots are not emotion-driven. “With human employees, their state of mind can noticeably affect service quality,” says Hu. Second, the knowledge of the human staff is naturally limited. “Our service catalog is extremely extensive,” he continued. “None of our employees could possibly memorize every detail, but the AI system can make a big difference. If the information the customer seeks is in our database, the robot can always provide a precise answer.”

The system has also made several months-long employee training courses obsolete, which has led to significant cost reductions. “We previously employed 120,000 customer service agents,” says Hu. “Today, the staff size has been cut in half. Over the next two years, the number could fall further to roughly 20,000.”

This customer service system has only been used in China to date, but it could be adapted to a wide variety of foreign languages and serve other countries. Such an AI-based voice technology offers a taste of what tomorrow’s customer service will look like in major cities around the world.

Micro-Expression Analysis

Laboratories in Shenzhen are exploring much more than the human voice. Ping An researchers have also scrutinized body language and micro-expressions. Regarded as intuitive knowledge, facial expressions can communicate thoughts and convey consciousness, and AI scientists worldwide are now researching the subject. In Shenzhen, scientists are inching closer to valuable insight into the workings of the brain.

One impressive technology is a micro-expression recognition system which Ping An is using to evaluate credit worthiness. The system can detect micro-expressions by analyzing muscle movements of different parts of the face such as eyes, eyebrows, forehead, nose, and mouth. “About 44 muscles in our face work together to produce 54 types of facial expressions,” says Hu. “Micro-expressions are coordinated, involuntary motions of facial muscles and can change within a 15th of a second. By observing and analyzing these facial features, we can make precise evaluations,” he further explained.

The system was first tested four years ago in a microfinance company for credit risk assessment. According to Hu, previously, the company’s 800 offices had to schedule face-to-face meetings before lending. The new technology enabled the company to carry out online evaluations, which resulted in a marked decrease in operating costs and a 40-percent drop on the default rate,” In May 2018, micro-expression recognition technology developed by Ping An took first place in the global competition of the One-Minute Gradual Emotion Challenge held in America.

Hu said the loan applicants are first asked two sets of questions. The first set includes questions about their basic information such as age and place of residence, while the second involves queries about their income or outstanding debts. “Then we compare the facial expressions made while answering each set of questions. The results form the basis of our appraisal,” he says.

As with many innovations, the risk for misuse of micro-expression recognition is clear, admitted Hu. Ethical issues arising from the newly developed technology also demand attention. “In theory, this technology could be used in many areas,” he says. “But as far as laws and regulations are concerned, there are narrow limits to its application range. It is also clearly not in our interest for this technology to be abused. We attach great importance to our customers’ privacy, and our evaluations are all conducted on a voluntary basis.”

The system is currently utilized primarily in Ping An’s quick small loan department. It has played an important role in simplifying application procedures, especially during the COVID-19 pandemic. In a face-to-face conversation, customer service personnel can assess whether the applicant is making honest statements by observing facial expressions.

“Micro-expression recognition analysis is never the sole disqualifier either,” says Hu. “If you fail the initial test, you can still have a chance to get a loan by submitting additional documents and attending a face-to-face meeting with our customer service staff.”

Future Urban Life

Workplaces are not the only locales to be revolutionized by technological innovations nurtured in Shenzhen. The City Brain, another highlight of Ping An’s tech arsenal, could change the way urban management is performed and how urbanites go about their daily lives.

The digital data center started operation in Shenzhen in 2018 and now serves about 150 Chinese cities. One sophisticated technology used in the center is an intelligent traffic management system. By issuing digital passes upon a drivers’ request, the system has helped relieve traffic congestion during rush hour in key areas, such as popular tourist sites in Shenzhen since 2018. Big data technology can transform virtually every Chinese urban region into a smart city in the near future.

The intelligent traffic management system also features an AI-based video calling platform to manage minor traffic incidents. The platform enables citizens to report incidents, upload pictures, and quickly determine liability with police guidance through video calls. “The platform serves multiple purposes,” says Hu, adding that the affected person does not have to wait on-site for police to arrive, while traffic police can handle more traffic accidents more efficiently and thus improve service. It has also helped reduce traffic jams caused by accidents.

The City Brain also provides new possibilities for improving hygiene conditions in catering establishments. The images recorded by existing video cameras in dining areas and storage rooms of restaurants can automatically be analyzed by the AI-based data center. “Cameras have been installed for a long time, but who could ever devote the manpower to look through everything? With AI technology, we can analyze video continuously, so we could catch a rat running through a kitchen at night,” says Hu. According to Hu, food safety is an important issue in China and the feedback from citizens on this camera system has been positive. “People welcome the system because it minimizes worries for diners.”

Today, more than 12,000 restaurants in Shenzhen use the AI-based camera system. It also serves cafeterias in schools and hospitals.

Alongside inception and development, many technological innovations are also tested and improved in Shenzhen. “Residents of this young, inclusive city have open minds about new products and services,” says Han Wangxi, director of the Publicity Department of the CPC Shenzhen Municipal Committee, who is also the director of the Shenzhen Innovation and Creative Design Development Office. “As China’s first special economic zone, Shenzhen has always stood ready to embrace changes, and the spirit of openness facilitates cultural and technological innovation. Seeking reform and innovation, people in this city are driven by their eagerness to pursue knowledge.”

Ping An plans to increase its R&D investment, and the industry giant has already taken the first steps towards AI-created art. AI-generated art, ranging from impressionist oil paintings to Chinese watercolor landscapes, is already a reality, along with musical compositions of various genres played by a digital jukebox. From jazz to classical and pop, robots create the music after infinite hours of listening.

Technology’s rise in the tallest building in Shenzhen is a reality. Research into the application of new technologies to improve the work and life of humanity is just beginning. Where it leads us is worth watching. One thing appears clear: The innovation powerhouse of Shenzhen will play a key role in shaping the future.

The author is a writer with China Today.