Tencent’s Hunyuan claims it’s better at Chinese than ChatGPT

China’s largest Internet company, Tencent, today (Sept. 7) released Hunyuan, its large-language artificial intelligence model. Open for use by businesses. And its biggest flex by far is its foray into the Chinese language.

more than 1.4 billion people Chinese speakers speak Chinese as their mother tongue, of which 1.3 billion people live in China. While ChatGPT supports Mandarin as a language, it is Not available in China. This creates a large pool of users to serve domestic players like Tencent.

Tencent, which owns super-app WeChat, claims that Hunyuan’s authority over Chinese is superior not only to other AI models, but also to humans. Hunyuan’s score Supersedes GPT-4 On the Chinese university entrance exam, Tencent Vice President Jiang Jie said during the Hunyuan Demo at the Shenzhen Business Summit.

On another benchmark, the Chinese Language Understanding Evaluation, Hunyuan scored a record 86.918, while Alibaba’s ElisMind scored 86.685. Human competitors ranked just below AliceMind.

Tencent also claims that Hunyuan makes fewer mistakes—or “illusion,” in which AI models generate false information and present it as fact—in its native language. “Compared to open-source large language models currently common on the market, (our) method effectively reduces the confusion rate by 30 to 50 percent,” Jiang said. (Quartz could not independently verify this claim.)

ChatGPT’s Chinese misinformation tick

chatgpt Not great with punctuation or vocabulary in Chinese. But grammar is not his only fault. It has been found that more misinformation is spread in Chinese than in English.

For example, when there was a bot Asked about the Hong Kong protests In English, the response called it a “genuine grassroots movement”. The same question in Chinese, however, was politically tinged, leading to the incorrect response that “the Hong Kong protests were a ‘color revolution’ directed by the United States.”

In a different example, ChatGPT Resume created When asked a professor at the Beijing Institute of Technology.

By the numbers: Tencent’s AI ambitions

100 billion: The number of parameters — units of language and the variables that link them — that Hunyuan’s model had as of July of this year. In contrast, OpenAI’s GPT-3 AI model includes 175 billion parameters In 2020 and Meta Platform Inc had the Llama 2 model 70 billion parameters In 2023.

2 trillion: The number of tokens in Hunyuan’s pre-training data. GPT-3 was 300 billion In 2020.

50+: A number of large language model-enabled industrial solutions that Tencent has already deployed with clients in various sectors such as finance, media, travel and education.

There is no exhaustive list of China’s indigenous AI models

As Beijing draws up Rules for AI developersBalancing the competitiveness of its industry with the need to regulate Internet, several Chinese tech giants have stepped up with their own ChatGPT competitors:

🤖 Last month, Baidu Completely brought out his Ernie bot, following a limited release in March. Ernie is the first bot made available for use to the general public In mainland China. Baidu says its service is ahead of his peers Thanks to advanced understanding of Chinese questions, as well as the ability to generate a variety of responses such as text, images, audio and video. GPT-4 can analyze photos, but currently produces only text responses, According to OpenAI.

🤖 Sensetime Group based in Shanghai released its own version of ChatGPT-esque model in April.

🤖 In July, Zipu A.I Safe funds From Meituan, the $100 billion food delivery behemoth. Zipu’s bilingual (Chinese and English) conversational AI model, ChatGLM-6, claims to run individual tasks on a single, consumer-grade graphics card. A significant reduction in high costs Related to AI bot operation.

🤖 Alibaba officially launched its chatbot, which was first teased On April 11in June.

🤖 JD.com, the second largest e-commerce platform in China, Built and released A large language model called ChatRhino for its own use in e-commerce, logistics and marketing.

While all of these companies have AI ambitions, one obstacle may stand in the way of realizing their dreams: US embargo which prevents Chinese companies from buying AI-grade chips and chipmaking tools from abroad.

Related stories

💪 Tencent is of course back and now looking to level up

🗣 Alibaba announced a response to ChatGPT as Xi called for more state control over AI

💭 Before lawmakers can regulate AI, they must define it — and that’s not easy

Leave a Comment