ByteDance saw usage of its Doubao large language models (LLMs) rise more than tenfold this year, as more enterprises in China adopt artificial intelligence to increase productivity and reduce operating expenses, according to the head of its cloud computing services unit.
“AI is being adopted at an unprecedented speed, and how to make better use of it has become a question all businesses have to answer well,” Tan Dai, president of ByteDance cloud unit Volcano Engine, said in Shanghai on Thursday.
Doubao’s average daily token usage exceeded 50 trillion tokens this month, up from 4 trillion tokens in December 2024, according to Tan.
Advertisement
Tokens are the basic units of data processed by AI models – comparable to a pixel in an image, a snippet of sound or a word in a sentence. One English word was worth 1.3 tokens, while a Chinese character amounted to 2.5 tokens.
For chatbots, a billion tokens equates to around a million conversations. Tokens are also the standard billing units for using LLMs through application programming interfaces (APIs).
Advertisement
Without naming specific clients, Tan said Volcano Engine has more than 100 corporate clients that have used more than 1 trillion tokens to date.
That volume of activity underscored how overall token consumption by businesses across mainland China has continued to grow in the country’s fast-developing and highly competitive AI market.