The AI bill is coming due. Businesses are learning tokens aren’t free

KPMG's upcoming survey, reported by The Wall Street Journal, indicates that only 25% of companies possess a comprehensive understanding of their artificial intelligence expenditures. Approximately half of businesses have partial visibility into AI costs, while 20% lack any insight until invoices arrive. Steve Chase, KPMG's global head of AI, highlighted that AI represents a novel resource experiencing exponential growth, necessitating new management strategies. The complexity of AI cost attribution stems from the token, the fundamental unit of AI processing, which represents fragments of text, code, or data. Tokens do not directly correlate to words and can be cached, leading to unpredictable billing cycles. This ambiguity results in significant, often unexpected, expenses for organizations. KPMG is assisting companies that have depleted their annual token and cloud computing budgets within months, with one client experiencing a sixfold increase in token usage. Axios reported that a client of an AI consultant incurred $500 million in a single month due to unchecked employee access to Claude licenses. Sam Ransbotham, a professor at Boston College, noted that the disconnect between product users and those responsible for payment contributes to these substantial bills.