I predict that on premises AI / LLMs will significantly grow as a focus area in the coming years as models get better, and compute (especially with unified memory) continues to get better. In conjunction, I predict that currently subsidised cloud AI / LLMs will become enshittified with ads as they desperately seek to become profitable.
Here is just one recent bit of vendor action in this burgeoning market. https://www.koreatimes.co.kr/business/tech-science/20260308/lg-uplus-furiosaai-to-build-on-premise-sovereign-ai-appliance