The potential of on-device artificial intelligence (AI) is highlighted in the context of simplifying tasks like tax filing and improving productivity for consumers and enterprises. Currently, most AI applications run in the cloud, leading to technical challenges such as high latency and network congestion. Smartphone manufacturers are starting to embed AI accelerators in devices to support local AI inferencing, enabling a broader range of productivity applications.
On-device AI offers benefits such as improved network latency, cost savings, support for future AI capabilities, enhanced data security, and model personalization. For consumers, on-device AI can stimulate demand for smartphones and tablets by offering time and cost-saving applications. In the enterprise market, on-device AI can automate administrative tasks, improve user-device communication, and enhance productivity.
The future of on-device AI relies on collaboration between independent software vendors, chipset vendors, and original equipment manufacturers to optimize AI applications for hardware and address consumer pain points. The market is expected to adopt a hybrid AI approach, where AI workloads are distributed between the edge, cloud, and on-device based on commercial and technical priorities. Overall, on-device AI has the potential to revolutionize the smartphone and PC markets, offering increased efficiency, cost savings, and enhanced user experiences.
Source link
Source link: https://www.computerweekly.com/opinion/Why-On-Device-AI-Is-the-future-of-consumer-and-enterprise-applications