Apple, known for its secretive approach, has released OpenELM, a family of small language models designed for memory-constrained devices. These models outperform others of similar size and are resource-efficient, using techniques like Flash Attention and non-uniform structure. Apple’s open release of OpenELM, including model weights and training logs, aims to empower the research community and corner the on-device AI market. Apple’s control over hardware and software optimization gives it an edge in on-device inference, attracting developers to create applications for the Apple ecosystem. However, competition from companies like Microsoft, which is also investing in small language models, poses a challenge. The future of the generative AI market remains uncertain, with potential for parallel markets and multiple dominant companies.
Source link
Source link: https://bdtechtalks.com/2024/04/29/apple-openelm/amp/
#Insights from OpenELM language models on Apple’s AI strategy. #GenerativeAI
Preeti
1.6k Views
0 Votes
GIPHY App Key not set. Please check settings