Qualcomm is introducing its Snapdragon 8 Elite Gen 6 SoC arsenic good arsenic the Snapdragon 8 Elite Gen 6 Pro astatine its annual Snapdragon Summit connected September 22.
Ahead of that event, contiguous the institution is teasing the improvements it's made to 1 of the chips' Hexagon NPU (presumably we're talking astir the Hexagon NPU of the Snapdragon 8 Elite Gen 6 Pro).
This is built for agentic AI, with a transformer-focused Element Accelerator and a 50% larger shared representation that "keeps often accessed exemplary information adjacent to the NPU" truthful that agents "can enactment responsive arsenic they juggle longer context, much tools, and concurrent tasks". So you tin expect reduced representation bottlenecks and "faster, much responsive agentic AI experiences".
The Element Accelerator is "purpose-built for the transformer workloads that powerfulness modern generative and agentic AI", and unneurotic with the scalar, vector, and matrix extensions, it accelerates the operations that substance astir for ample models, helping agents respond faster, arsenic good arsenic crushed much efficiently and "deliver richer experiences without compromising mobile powerfulness efficiency".
Qualcomm besides says the caller NPU has up to 50% faster prefill for INT4 models, and it's precise good suited to Mixture-of-Experts (MoE) models which lone activate a fraction of their parameters per token. The caller Hexagon NPU is "designed for always-running AI, long-context reasoning, multimodal models, concurrent agents, and low-latency enactment loops".
English (US) ·