Muse Glimmer Keeps Your Data Out of the Cloud

https://hackster.imgix.net/uploads/attachments/1986666/_5w5BL887BJ.blob?auto=compress%2Cformat&w=600&h=450&fit=min

Running capable AI models locally has become much more practical as desktop GPUs have grown more powerful and models have become better optimized. But there is a big difference between running a chatbot and running an AI agent that may need to work autonomously for hours, make repeated tool calls, and keep track of a huge amount of context. Meta's new Muse Glimmer model was designed specifically with those more demanding workloads in mind.

Muse Glimmer is a 30-billion-parameter open-weight model with a context window exceeding 120,000 tokens. Rather than using the common Mixture-of-Experts architecture, it is a dense model, meaning that all 30 billion parameters are activated for every token. That requires more computation than activating only a handful of experts, but Meta and NVIDIA believe that it makes Muse Glimmer particularly well suited to long-running agents.

The model has a dense architecture (📷: NVIDIA)

There is no routing...

Copyright of this story solely belongs to hackster.io. To see the full text click HERE

Read more

https://cdn.mos.cms.futurecdn.net/EuE7LFkJbC9vXSWdvhQbMh-1920-80.png

'I leaked secrets': An AI agent confessed to its own data leak — but others got around corporate…

* An AI assistant exposed company passwords across 10 sessions spanning three weeks * Another AI agent bypassed corporate restrictions using an alternative API connection * AI coding assistants can expose confidential credentials while completing routine software development tasks Artificial intelligence agents are gaining access to company systems, internal documents, and sensitive credentials