More from Ollama
Prefix caching helps coding agents stay fast as conversations grow. Prompts, tool calls, and inference routing determine how much work the model can reuse.
AI agents can now use Ollama's cloud models safely inside Fly.io's cloud computers.
Ollama now supports decision models, based on TypeSafe's Jev API for fast, typed decisions. Decision models can now be run at no cost with low latency. Based on text, decision models answer yes-or-no questions, choices and scores about it, with a probability for every option.
Meta's Muse Glimmer, the first open model released by Meta Superintelligence Labs, is now available. Muse Glimmer is a 30B multimodal model released under the Apache 2.0 license, designed for local coding agents, and accelerated by Ollama's MLX engine with new native DFlash and image input support.
Serving 8.9 million developers, Ollama has raised $88M from Benchmark, Theory Ventures, 8VC, and many incredible angel investors.
More in AI
Parenting a Newborn with AI Is Radically Different from a Few Years Ago
How to read benchmarks and what to question, from a teardown of 12 benchmarks.
Early in the coronavirus pandemic, as I sat at home channeling my anxiety into publishing daily essays on this newsletter (a streak I kept up ... Read more The post In Search of the Deep Life appeared first on Cal Newport.
Prefix caching helps coding agents stay fast as conversations grow. Prompts, tool calls, and inference routing determine how much work the model can reuse.
The tool we created to build understanding and mastery for our own internal work at Answer.AI