Seems like docker is leaning harder into compose - which is great for me as a heavy compose user. I had heard about some of the LLM enablements directly through docker desktop - for example taking fuller advantage of the host's compute power without paying the penalty of the nvidia runtime or something... I can't claim to have followed it all but I heard "run LLMs in docker directly for a bigger boost" and I'm in.
-
@Nic
3 days ago
Docker Brings Compose to the AI Agent Era | D ...
https://www.docker.com/blog/build-ai-agents-with-docker-compose/
You found my thought's a collection of short posts generally tied to a link on the web and written through a small chrome extension. See full posts on waylonwalker.com