@Nic's thoughts

2025

Seems like docker is leaning harder into compose - which is great for me as a heavy compose user. I had heard about some of the LLM enablements directly through docker desktop - for example taking fuller advantage of the host's compute power without paying the penalty of the nvidia runtime or something... I can't claim to have followed it all but I heard "run LLMs in docker directly for a bigger boost" and I'm in.

https://www.docker.com/blog/build-ai-agents-with-docker-compose/