This talk examines using open-source LLMs for real-world purposes. It compares the benefits and drawbacks of open-source LLMs. The discussion covers the economics of fine-tuning and hosting open-source LLMs, highlights serving frameworks, and overviews key open-source LLMs.
Speaker
Andrey Cheptsov
Founder and CEO @dstack, Previously Product Manager @JetBrains
Andrey is the core contributor to dstack. He is passionate about open-source and AI. Previously, Andrey worked at JetBrains, incl. the PyCharm team.
