Leveraging Open-Source LLMs for Production

code red code red

This talk examines using open-source LLMs for real-world purposes. It compares the benefits and drawbacks of open-source LLMs. The discussion covers the economics of fine-tuning and hosting open-source LLMs, highlights serving frameworks, and overviews key open-source LLMs.


Andrey Cheptsov

Founder and CEO @dstack, Previously Product Manager @JetBrains

Andrey is the core contributor to dstack. He is passionate about open-source and AI. Previously, Andrey worked at JetBrains, incl. the PyCharm team.

Read more
Find Andrey Cheptsov at:


Thursday Sep 26 / 02:30PM CEST ( 50 minutes )


Ballroom A