Proposed by: Ravishanker
Conquering GenAI with FOSS
This talk will immense the audience into the LLM world with the help of https://jan.ai/
What is JAN?
JAN is a open-source local LLM client which will run local LLMs on almost all platforms.
Things to be covered in the Talk:
- Introduction to LLMs.
- Introduction to Local LLMs.
- What is JAN and Why JAN?
- Setting up JAN.
- Loading different Models into JAN.
- Limitations of JAN.
- Overcoming the Limitations of JAN.
- Loading custom models from Hugging Face to JAN.
- Building APIs with JAN.
Outcomes from the Talk:
The audience will get to know about what the FOSS world has to offer in the LLM world other than just ChatGPT and Gemini. They will get to know how to run an open-source LLM locally and even build projects with the help of APIs that JAN offers.
Source code/Reference: https://github.com/janhq/jan
Talk duration: