How to Build an AI Chatbot on Your Own PC in Under an Hour, Including RAG!

This technical presentation aims to equip attendees with the knowledge and practical skills to construct their own chatbot using large language models (LLMs). We will delve into the various software options available for hosting your own LLM, eliminating the need for complex infrastructure considerations.

Plus, we will discuss strategies for extending or growing the capabilities of your LLM, including the implementation of Retrieval-Augmented Generation (RAG).

Lastly, we will demonstrate how to call the large language model from RPG or Db2 programs on IBM i, bridging the gap between traditional IBM i programming and modern AI technologies.

By the end of this presentation, attendees will be able to build their own AI chat interface using large language models, fostering innovation and efficiency in their IT environments.

Jesse Gorzinski

Senior Business Architect - Open Source Software on IBM i

IBM

Jesse Gorzinski works for the IBM i development lab in Rochester, MN. He is the Business Architect of open source technologies. Jesse, who was doing RPG programming at the age of 18, is an expert on application development on IBM i, as well as system access and modernization. His hobbies include playing with his dog, replacing complex applications with 5-line Python programs, and advocating for the use of new technologies on IBM i!Prior to his 2006 employment at IBM, Jesse worked with the AS/400 as an I/T administrator for an IBM customer in the finance/mortgage industry, where he specialized in data backup/recovery, process optimization, and information integrity. He has a Bachelor's degree in Computer Science as well as a Master of Business Administration degree