Using AI applications such as ChatGPT from OpenAI is easy and many have already gained experience using it. Obvious applications like creating or re-writing text already have a nice integration with Drupal.
However, the real value of “Large Language Models” (LLMs) lies in building custom applications for clients using their data and tailoring the applications to their business processes.
Building such applications is difficult, because you quickly learn what the pitfalls of public LLMs are and you will need to customise them to fit your needs.
In this session we will first give a high level overview how LLMs work so the attendees understand where public models can be used and where customising starts.
For customising we will focus on “In-context Learning” and “Retrieval Augmented Generation” (RAG) because this provides the highest value when building your own applications. Other concepts like fine-tuning, embeddings, or pre-training will only be discussed in a high-level context of how to use LLMs in general.
To illustrate such a customised application an engaging AI with Drupal will be presented, that suggests sessions from Drupal Developer Days 2024 to the users (Yes, using live session data!). The AI demo will be made available to the attendees of the session and also to all attendees of the conference.
Based on the demo we will discuss the shortcomings of public LLMs such as complexity and cost and how we can overcome them. The attendees can use these findings for optimising their own applications.
To wrap up the session an ideation process for inventing useful AI applications will be presented, and some ideas for solutions will be shown to inspire the attendees when they discuss potential use cases of AI with colleagues and partners.
Attendees will learn
- how does AI work (high-level),
- what is possible with LLMs,
- what are the shortcomings of pre-trained transformers,
- what are the costs associated with integrating AI and how can they be optimised,
- what are the most (cost / resource) effective ways to use LLMs,
- and what AI providers exist.
Attendees will be inspired by an engaging demo application and will maybe get ideas for their own AI applications.