Generative AI

AITH02 Avoid Common LLM Pitfalls

11/21/2024

8:00am - 9:15am

Level: Intermediate

Mete Atamel

Developer Advocate

Google

It's easy to generate content with a Large Language Model (LLM), but the output often suffers from hallucinations (fake content), outdated information (not based on the latest data), reliance on public data only (no private data), and a lack of citations back to original sources. Not ideal for real-world applications. In this talk, we'll provide a quick overview of the latest advancements in multi-modal LLMs, highlighting their capabilities and limitations. We'll then explore various techniques to overcome common LLM pitfalls, including Retrieval-Augmented Generation (RAG) to enhance prompts with relevant data, ReACT prompting to guide LLMs in verbalizing their reasoning, Function Calling to grant LLMs access to external APIs, and Grounding to link LLM outputs to verifiable information sources, and more.