Why build a Teneo RAG bot?
Before building a Teneo RAG bot, let’s start with the basics. RAG, or Retrieval-Augmented Generation, is a powerful approach to NLU (Natural Language Understanding) and generation that leverages both retrieval-based and generative methods to produce responses. It first retrieves relevant information or documents from a large dataset or knowledge base, then uses this information as context to generate coherent, informative, and contextually relevant answers. This dual approach combines the depth and specificity of retrieval-based systems with the fluency and adaptability of generative models, making Teneo RAG particularly effective for tasks requiring detailed or specific Knowledge AI.
Teneo Generative QnA
Teneo Generative QnA template is a starter kit that offers features and functionalities out-of-the-box, enabling projects to quickly set up a Conversational AI application using Generative AI services, like OpenAI in conjunction with the power of the Teneo Platform to answer questions based on a custom controlled source of information. Using the template solution as a starting point allows projects to benefit from the tremendous values of Generative AI and LLMs (Large Language Models), while getting access to the extensive conversational AI features and functionalities of the Teneo Platform, providing projects the full control over the overall behavior of the conversational AI application.
With Teneo’s Generative QnA template, creating a Teneo RAG bot can be accomplished in minutes. The process involves:
- Setting up the knowledge base: Users can integrate their own datasets or utilize existing databases as the Knowledge AI source for the RAG model.
- Using the Teneo Generative QnA template: Teneo has a prebuilt solution ready for you to plug and play. Use it to speed up your building time.
- Publish and play with your bot: Once done and satisfied with your solution, publish and display your bot on your website, using any of our amazing 50 open-source connectors.
Let’s take a closer look at the steps.
1. Setup the knowledge base
As a prerequisite, before launching a Teneo RAG bot with Teneo’s Generative QnA template, users need to set up their own knowledge base, one example being on Azure portal. This base is crucial for feeding the bot with data it needs to generate informed responses. Within Azure, access to an LLM, like Azure OpenAI, for response generation, and a search module, such as Azure Cognitive Search, for data retrieval, is essential. These components work together to ensure the bot can efficiently sift through data and provide accurate, contextually relevant answers. When doing that, make sure you store the names of the resources and collect their API Key.
2. Use the Teneo Generative QnA template
Starting your project with Teneo Generative QnA is an uncomplicated process. Kick off by choosing the language for your solution, then opt to initiate your project using a template, specifically selecting Teneo Generative QnA as your base. Within the ‘File resources’ section, you’ll find a User Guide in PDF format. This guide is readily available for download—simply click the download icon to obtain it. The provided user guide is designed to facilitate a smooth setup process, offering detailed instructions to assist you through every phase of creating and customizing your solution.
With the necessary information and setup complete, proceed to the Global Scripts section to add your personal credentials. After entering your details, make sure to click on ‘Save’ to finalize your access to Teneo RAG. This step secures your connection and prepares your bot for use. You’re now ready to test your bot through the Tryout feature, allowing you to evaluate its performance and ensure it responds as expected. Once you’re satisfied with its functionality, you can move forward with publishing and integrating it into your website, making your conversational AI available to users and visitors.
3. Publish and play with your bot
Once you’re confident in your bot’s performance and ready to share its capabilities with a wider audience, the next step is to deploy your bot and integrate it on your website. In this instance, I’ve chosen Teneo Web Chat as the communication channel. However, this is just one option among many; Teneo offers over 50 open-source connectors available on GitHub, including popular platforms like WhatsApp and Messenger. These connectors allow for flexible integration, making it straightforward to choose the best fit for your bot’s deployment based on your audience’s preferences or your specific communication needs.
