Teams AI Library Blog Series: Episode #1 – Setup A Teams AI Library-Based Application to Reason Over SharePoint Content with Azure AI Search


Introduction

This article is the product of discussions that occurred at a recent Microsoft 365 PnP Dev community call.

On the call. several discussions were asking to have content around setting up a Teams app. The Teams App should be able to use Generative AI (Ideally with the Teams AI library) that can reason over content in a SharePoint Document library.

Back in December, I built a little app from one of the Teams AI library samples to do just that. I had been thinking about authoring this article for a couple of months but thought that someone else would do it.

Anyway, I have not really found anyone who has put something out there quite like this. Yes, there are lots of articles about Teams AI and Copilot Studio but not quite like this one, so here it is.

The Teams AI library is a fascinating toolset and enables developers with relative ease to be able to create Teams-based Chatbots which integrate with Open AI or Azure Open AI Services to deliver solutions using Generative AI.

The nice thing about the Teams AI library is the way that you can build the prompts to deliver clever applications. Do not believe me? Check out the Twenty Questions sample.

Last year, one of the projects that I wanted to build, was to create a bot that can consume SharePoint content via Azure Open AI Services through Azure AI search. The problem was that when I came to look at this, no abstract or example referenced allowed you to use Azure AI Search with Teams AI library.

This article is part of a series of blog series which will describe how to get this all set up and show you how an extension to the library to be able to use Azure AI Search. As I started authoring this article, I realised that it would be quite overwhelming as one article, so I have split it up into a blog series.

To help consume this content there will be the following articles:

Let’s get into it.

Solution overview

The beautiful thing about the Teams AI Library is that it handles a lot of the complexities of chatbots for you.

For example, AI-powered chatbots work better if they have the history of the conversation included as part of the prompt. This way they are more natural to use, less annoying and behave in the way that you would expect.

Of course, the Teams AI Library has a mechanism for reasoning over content. It uses the Retrieval Augmentation Generation (RAG) pattern to take a user’s natural language prompt, extract the intent and pass that to a data source for extract of results and bringing those results back to the LLM for a natural language response to the user.

In Teams AI Library these are called data sources and there is an interface provided that you can implement.

However, the samples that I have seen implemented are for a local file system of files. Now, I want to be able to use the data source from an Azure AI Search for these queries. By doing this we can access content hosted in SharePoint, Azure Blob Storage and a whole lot more using third-party connectors.

So, I built this abstraction, the AzureAISearchDataSource which implements the DataSource interface and allows you to use Azure AI Search as the data source.

What is more, I have shared this library with you via my GitHub repository. This has the current implementation and will be updated as required.

In the rest of this post, I will explain the steps that are needed to build and deliver this solution. The solution includes the setup of:

  • SharePoint Document Library.
  • Azure AI Search
  • Azure AI Search Indexing
  • Building the Microsoft Teams application.

I will say that the landscape is moving quickly so where possible I have referred to Microsoft articles to help describe the steps. Hopefully, that way if something changes, you’ll still be able to continue setting up the solution.

However, if it is not clear please reach out to me.

I am assuming that you already have your SharePoint content setup that you wish to reason over, with your GPT model.

Next Steps

In our next post, we will start you on your journey by setting up the Azure AI infrastructure for your solution.