AI✨

IGNITE UPDATE NOVEMBER 2023

🚀🚀🚀 In connection to the Copilot Studio Announcement at Ignite 2023 we have VERY exciting news for Timon! 🚀🚀🚀

Your friendly little "Teams, M365 and beyond " Copilot, Timon, is getting an AI-boost!

First of all, you need to know about the current state in November 2023. Basically, there are two options to supercharge your Timon with AI✨:

Option 1 - Timon AI Hybrid - Using your private Azure OpenAI service in your tenant (Multiple languages available)

$200/month + $3.5/1000 responses*

• Timon with Azure OpenAI + Human knowledgebase
• 10+ language interfaces
• Multi-language responses when using AI, regardless of language interface
• Your own framing (copilot personality and behavior)
• Data stays in your tenant
• Azure subscription and Azure OpenAI service needed for AI to run in your own tenant
• Knowledge is basically unlimited = Azure OpenAI GPT model can handle any topic. Like ChatGPT, knowledge training data has a cutoff date of September 2021 for GPT 3.5 Turbo, and April 2023 for GPT 4 Turbo (preview)

Option 2 - Timon AI Only - (U.S. region and English only)

$200/month*

• Timon with Microsoft Copilot Studio integrated Azure OpenAI service.
• English only
• United States is required as a region for your copilot
• Data processed in US
• Azure subscription is optional (not required)
• In default configuration: Knowledge is based on your choice of data sources, not the Azure OpenAI service. (This means that evergreen live public URL sources, internal SharePoint sites, internal OneDrive links, and more data source options are available. URLs have no cutoff date, always latest info).

*Both options will include 25 000 message capacity per tenant/month Official Copilot Studio details here

Tip

Some more Info:

Option 1 - Add Azure OpenAI topic to Timon

Adding Azure OpenAI Services gives Timon the possibility to use a LLM (Large Language Model) and it's training data to provide answers in cases where normally Timon wouldn't have a answer.

The cool thing about Azure OpenAI in direct comparison to ChatGPT, for example: Azure OpenAI runs in your Subscription, the data / prompts will never leave the boundaries of your Microsoft environment. Additionally it lets your user's indirectly use a LLM and that might bring a lot of fun! Instead of user's asking ChatGPT and data leaving your organization's boundaries, your users can trust Timon with their query ✨✅ All data will stay in your environment hosted on Azure.

Curious?

We got you covered -> just follow the Link: Add your Azure OpenAI Instance

Option 2 - Copilot Studio -> Conversational Boosting

Using the latest GPT Models of Azure OpenAI Services Timon can stay up to date with it's knowledge. Usually a GPT model is trained up to a specific date in time and therefore wouldn't know about anything past that date. With the Conversational Boost feature in Copilots we can circumvent this limitation by providing the links to the M365 Documentation in the Copilot Config. The Copilot will then 'crawl' the documentation and stay up-to-date with it's data.

Currently this feature is limited to your bot copilot being in English and hosted in the United States.

Ok... but what if you're outside the U.S. like many of Microsoft's global customers? Well, Option 1 is designed for you! But let's see what the documentation has for us in terms of being able to use Option 2 outside the U.S. in the future:

Additional geo hosting and language options are expected to become available in the future (no dates disclosed at this time).

• This capability may be subject to usage limits or capacity throttling.
• Responses generated by the generative answers capability aren't always perfect and can contain mistakes. The system is designed to query knowledge from the website of your choosing and to package relevant findings into an easily consumable response. However, it's important to keep in mind some characteristics of the AI that may lead to unexpected responses:
  • The corpus upon which the model has been trained doesn't include data created after 2021.

We have implemented mitigations to prevent the model from using its training corpus as a source for answers, however it is possible for answers to include content from websites other than the one you selected.

• The system doesn't perform an accuracy check, so if the selected data source contains inaccurate information it could be shown to your chatbot users. We have implemented mitigations to filter out irrelevant and offensive responses, and the feature is designed not to respond when offensive language is detected. These filters and mitigations are not foolproof. Note You should always test and review your bots before publishing them, and consider collecting feedback from your bot's users.

Ok, ok - noted! BUT HOW?

We got you covered -> just follow the Link: Copilot Studio