I'm a bot developer and I just migrated our QnA from preview to GA. But, then I realised I can't find the answer with what I'm asking previously. Then I did some research from my side, and I found the scores of preview and GA are way to different for a same question. I have attached few screenshots about this issue from both preview and GA.
1. Screenshot: This is the Question and Answer from QnA preview
Then, I'm asking "explain braveheart". In this case, even though I don't have exactly "Explain braveheart" in my question, but QnA should understand what I'm trying to ask. In preview, as we can't see the score from Test portal, so I write a simple program to extract the score from code. Like below:
2. Screenshot: QnA maker preview works great for this question in my code
Then, I migrated my QnA from preview to GA, and score changed dramatically, like below:
3. Screenshot: The same question and answers in QnA maker GA
Then, this is the result when I test the same question within QnA maker GA.
4. See the confidence score is way too lower than preview
I would like to know why the QnA GA works different with preview, and it is quite important for use to manage our questions and answers. Moreover, if they are performing differently, so we can't simply migrate the QnA KB from preview to GA. This is a huge different with what we have from the MS QnA document.
