# Send user question to slack based on confidence level

**URL:** <https://community.pickaxe.co/t/send-user-question-to-slack-based-on-confidence-level/4062>\
**Category:** Actions\
**Created:** [February 10, 2025, 11:51am UTC](https://community.pickaxe.co/t/send-user-question-to-slack-based-on-confidence-level/4062 "2025-02-10T11:51:47Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![cfdynamics](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/cfdynamics/32/2180_2.png) [@cfdynamics](https://community.pickaxe.co/u/cfdynamics)\
**Post date:** [February 10, 2025, 11:51am UTC](https://community.pickaxe.co/t/send-user-question-to-slack-based-on-confidence-level/4062/1 "2025-02-10T11:51:47Z")

</div>

I’m looking for help triggering the action correctly.

The chatbot is evaluating the responce as a confidence level, and if it is low enough I want the user input to be sent to the slack action so I can become aware of it and add to the known answers PDF file and update the chat bot knowledge.

I’m not able to get it to send to slack - not able to trigger the action.

I have a rule that tells it to use the action - and when the confidence level is below 80% the chat tells the user it is sending it to slack to improve knowledge (will probably remove that later as the user doesn’t need to know).

RULE

- If the confidence of your response is below 80% use the action to send a message to slack including the user question.

Also, in the action the trigger prompt is:  
When a response is provided with a confidence level below 80% use this action to send the user question to Slack.

I have tested with the default trigger prompt and I am getting input to slack, so the connection is working, I’m just not getting it triggered when the confidence level is low enough.

Thank you!

---

<div class="post-metadata">

**Author:** ![admin\_mike](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/admin_mike/32/283_2.png) [@admin\_mike](https://community.pickaxe.co/u/admin_mike)\
**Post date:** [February 10, 2025, 11:47pm UTC](https://community.pickaxe.co/t/send-user-question-to-slack-based-on-confidence-level/4062/2 "2025-02-10T23:47:54Z")

</div>

This needs to be done entirely through prompting. The confidence level is a good idea, but just recognize the AI will be making up a confidence level. These are language models, so there is not internal confidence level calculator. When I write prompts for actions like these I use phrasing like “If you aren’t sure about the answer”. Stuff like that.

That being said, the confidence level idea can work. Just recognize it’s made-up and the AI is making up its own rules!

---

<div class="post-metadata">

**Author:** ![cfdynamics](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/cfdynamics/32/2180_2.png) [@cfdynamics](https://community.pickaxe.co/u/cfdynamics)\
**Post date:** [February 11, 2025, 5:34am UTC](https://community.pickaxe.co/t/send-user-question-to-slack-based-on-confidence-level/4062/3 "2025-02-11T05:34:15Z")

</div>

Thank you @admin_mike – I’m starting to get the hang of this better and have it working now… thank you!!

Rule:

- Do NOT MAKE UP answers. If you truly don’t know the answer to a question, tell the user you don’t know, use the action to send a message to slack with the question, and encourage them to reach out to our support team.

Actions trigger prompt:  
When you don’t know the answer, use this action to send the most recent user input to slack.

---

<div class="post-metadata">

**Author:** ![ab2308](https://yyz2.discourse-cdn.com/flex004/user_avatar/community.pickaxe.co/ab2308/32/1542_2.png) [@ab2308](https://community.pickaxe.co/u/ab2308)\
**Post date:** [February 24, 2025, 10:38pm UTC](https://community.pickaxe.co/t/send-user-question-to-slack-based-on-confidence-level/4062/4 "2025-02-24T22:38:54Z")

</div>

Hi @cfdynamics, there is an action in Pickaxe that integrates with the Pinecone assistant. You can use one of the functions in Pinecone to evaluate the answers:

> **[Understanding evaluation - Pinecone Docs](https://docs.pinecone.io/guides/assistant/understanding-evaluation)**
>
> Search through billions of items for similar matches to any object, in milliseconds. It's the next generation of search, an API call away.
