🔁 Test Run

Test Run is a powerful feature that allows you to preview and validate how Siena will handle customer inquiries before deploying your automations to live conversations. Instead of waiting for real customer messages to verify your automation setup, Test Run generates realistic sample scenarios and shows you exactly how Siena would respond.

How It Works

• Generation: When you initiate a Test Run, Siena automatically generates 10 diverse sample customer inquiries related to your automation's intended purpose
• Response Simulation: For each sample inquiry, Siena shows you exactly how she would respond using your current automation configuration
• Review & Feedback: You can evaluate each response and take notes on any feedback to use when tweaking the automation to meet your expectations

Steps

1. Open the automation from your Automation library.
2. Click on the Run test dropdown in the page header, then select + New Test Run . You can also view previous test runs from this dropdown.
3. A pop-up window will appear, prompting you to enter the following details:
   
   
   • Name: The default name will be [automation name] + #1, but feel free to customize it.
   • Persona: Choose the Persona from your available list.
   • Channel: Select your desired communication channel.
   • Email: Your email will be set as the default. However, if you want to test actionable requests (like retrieving order data from Shopify or other integrations), you can input the actual email of the customer. This allows Siena to utilize real data. Keep in mind that Test Runs are simulations and will not perform any actions or alter any information in your integrations.
   • Additional Information: You can provide extra context about the automation, such as specific customer details, order numbers, shipping addresses, or any other relevant information you want Siena to consider during the tests.
     
     
4. After entering all necessary information, click the Run test button.
5. You will be taken to the Test Runs page, where you can view all the generated customer inquiries along with Siena's responses. You can also rate the responses and add notes, which will help you refine your automations. Note that these comments will not automatically train the AI; they are intended for manual adjustments if needed.
   
   
   
   
6. You can find all Test Runs in the Automations tab on the left panel.
   

Best Practices

• Run tests after making significant changes to your automation configuration
• Provide specific, detailed feedback for any responses marked as "Thumbs down"
• Use Test Run regularly as part of your quality assurance process

Getting Help

If you need any help interpreting results or optimizing your automation:

1. Document your concerns using the feedback feature
2. Reach out to your Customer Success Manager
3. Schedule a review session to discuss improvements

Remember: Test Run is a tool for continuous improvement. Regular testing and feedback help ensure your automations provide the best possible customer experience.

If you have any further questions, please don’t hesitate to reach out to our Customer Support team. We’re here to help!