Skip to content

Conversations

The Conversations panel on the left sidebar provides access to all your conversations with Fabaio. You can view your personal conversations, shared conversations, create new conversations, and manage existing ones. This section covers everything you need to know about managing and working with conversations in Fabaio.

  1. Add Button ( + ) - Create a new conversation with Fabaio.
  2. My Conversations - View all conversations you've created. This is your personal conversation list.
  3. Shared with Me - Access conversations that other users have shared with you.
  4. Row Level Actions - Access conversation options via the More Options Menu (โ‹ฎ) including Share, Shared Details, Rating, Evaluate, Star, Rename, and Delete
  5. Star Icon - Mark conversations as favorites for quick access
  6. Archive - Archive old conversations to keep your active list clean

You can scroll through your conversation list to find previous conversations, and clicking on any conversation loads it in the main chat area.

1.โž• Creating a New Conversation

When you click Add ( + ) at the top of the Conversations panel, Fabaio opens the New Conversation dialog.

New Conversation Dialog

You must choose:

  1. Persona - Select the AI persona that defines Fabaio's behavior, expertise, and communication style for this conversation. Personas determine which tools are available, what prompt templates are used, and how Fabaio responds to your queries. For detailed information about personas and how to create custom personas, see the Personas Guide.
  2. Conversation Title - Provide a descriptive title for your conversation. This helps you identify and organize conversations later. Titles can be edited after creation.
  3. LLM Model - Choose the Large Language Model that will power this conversation. Available models depend on your organization's configuration and may include options like Claude Sonnet, GPT-4, or other configured models. Each model has different capabilities, costs, and performance characteristics.

Once you've configured these settings, click "Create" to start a new conversation with Fabaio using your selected persona and model.

Quick Actions from Add Menu

The Add ( + ) button also provides quick access to:

  • New Conversation - Create a standard conversation with Fabaio
  • New Model Comparison - Create a conversation specifically for comparing AI models

2. ๐Ÿ“‚ My Conversations

The My Conversations section is your central workspace inside Fabaio.

  1. Contains every conversation - All conversations you've created using any persona and any LLM
  2. Manage your conversations - Organize, edit titles, and archive old ones
  3. Revisit past conversations - Access full conversation history at any time
  4. Continue conversations - Pick up where you left off with full context preserved
  5. Analyze interactions - Review tool calls, reasoning, and performance metrics

3. ๐Ÿ‘ฅ Shared With Me

The Shared With Me section lists all conversations that other users have explicitly shared with you.

  1. Read-only access - Explore and learn from conversations, but cannot modify or continue the conversation thread
  2. Enables collaboration across teams - SREs, AIOps engineers, platform teams, data teams, and product users can share RCA reports, dashboards, agent outputs, or troubleshooting sessions
  3. View full conversation thread - See user requests, agent responses, intermediate reasoning, tool calls, and final reports (RCA, dashboards, summaries, etc.)
  4. Inspect tool call details - Expand Tools Called sections to view inputs, outputs, and MCP Request/Response logs to understand step-by-step workflow execution
  5. View cached documents used - See logs, metrics, device configurations, query results, scratchpad notes, and retrieved API data used in the conversation. For detailed information about cached documents, see the Cached Documents Guide
  6. Share conversations further - Re-share conversations with other users in your organization (useful for transferring RCA reports, troubleshooting sessions, dashboards, or training examples)

4. Row Level Actions

Row Level Actions Menu

When you open the More Options Menu (โ‹ฎ) on any conversation, you will see:

  1. Share
  2. Shared Details
  3. Rating
  4. Evaluate / Evaluation Report
  5. Star
  6. Rename
  7. Delete

4.1 ๐Ÿ”— Sharing Conversations

Fabaio allows users to securely share conversations with other team members or user groups for collaboration on RCA reports, dashboards, agent outputs, or operational analysis.

  1. Secure sharing - Share conversations with team members or user groups through role-based group sharing
  2. Read-only for recipients - Shared conversations are read-only, ensuring integrity of original sequence, tool calls, cached documents, and results
  3. Share modal features - Conversation label display, shared conversation details table (Shared With, Shared By, Originator, Timestamp), and user group selection
  4. User group selection - Select from available user groups (e.g., cisco-ai-users, msp, workflow-admin) - role-based, not manual email entry
  5. After sharing - Conversation becomes visible under Shared with Me for selected users, all content viewable but not modifiable, cached documents visible for transparency
  6. Owner control - Owner retains full control and can unshare or delete at any time
  7. Security - Shared conversations cannot be modified by recipients, original data remains intact, all reads are audit logged, follows organization/user-group permission rules

4.2 Shared Details

The Shared Details panel provides a complete audit trail of how a conversation has been shared across the organization. While the Share option allows you to share a conversation with user groups, the Shared Details screen helps you review who already has access.

  1. Read-only visibility - Provides complete audit trail of conversation sharing for visibility, compliance, and auditing purposes
  2. Access review - Review who currently has access to the conversation without modifying sharing settings
  3. Fields displayed - Shows Shared With (user groups/users), Shared By (person who shared), Originator (original creator), and Shared Timestamp (when shared)
  4. Conversation label - Displays conversation name at the top for reference (e.g., "Dynatrace Monitoring Agent")
  5. Transparency - Maintain transparency for AI-generated outputs such as RCA results, dashboards, and agent workflows

4.3 ๐Ÿ‘ / ๐Ÿ‘Ž Rating

The Rating feature allows users to provide structured feedback on any conversation to measure the usefulness, clarity, and accuracy of AI-generated outputs such as RCAs, dashboards, reports, and agent workflows.

  1. Conversation label - Shows the selected conversation's name for reference (e.g., "Agent Creator Agent without Dynatrace toolset") to ensure you are rating the correct conversation
  2. Star rating - Give a score between 1 to 5 stars: 5 stars (Excellent), 4 stars (Good but can improve), 3 stars (Acceptable), 2 stars (Poor quality), 1 star (Not useful or incorrect)
  3. Review positive - Free-text box to describe what worked well (e.g., "RCA report was detailed and accurate", "Tool calls were sequenced perfectly", "Clear explanation and actionable insights")
  4. Review negative - Free-text box for improvement feedback (e.g., "Missed fetching entity details", "Metrics chart formatting was incorrect", "Longer than needed")
  5. Submit rating - Click Rate to submit feedback, which logs to ratings database, user-specific analytics, project analytics, and AI Observability dashboards
  6. Ratings contribute to AI Reviews Dashboard, user rating summaries, project rating breakdown, agent persona performance metrics, and leaderboard-like insights

4.4 ๐Ÿงช Evaluate

The Evaluate feature allows users to run an automated evaluation of any conversation using an LLM. Useful for reviewing agent correctness, benchmarking persona responses, assessing completeness or accuracy, and performing compliance or quality checks. Widely used by QA teams, developers, and operational leads to ensure Fabrix agents behave consistently and correctly.

  1. Conversation label - Auto-filled field showing current conversation name, editable to give evaluation run a custom title
  2. LLM model (required) - Select which model will perform the evaluation (e.g., claude-sonnet-4, claude-3.5, gpt-4.1, gpt-o1, meta-llama3-70b) - controls the "judge" for this evaluation
  3. Additional instructions (optional) - Free-text section for custom evaluation criteria including what correctness/completeness means, what should be checked, output format expected, and rules/constraints for the evaluator
  4. Evaluation usage - Appears in Evaluation Report, AI Observability dashboards, model comparison workflows, persona tuning workflows, and agent creator testing loops

4.5 ๐Ÿ“Š Evaluation Details

The Evaluation Details tab provides a centralized place to view all evaluation runs that were performed on a conversation. Whenever a user triggers Evaluate, the system stores which conversation was evaluated, when the evaluation took place, which LLM model was used, any additional instructions provided, and the detailed evaluation output.

  1. Use cases - Essential for audit trails, quality checks, results comparison across different LLMs or personas, and compliance-sensitive operations

4.6 โญ Star / Unstar Conversations

The Star feature allows users to quickly mark important or frequently used conversations so they can be easily accessed later. Starring a conversation highlights it in the list and enables star-based filtering.

  1. Filter starred conversations - Click the Filter Starred Conversations button at top of conversation panel to display only starred conversations across My Conversations and Shared With Me
  2. Use cases - Useful for ongoing agent builds, frequently accessed workflows, conversations with dashboards or cache docs you revisit, shared conversations to keep handy, and evaluations requiring follow-up

4.7 โœ๏ธ Rename Conversation

The Rename option allows you to update the title of an existing conversation so it is easier to identify, search, or organize.

  1. Permissions - You can rename your own conversations at any time, shared conversations received from others are read-only so renaming is disabled

4.8 ๐Ÿ—‘๏ธ Delete Conversation

The Delete option allows you to permanently remove a conversation from My Conversations. This helps keep your workspace clean and organized, especially when older or test conversations are no longer needed.

  1. Observability and costs - When deleted, conversation will be removed from observability/conversations, but already calculated costs will still show in cost reports
  2. Permissions - You may delete your own conversations, you cannot delete conversations in Shared With Me (those are read-only)

Note

Conversations are persistent and maintain their full history. You can return to any conversation at any time to continue where you left off. All conversations are logged for audit purposes and can be reviewed through the AI Administration module.