This article explains how to add web-based knowledge to your Eloquent workflows. This enhances your workflow by allowing it to use information from specific websites, improving responses to user queries. This process is the same whether you are creating a new workflow or editing an existing one.
Steps
1. Access Workflow (Add or Edit):
- New Workflow: In the Eloquent dashboard, click "Workflows" in the left-hand navigation, then click "+ Add Workflow".
- Edit Existing Workflow: In the "Workflows" section, find the workflow you want to modify. Click the three dots (...) on the right, and select "Edit".
2. Go to "Manage Knowledge":
- Within the workflow creation/edit screen, click on "Manage Knowledge" in the left sidebar. This section is where you define the information sources for your workflow.
3. Select the "Web" Tab:
-
- In the "Manage Knowledge" section, make sure you are on the "Web" tab. This tab is specifically for adding websites as knowledge sources.
4. Add a New Web Source:
- Click the "+ New Source URL" button. This starts the process of adding a new website.
- In the "Add Web Source" pop-up:
- Name: Enter a descriptive name for the web source (e.g., "Company Blog", "Product Documentation").
- Root URL: Enter the main URL of the website (e.g., https://blog.example.com or https://docs.example.com). This is the starting point for discovering pages.
- Click "Create"
5. Select Pages from the Web Source:
-
- The new web source will appear under "Source URLs". Click on it.
- Under "Pages Found", a list of pages discovered on the website will be displayed.
- Expand the sections (using the arrows) to see all available pages.
- Check the boxes next to the specific pages you want your workflow to use as knowledge.
- Use "Select All Pages" or "Select All Children" to quickly select multiple pages within a section.
6. Train Selected URLs:
- After selecting the relevant pages, click the "Train selected URLs" button. This tells Eloquent to process the content of these pages and make it available to the workflow.
- Note: The "Training materials" section (below the page selection) will show the status of each page.
- Initially, pages will have a "PENDING" status.
- The status will change to "DONE" once the system has processed the page's content. Only pages with a "DONE" status are actively used by the workflow.
7. Add Web Collection to Workflow
- Make sure the added URL is selected as a source URL on the left side.
- Click the "Save changes" button at the bottom right corner to save the changes.
Key Considerations:
- Processing Time: The time for pages to transition from "PENDING" to "DONE" depends on the size and complexity of the web pages. Usually its between 30 seconds to 2 minutes.
- Website Accessibility: The website you add must be publicly accessible and allow web crawlers to access its content.
- Content Updates: If the content of a website changes significantly, you should re-train the relevant URLs (select the pages and click "Train selected URLs" again) to ensure your workflow has the latest information. Eloquent does not automatically update its knowledge based on website changes.
- Root URL Choice: Be mindful of the Root URL you choose. If you only need a specific section of a website (e.g., a blog), use the URL of that section as the Root URL, not the main website homepage. This will make the page selection process more efficient.