> ## Documentation Index
> Fetch the complete documentation index at: https://docs.webagent.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Website

There are three ways to add your entire website to your chatbot's knowledge base:

* Add each URL individually
* Add your website's domain with a wildcard
* Add your website's sitemap

<Tabs>
  <Tab title="Each URL Individually" default>
    ## Add Each URL Individually

    1. Click on the **Knowledge** tab.
    2. Enter each URL of your website individually, one by one.
    3. Click **Add Url +** to add multiple URLs.

    <img style={{ borderRadius: "0.5rem" }} src="https://mintcdn.com/webagentai/Xo4IpnEW6BaFm2mJ/images/add-url-individually.png?fit=max&auto=format&n=Xo4IpnEW6BaFm2mJ&q=85&s=d75cdf896a446c74a305b0a52aa0b7a1" width="1271" height="1018" data-path="images/add-url-individually.png" />

    4. Click **Fetch** to fetch the URLs

    <img style={{ borderRadius: "0.5rem" }} src="https://mintcdn.com/webagentai/Xo4IpnEW6BaFm2mJ/images/add-url-individually-2.png?fit=max&auto=format&n=Xo4IpnEW6BaFm2mJ&q=85&s=2d4d9074ac5b5be1c48c169f367d7ca0" width="1440" height="1001" data-path="images/add-url-individually-2.png" />

    4. Once all URLs have been successfully fetched and are in the staging area, click the **Train Chatbot** button. This will crawl each URL then train the chatbot on the content of each URL.

    <img style={{ borderRadius: "0.5rem" }} src="https://mintcdn.com/webagentai/Xo4IpnEW6BaFm2mJ/images/add-url-individually-3.png?fit=max&auto=format&n=Xo4IpnEW6BaFm2mJ&q=85&s=50ef5fa27a03cb6449df1a4e6147e2bc" width="1438" height="1452" data-path="images/add-url-individually-3.png" />
  </Tab>

  <Tab title="Entire Site with Wildcard">
    ## Add Domain with Wildcard

    1. Click on the **Knowledge** tab.
    2. Enter your website's domain followed by `/*`. For example: `https://domain.com/*`
    3. This will add all subpages of your website to your chatbot's knowledge base.

    <img style={{ borderRadius: "0.5rem" }} src="https://mintcdn.com/webagentai/Xo4IpnEW6BaFm2mJ/images/subpage-wildcard-2.png?fit=max&auto=format&n=Xo4IpnEW6BaFm2mJ&q=85&s=4689569c82ac030a9dfaa5ae510e370e" width="1271" height="1057" data-path="images/subpage-wildcard-2.png" />

    Tip: You can also use the `/*` wildcard to add subpages of a specific section of your website. For example: `https://domain.com/docs/*` would add all subpages of your documentation section.
  </Tab>

  <Tab title="Entire Site with Sitemap">
    ## Add Website Sitemap

    1. Click on the **Knowledge** tab.
    2. Enter the URL of your website's sitemap. Typically, this is located at `https://domain.com/sitemap.xml`.
    3. Our system will automatically crawl your website and add all pages to your chatbot's knowledge base.

    <img style={{ borderRadius: "0.5rem" }} src="https://mintcdn.com/webagentai/Xo4IpnEW6BaFm2mJ/images/sitemap.png?fit=max&auto=format&n=Xo4IpnEW6BaFm2mJ&q=85&s=0e3f5fae17b5261a16eef6927d132c0b" width="1271" height="941" data-path="images/sitemap.png" />
  </Tab>
</Tabs>

***

Once you've added your website's content, our system will process the data and make it available to your chatbot. Your chatbot will then be able to respond accurately to user queries based on your website's content.
