Review Indexed Pages
See exactly which pages, files and Q&A entries your AI Chatbot can answer from, stop a single page being used, and keep whole sections of your site out with patterns.
After a source is indexed, Flidu lists everything your assistant learned from it. Review that list before you publish Ask AI and again after each recrawl. It is the reliable way to know which pages an answer can draw on, and the place to remove pages that should not be used.
Where To Find Indexed Content
In the dashboard, open AI Chatbots, choose your assistant, and open the Data Sources tab. Below the source cards is a section called Indexed Content. Each row is one website page, uploaded file or Manual Q&A entry. While there is nothing to list yet, the section reads “No pages indexed yet”.
Filters across the top narrow the list, each with a count: All, Website Pages, Files, Manual Q&A, Ignored & Skipped and Failed. Selecting one of the summary cards higher up the tab, such as Files or Indexed Pages, applies the matching filter. A website page row shows the page address, when it was indexed, its status and a View link that opens the page in a new tab.
What Each Page Status Means
| Status | Meaning | What To Do |
|---|---|---|
| Indexed | The page was read and can be used in answers. | Nothing. Select Ignore if it should not be used. |
| Ignored | You chose to stop using this page. | Select Include again to use it once more. |
| Skipped | The page matches one of your exclude patterns. | Remove the pattern, or include the page again from Review Skipped Pages. |
| Needs reindexing | The page is included, but no indexed copy is ready to answer from. | Index its source again from the source card. |
| Could not read | The last crawl could not add the page. | Read the reason on the row, then index its source again from the source card. |
A page that could not be read carries a short reason: the page could not be reached, it is a type of page that can’t be read, it was too large, no readable text was found on it, its address can’t be crawled, or the page couldn’t be saved. When any item needs attention, a notice above the source cards offers Review Failed, which jumps to the Failed filter.
Stop One Page Being Used
- In Indexed Content, find the page. The Website Pages filter shortens the list.
- Select Ignore on its row. The button appears on pages with the status Indexed.
- Flidu confirms with “Page ignored. It won’t be used in answers.” and the row changes to Ignored.
Ignore takes effect straight away, without a recrawl, on every AI Chatbot plan. Nothing is removed from your website. To reverse it, select Include again. If the indexed copy was kept, the page is used again at once; otherwise Flidu asks you to index its source again first. The workspace Owner and Admins can ignore pages and manage patterns.
Ignore is for website pages. To stop using a file or a Manual Q&A source, select Remove on its source card and confirm.
Keep Whole Sections Out With Patterns
To keep an area of your site out of the index, such as checkout pages or a private section, select Included & Ignored Pages at the top of the Data Sources tab. The panel shows your Included Pages and Ignored Pages counts and how many patterns you have used. It is on the assistant’s Data Sources tab, not inside the Create AI Chatbot flow.
- Under Add a pattern, choose how it should match: Path starts with, Path contains, URL starts with or URL contains.
- Type the pattern, for example
/privatewith Path starts with. Path patterns begin with/, patterns cannot contain spaces, and letter case is ignored when matching. - Select Add Pattern. It appears under Active Patterns, where the bin icon removes it.
A pattern applies on the next crawl. Matching pages are skipped, and a matching page that was already indexed stops being used at that crawl. For an immediate effect on a page that is already indexed, use Ignore on its row.
Review Skipped Pages lists the pages that a pattern skipped and the pages you ignored, with the reason for each. Include again brings a pattern-skipped page back on the next crawl by adding a rule for that exact page, which counts toward your pattern total. A page you ignored yourself is included again at once when its indexed copy was kept.
| AI Chatbot Plan | Patterns Per Assistant |
|---|---|
| Free | 2 |
| Starter | 10 |
| Pro | 25 |
| Business | 50 |
| Agency | 100 |
A Review Routine That Works
- After the first indexing. Compare the list with the pages you expected. Website URL and Sitemap sources index a limited batch of pages per crawl, so a page you rely on may need naming in a Manual URL List. See Add Website Data Sources.
- Before you publish. Ignore pages that would confuse visitors, such as old offers, thank-you pages or internal notices.
- In Preview. Ask about the pages that matter most and check the sources shown under each answer. Preview questions count toward your monthly AI messages.
- After your site changes. Recrawl the source from its card, then check the list again.
If a page is missing, My Pages Are Not Being Indexed walks through the causes. To remove a page from answers quickly, see I Need To Stop Ask AI Using A Page.