> For clean Markdown content of this page, append .md to this URL. For the complete documentation index, see https://buildwithfern.com/learn/llms.txt.

# Reindex Website

POST https://fai.buildwithfern.com/sources/website/{domain}/reindex
Content-Type: application/json

Re-crawl a website by starting a new crawl job. The job will delete old pages before indexing.
Uses the configuration from the original index request.

Reference: https://buildwithfern.com/learn/docs/ai-features/ask-fern/api-reference/website/reindex-website

## Authentication

- `Authorization` header (bearer token, required) — Bearer authentication of the form `Bearer <token>`, where token is your auth token.

## Servers

- `https://fai.buildwithfern.com` (Production, default)
- `https://fai-dev.buildwithfern.com` (Development)
- `http://localhost:8080` (Local)

## Request

### Path parameters

- `domain` (string, required)

### Body (application/json)

This endpoint expects an object.

- `base_url` (string, required) — The base URL to re-crawl (will delete old pages and re-index)
- `domain_filter` (string, optional, nullable) — Domain to filter crawling (e.g., 'docs.example.com'). If not provided, uses previous config.
- `path_filter` (string, optional, nullable) — Path prefix to restrict crawling (e.g., '/docs'). If not provided, uses previous config.
- `url_pattern` (string, optional, nullable) — Regex pattern to filter URLs (e.g., `https://example\.com/(docs|api)/.*`). If not provided, uses previous config.
- `chunk_size` (integer, optional, nullable) — Size of text chunks for splitting documents. If not provided, uses previous config.
- `chunk_overlap` (integer, optional, nullable) — Overlap between consecutive chunks. If not provided, uses previous config.
- `min_content_length` (integer, optional, nullable) — Minimum content length to index a page. If not provided, uses previous config.
- `max_pages` (integer, optional, nullable) — Maximum number of pages to crawl. If not provided, uses previous config.
- `delay` (double, optional, nullable) — Delay in seconds between requests. If not provided, uses previous config.
- `version` (string, optional, nullable) — Version to tag all indexed pages with. If not provided, uses previous config.
- `product` (string, optional, nullable) — Product to tag all indexed pages with. If not provided, uses previous config.
- `authed` (boolean, optional, nullable) — Whether indexed pages should be auth-gated. If not provided, uses previous config.

## Response

### 200

Successful Response

- `job_id` (string, required) — ID to track the re-crawling job status
- `base_url` (string, required) — The base URL being re-crawled

## Errors

### 422 Unprocessable Entity Error

Validation Error

- `detail` (list of object, optional)
  - `loc` (list of string or integer, required)
  - `msg` (string, required)
  - `type` (string, required)

## Examples

**Request**

```json
{
  "base_url": "https://www.example.com"
}
```

**Response**

```json
{
  "job_id": "a1b2c3d4-e5f6-7890-ab12-cd34ef567890",
  "base_url": "https://www.example.com"
}
```