Webscraping
Scraping Controls
| Enable Web Scraping | Global switch to allow page-content extraction for agent usage. |
| Include Images | Controls whether images are retained in scraped markdown output. |
| Timeout Setting | Defines scraping timeout in seconds at UI level. |
Image Filtering
| Minimum Image Size Filter | Excludes images smaller than configured threshold. |
| Maximum Image Size Filter | Excludes images larger than configured threshold. |
| Size Unit Conversion | Converts UI units (KB and MB) to backend byte values during persistence flow. |
Path Exclusion Controls
| Ignored Path Patterns | Configures path patterns to exclude from scraping coverage. |
| Pattern List Management | Supports add/remove operations for ignored path entries. |
| Pattern Limit Guard | Enforces maximum pattern list size for ignored paths. |
Persistence and Data Mapping
| UI-to-API Unit Mapping | Converts timeout and image-size units between UI representation and API representation. |
| Save Confirmation Flow | Uses explicit confirmation before persisting scraping configuration updates. |
| Agent Profile Sync | Writes saved scraping settings back into active agent profile state. |