Optional chunkThe size to chunk the sitemap URLs into for scraping.
{300}
Optional filterOptional maxThe maximum number of concurrent calls that can be made.
Defaults to Infinity, which means no limit.
Optional maxThe maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Optional onCustom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Optional selectorThe selector to use to extract the text from the document. Defaults to "body".
Optional textThe text decoder to use to decode the response. Defaults to UTF-8.
Optional timeoutThe timeout in milliseconds for the fetch request. Defaults to 10s.
Generated using TypeDoc
Interface representing the parameters for initializing a SitemapLoader. SitemapLoaderParams