I undertook the work on an intranet based on Typo3 v9.5.23. They're using indexed_search v9.5.23 and crawler v9.1.5 to crawl the pages but in the database table tx_crawler_queue
in the column result_data
I get {"content":"\"403 Access denied\""}
for every page.
To see the pages you have to login as a front end user. What do I have to do to crawl those pages?
I'm using the console with the following commands:
vendor/bin/typo3 crawler:flushQueue all
vendor/bin/typo3 crawler:buildQueue 69 intranet --depth=2
vendor/bin/typo3 crawler:processQueue
In the crawler config you find a field Crawl with FE user groups
.
As any FE-login needs a FE user group you should select the possible groups for crawling.