#59007Indexed Search cannot index external files if FileStorage is not public
Description
External files are indexed with the following TypoScript:
config.index_enable = 1
config.index_externals = 1
and Configuration in extension (useCrawlerForExternalFiles)
If the sys_file_storage is public, everything works fine. The frontend generates URLs in the form of “fileadmin/download.pdf” which are correctly indexed.
But if the storage is not public, the frontend generates links in the form of “index.php?eID=dumpFile&t=f&f=FILEID&token=HASH” which are not indexed. This is the case even if it would be possible to read the file on the server side (for example if the path is a samba mount)
To reproduce the bug, just uncheck the “is public” checkbox for the default fileadmin FileStorage.
Reviews 2
History 79
-
Tymoteusz Motylewski changed parent task #65815 <span data-processor="relativetime" data-value="2015-03-18T17:24:43+00:00" > 03/18/15, 17:24 </span>
-
Michael OF commented and changed TYPO3 Version
6.27 <span data-processor="relativetime" data-value="2017-02-10T22:25:14+00:00" > 02/10/17, 22:25 </span> -
Michael OF commented <span data-processor="relativetime" data-value="2017-02-10T22:26:38+00:00" > 02/10/17, 22:26 </span>
Remark: useCrawlerForExternalFiles is not needed to reproduce. Reproduced in 7.6.15
-
Tomas Norre Mikkelsen commented <span data-processor="relativetime" data-value="2022-11-30T10:54:41+00:00" > 11/30/22, 10:54 </span>
I accept that this still might be an issue, would need to check that.
But why would you index non-public file storage? So that the content gets public through the indexing? I might be missing a use case or context here. -
Robert Vock commented <span data-processor="relativetime" data-value="2022-11-30T10:59:24+00:00" > 11/30/22, 10:59 </span>
If a file from a non-public file storage is used in a content element, it will be indexed with
config.index_externals = 1. If it’s used on a page, it should be findable via search.The configuration does not index ALL the files in the non-public storage, just those, that are used on any public page.
-
Tomas Norre Mikkelsen commented <span data-processor="relativetime" data-value="2022-12-01T13:13:55+00:00" > 12/01/22, 13:13 </span>
Thanks for clearing that up.
I can still reproduce this with
TYPO3 11.5.19
PHP 8.0.24Will see if I can figure out what the problem is.
I think the problems is around the lines https://github.com/TYPO3-CMS/indexed_search/blob/main/Classes/Indexer.php#L563
The allowedAbsPath doesn’t allow this path pattern, that the link has if not public.Perhaps a if clause should be added for the private file.
I don’t know if it’s wanted by design or not.Perhaps
benni orjust2b can saw a word or two about that. -
Gerrit Code Review pushed patch set 1 for main to change 95210 status
NewUnder Review <span data-processor="relativetime" data-value="2026-08-10T16:26:15+00:00" > 08/10/26, 16:26 </span> -
Gerrit Code Review pushed patch set 1 for 14.3 to change 95543 <span data-processor="relativetime" data-value="2026-09-02T06:23:45+00:00" > 09/02/26, 06:23 </span>
-
Benni Mack commented and changed status
Under ReviewResolved done0 %100 % <span data-processor="relativetime" data-value="2026-09-02T06:35:08+00:00" > 09/02/26, 06:35 </span>Applied in changeset commit:cda82504f1ad0df2efb1a2e0cc80ec6daf6fdf9e.
Hi,
As this issue is open now for more than two years, and because I’m also missing this feature, could anyone please be so kind and tell me if there are any plans/roadmaps to solve it?
Regards,
Michael