#83134Re-implement Update storage index [File Abstraction Layer]
Description
Indexer should work based on the whitelist and iterate over all sys_file records in db and check if file exists in file system, if file doesn’t the record should be deleted. If file’s modification_date was changed the record should be updated. This operation should be divided into small chunks.
class related to this task: \TYPO3\CMS\Scheduler\Task\FileStorageIndexingTask
Reviews 2
Related issues 1
History 712
-
Pawel Cieslik commented <span data-processor="relativetime" data-value="2017-11-29T10:05:03+00:00" > 11/29/17, 10:05 </span>
currently indexer iterate over all files in specific storage folder and later it updates database, GC task can have really big table with IDs of records which exist in filesystem and database. Later GC task is making query to database and choose all records from sys_file which are not in this really big table with IDs.
such task is really memory and resource consuming. changing order will reduce memory and cpu usage.
-
Wouter Wolters changed removed the assignee <span data-processor="relativetime" data-value="2017-11-30T21:39:03+00:00" > 11/30/17, 21:39 </span>
-
Susanne Moog changed target version <span data-processor="relativetime" data-value="2018-01-28T14:04:17+00:00" > 01/28/18, 14:04 </span>
-
Thomas Sam Wittich changed Related to #91934 <span data-processor="relativetime" data-value="2020-08-05T15:50:21+00:00" > 08/05/20, 15:50 </span>
-
Gerrit Code Review pushed patch set 1 for main to change 96810 status
NewUnder Review <span data-processor="relativetime" data-value="2026-10-18T07:32:32+00:00" > 10/18/26, 07:32 </span> -
Gerrit Code Review pushed patch set 2 for main to change 96810 <span data-processor="relativetime" data-value="2026-10-18T13:33:10+00:00" > 10/18/26, 13:33 </span>
-
Gerrit Code Review pushed patch set 1 for 14.3 to change 97040 <span data-processor="relativetime" data-value="2026-10-23T05:06:42+00:00" > 10/23/26, 05:06 </span>
-
Benni Mack commented and changed status
Under ReviewResolved done0 %100 % <span data-processor="relativetime" data-value="2026-10-23T05:10:11+00:00" > 10/23/26, 05:10 </span>Applied in changeset commit:45d3c4ae2e9c94290e6ca834e231f942a304f691.
-
Gerrit Code Review pushed patch set 2 for 14.3 to change 97040 status
ResolvedUnder Review <span data-processor="relativetime" data-value="2026-10-23T05:16:01+00:00" > 10/23/26, 05:16 </span> -
Gerrit Code Review pushed patch set 3 for 14.3 to change 97040 <span data-processor="relativetime" data-value="2026-10-27T11:44:51+00:00" > 10/27/26, 11:44 </span>
-
Benni Mack commented and changed status
Under ReviewResolved <span data-processor="relativetime" data-value="2026-10-28T07:45:14+00:00" > 10/28/26, 07:45 </span>Applied in changeset commit:426c7f8ff3e23fd068ca97e23b57fb7e7d043ba6.
Records are already updated by the task. And missing files are marked as missing.
What exactly do you want to approve?