Issue Feature Resolved

#83134Re-implement Update storage index [File Abstraction Layer]

Pawel Cieslik 11/28/17, 10:52 updated 10/28/26, 07:45

Description

Indexer should work based on the whitelist and iterate over all sys_file records in db and check if file exists in file system, if file doesn’t the record should be deleted. If file’s modification_date was changed the record should be updated. This operation should be divided into small chunks.

class related to this task: \TYPO3\CMS\Scheduler\Task\FileStorageIndexingTask

Reviews 2

History 712

  1. Frans Saris commented <span data-processor="relativetime" data-value="2017-11-28T12:58:36+00:00" > 11/28/17, 12:58 </span>

    Records are already updated by the task. And missing files are marked as missing.

    What exactly do you want to approve?

  2. Pawel Cieslik commented <span data-processor="relativetime" data-value="2017-11-29T10:05:03+00:00" > 11/29/17, 10:05 </span>

    currently indexer iterate over all files in specific storage folder and later it updates database, GC task can have really big table with IDs of records which exist in filesystem and database. Later GC task is making query to database and choose all records from sys_file which are not in this really big table with IDs.

    such task is really memory and resource consuming. changing order will reduce memory and cpu usage.

  3. Benni Mack commented and changed status Under Review Resolved done 0 % 100 % <span data-processor="relativetime" data-value="2026-10-23T05:10:11+00:00" > 10/23/26, 05:10 </span>

    Applied in changeset commit:45d3c4ae2e9c94290e6ca834e231f942a304f691.

  4. Gerrit Code Review pushed patch set 2 for 14.3 to change 97040 status Resolved Under Review <span data-processor="relativetime" data-value="2026-10-23T05:16:01+00:00" > 10/23/26, 05:16 </span>

  5. Benni Mack commented and changed status Under Review Resolved <span data-processor="relativetime" data-value="2026-10-28T07:45:14+00:00" > 10/28/26, 07:45 </span>

    Applied in changeset commit:426c7f8ff3e23fd068ca97e23b57fb7e7d043ba6.