#93547Collection of problems with large sites
Description
I used the following tags in sub-issues – where appropriate.
tags : “large-site”, “memory hog”, “prepared statement”, “placeholderlimit”, “memory”, “performance”, “throttle”, “usability” (or UI related things)
All issues related to large site are tagged with large-site.
———-
Can be many pages, many files, many directories, many categories, etc. or a combination.
The problems are mostly related to:
- performance and resource (memory) problems.
- exceptions, e.g. database query – “Prepared statement contains too many placeholders”
- usability: e.g. long, unusable lists (see sys_filemount: long list of directories + performance issue, unable to filter for specific pages in pagetree filter etc.)
Can the question of large sites be addressed in general?
e.g.
- consider large sites when creating concepts for new features
- create a reference “large site”
- test patches on “large sites”
- define hard limits / soft limits (if possible) – e.g. are there specific known limitations, can we say TYPO3 easily runs with x number of pages (redirects, sites, files, be user groups etc.) in a typical installation (e.g. with a reference site)
Reviews 1
Related issues 41
- Bug #36744Workspaces are unusable on larger installations
- Bug #52374Editing a sys_filemount is very slow
- Bug #57953Rendering time of HMENU is really bad, maybe bug?
- Feature #75017Search for relations in backend
- Bug #76581Backend Performance Flaws
- Bug #78258List view CSV export goes out of memory
- Feature #78760Make pagetree panel resizable/expandable on large screens
- Bug #81996Read-only select field 'renderType' => 'selectSingle' renders all available items
- Bug #84051SelectTree (Category Tree) - add horizontal scrolling
- Bug #84558TYPO3 sys_category problem with performance/slow opening category in BE
- Bug #86859Search with indexed_search plugin throws exception: Prepared statement contains too many placeholders
- Bug #88134Lots a database queries to sys_refindex cause slow page saving
- Epic #88474Page tree performance in 9.5
- Bug #88672SlugHelper->isUniqueInSite() slow for installations with many sites and similar URL structures
- Bug #88873ext: form hangs (run into 500 error) when a lot of files are in the fileadmin
- Feature #89015Lazy Loading for TCA / Backend View to improve performance
- Task #89287Make linkvalidator crawling polite
- Epic #89759Performance improvements in Forms module
- Feature #89762Add pagination to forms list
- Task #90143Redirects: Poor performance of redirect matching for large redirects table
- Bug #90518DB problems with rootline cache: DELETE cf_cache_rootline double-JOIN with cf_cache_rootline_tags take excessively long
- Bug #91372Filelist module stops working if a lot of files in one directory
- Bug #92033"Page tree error: Got unexpected reponse" with filter - allowed memory size exhausted
- Bug #92036New behaviour of page tree filter might more easily submit "monster queries" or too many queries
- Bug #92493 linkvalidator: scheduler task + list of broken links dies if too many pages ("Prepared statement contains too many placeholders")
- Feature #92576Page Tree filter: make it possible to explicitly filter by uid - to go to a specific page in the pagetree
- Task #93305Long lists of parameters in QueryBuilder handled differently ("too many placeholders")
- Bug #93937Live search really slow for non admin users in large TYPO3 websites
- Epic #95690Performance issues when hosting a large amount of websites, and optimizations propositions
- Bug #96042Row update wizard may consume too much memory for tables with many records and content
- Task #96729Auto generate database index "language"
- Feature #97017Allow LiveSearch to be disabled via configuration
- Bug #99326DataHandler - Process too many records
- Feature #99843Option to disable clearing sibling page cache (clearCache_pageSiblings)
- Bug #109089Reference index scales very poorly, slows down saving records in backend and should use a lock
- Bug #109180Editing a record in TYPO3 v14.2.0-dev takes much longer than in TYPO3 v13 LTS
- Task #109601Resolving legacy SiteSettings slows down massively with many sites and settings
- Bug #109897cache garbage collection fails with large amount of tags
- Task #110358Installations with lots of sites gets slow due to re-building site objects
- Bug #110979Bad query performance on sys_file_reference language overlay
- Task #111392Resolve the site of a site root page without loading its rootline