Issue Bug Closed

#20035Crawler does not crawl though relative links in an external page

Dennis van 02/17/09, 15:44 updated 03/06/13, 21:59

Description

The crawler does not crawl through relative links when crawling an external page AND this external page is not just the domain name.

Example:
Relative links work when you crawl http://www.somesite.com/

Relative links DO NOT work when you crawl http://www.somesite.com/somefolder/

This seems to be a small error in class.crawler.php. The original writer seems to have forgotten to add the folder names that were in the url of the page it is crawling.

The diff holds a fix, where the class.crawler.php_back is the original file and class.crawler.php is the fixed file.
(issue imported from #M10463)

Reviews 0

No change resolves or names this issue in its commit message, and no comment links one.