Dominique Fournier
5342b716b1
git-svn-id: https://svn.fournier38.fr/svn/ProgSVN/trunk@5356 bf3deb0d-5f1a-0410-827f-c0cc1f45334c
12 lines
490 B
Plaintext
12 lines
490 B
Plaintext
# Sitemap support
|
|
|
|
This class allow to read the sitemaps files available in websites. This files
|
|
allow to provide web crawlers all the interesting URL to crawl, some optional
|
|
other sitemaps files and some parameters concerning the last update of the
|
|
pages.
|
|
|
|
Two formats are available : a textual one and a XML one.
|
|
The texutal format is simple : all the URL are written, one by line.
|
|
The XML allow to provide more data like the change frequency, the priority and
|
|
the last modification date
|