From 5342b716b1b768e31c64b00f99a3cc1a1bfc0e47 Mon Sep 17 00:00:00 2001 From: Dominique Fournier Date: Fri, 14 Jun 2019 07:19:51 +0000 Subject: [PATCH] Sitemap doc git-svn-id: https://svn.fournier38.fr/svn/ProgSVN/trunk@5356 bf3deb0d-5f1a-0410-827f-c0cc1f45334c --- docs/sitemap | 11 +++++++++++ 1 file changed, 11 insertions(+) create mode 100644 docs/sitemap diff --git a/docs/sitemap b/docs/sitemap new file mode 100644 index 0000000..d9ec760 --- /dev/null +++ b/docs/sitemap @@ -0,0 +1,11 @@ +# Sitemap support + +This class allow to read the sitemaps files available in websites. This files +allow to provide web crawlers all the interesting URL to crawl, some optional +other sitemaps files and some parameters concerning the last update of the +pages. + +Two formats are available : a textual one and a XML one. +The texutal format is simple : all the URL are written, one by line. +The XML allow to provide more data like the change frequency, the priority and +the last modification date