paull
I'd like to avoid that some pages in our wiki are going to be indexed by search engines. These special pages should be accessible by anyone actually visiting the website, but not directly from google&co. However, I would like google to index all other, non-special pages of our dokuwiki-website.
What would be a good way to achieve this? Thanks for any help!!
hemmerling
a)
If you are disabling the "index" command AND if you don´t use a template with an index sidebar ( as "roundbox ),
you might create another namepspace,
to which you just point by a text and not by a link.
So that search engines won´t find it.
But its important to avoid any naming of the namespace by additional plugin actions like tag, cloud,...
this namespace would also be mentioned in automatically generated sitemaps ect...
so its a true risk, after all, especially if you are not a DokuWiki Methusalem ( but even then... you can´t be shure never to do a mistake ).
b)
Once I did such on a website ( without Dokuwiki ), to have a namespace = directory with file which should not be listed by search engines, as the contents was a little bit sticky and just for collegues and not the public,
so of course I told my collegues about it.
There was no reason for them to put public links to my directory on their websites, if the had websites at all.
But after 2 years I got a message from a collegue that the search engines had found the contents by what way ever, and so I had to delete it ( alternatively I might have changed the directory, but after this experience, I did not do such again but deleted the hopefully outdated contents ).
But I was surprised about the success of the search engines.
c)
Btw, the greatest danger is so, that visitors bookmark your hidden site, put the bookmark on their sites or on delicous.com,
and le voila the search engines will learn about it, and nobody tells the search engines then NOT to follow that link, as if they do, they don´t follow a deep link and don´t go through your front door....
Nevertheless, the number of search engines who accept website submission are limited,
many "well known" good old websites refer to either Yahoo, Microsoft or Google.... in their sections "adding a website" :-(.
Sincerely
Rolf