post

In this week’s web design video blog, Nick and I explain the purpose of a robots.txt file and also share the common Robot Exclusion Standards. Checkout the supporting code at http://www.webdesigncreare.co.uk/blog/videos/robots-txt.html

Leave a Reply

Your email address will not be published. Required fields are marked *