A Secret Weapon For thailand
The value on the name attribute (robots) specifies which the rule relates to all crawlers. Both the title and also the information attributes are case-insensitive. to deal with a selected crawler, replace the robots price of the title attribute with the user agent token of the crawler that you're addressing. Google supports two person agent tokens