Customise The Robots.Txt File, For Your Blog
Friday, March 13, 2020
Edit
The file "Robots.Txt", used to grapple search engine access to your blog, is establish inward the weblog root folder.
You can't edit "Robot.Txt" lead - but y'all tin flame upload a novel file. Long ago, y'all would use Webmaster Tools - which is at nowadays called Search Console.
Now, nosotros tin flame update "robots.txt" directly, using the Blogger dashboard "Custom robots.txt" wizard, inward Settings - "Search preferences".
Here's the link to the "Robots.Txt" file, for this blog.
To persuasion / re-create the electrical flow contents, only click on the link. You tin flame create the same amongst the file, for your blog.
If I desire to alter the file for this blog, I get-go amongst the electrical flow file. Excepting one small-scale detail (my weblog is published to "blogging.nitecruzr.net", yours is published to your chosen URL), your file volition live on identical - if y'all convey non tweaked it.
Let's hold off at a uncomplicated representative - adding a sitemap.
Some people would similar to index the static pages, inward their blog. That's a uncomplicated plenty chore - only add together the sitemap, for static pages, to your file.
"sitemap-pages.xml", similar "sitemap.xml", is automatically generated for each blog.
Start from Settings - Search preferences.

Start amongst an empty ("[Disabled]") "Custom robots.txt".

Click on "Edit".

Click on "Yes".

Paste inward your edited file content. Note that y'all volition overlay the electrical flow contents amongst what y'all glue - then glue the entire file, equally y'all want to have.

Click on "Save changes".
Select "Yes" for "Enable custom robots.txt content?", if necessary.

Right now, though, I don't desire to alter my file. So, I'll exit my custom file inward the wizard, as well as exit "No" selected.

And the custom file is
"[Disabled]", again.

Even if disabled, I tin flame larn it dorsum again, easily enough. Just click on "Yes", as well as in that place it is, again. For correct now, though, I'll exit it "[Disabled]".
Just live on aware of the dangers of editing, without knowing what termination a given entry has, on search engine activity. Remember that y'all tin flame larn the default file back, amongst a twosome mouse clicks.
You can't edit "Robot.Txt" lead - but y'all tin flame upload a novel file. Long ago, y'all would use Webmaster Tools - which is at nowadays called Search Console.
Now, nosotros tin flame update "robots.txt" directly, using the Blogger dashboard "Custom robots.txt" wizard, inward Settings - "Search preferences".
Here's the link to the "Robots.Txt" file, for this blog.
http://blogging.nitecruzr.net/robots.txt
To persuasion / re-create the electrical flow contents, only click on the link. You tin flame create the same amongst the file, for your blog.
If I desire to alter the file for this blog, I get-go amongst the electrical flow file. Excepting one small-scale detail (my weblog is published to "blogging.nitecruzr.net", yours is published to your chosen URL), your file volition live on identical - if y'all convey non tweaked it.
User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: http://blogging.nitecruzr.net/sitemap.xml
Let's hold off at a uncomplicated representative - adding a sitemap.
Some people would similar to index the static pages, inward their blog. That's a uncomplicated plenty chore - only add together the sitemap, for static pages, to your file.
"sitemap-pages.xml", similar "sitemap.xml", is automatically generated for each blog.
User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / Sitemap: http://blogging.nitecruzr.net/sitemap.xml Sitemap: http://blogging.nitecruzr.net/sitemap-pages.xml
Start from Settings - Search preferences.

Start amongst an empty ("[Disabled]") "Custom robots.txt".

Click on "Edit".

Click on "Yes".

Paste inward your edited file content. Note that y'all volition overlay the electrical flow contents amongst what y'all glue - then glue the entire file, equally y'all want to have.

Click on "Save changes".
Select "Yes" for "Enable custom robots.txt content?", if necessary.

Right now, though, I don't desire to alter my file. So, I'll exit my custom file inward the wizard, as well as exit "No" selected.

And the custom file is
"[Disabled]", again.

Even if disabled, I tin flame larn it dorsum again, easily enough. Just click on "Yes", as well as in that place it is, again. For correct now, though, I'll exit it "[Disabled]".
Just live on aware of the dangers of editing, without knowing what termination a given entry has, on search engine activity. Remember that y'all tin flame larn the default file back, amongst a twosome mouse clicks.
