v 8.0 v 9.0 v 10.0 v 11.0 Third Party 927
Download for v 11.0 Deploy on Odoo.sh
Required Apps Website Builder (website)
Lines of code 12
Technical Name website_no_crawler
LicenseAGPL-3
Websitehttps://github.com/OCA/website
Also available in version v 8.0 v 10.0 v 9.0 v 13.0
You bought this module and need support? Click here!

Alter robots.txt disallow indexing

Beta License: AGPL-3 OCA/website Translate me on Weblate Try me on Runbot

By default, /robots.txt on an Odoo installation with website module installed will allow indexing by webcrawlers.

This module will overwrite view that generates /robots.txt and won’t allow to index.

Table of contents

Usage

No useable features for an user are available. To view the results, visit /robots.txt on your site.

Bug Tracker

Bugs are tracked on GitHub Issues. In case of trouble, please check there if your issue has already been reported. If you spotted it first, help us smashing it by providing a detailed and welcomed feedback.

Do not contact contributors directly about support or help with technical issues.

Credits

Authors

  • B-Informed B.V.

Contributors

Maintainers

This module is maintained by the OCA.

Odoo Community Association

OCA, or the Odoo Community Association, is a nonprofit organization whose mission is to support the collaborative development of Odoo features and promote its widespread use.

This module is part of the OCA/website project on GitHub.

You are welcome to contribute. To learn how please visit https://odoo-community.org/page/Contribute.

Please log in to comment on this module

  • The author can leave a single reply to each comment.
  • This section is meant to ask simple questions or leave a rating. Every report of a problem experienced while using the module should be addressed to the author directly (refer to the following point).
  • If you want to start a discussion with the author, please use the developer contact information. They can usually be found in the description.
Please choose a rating from 1 to 5 for this module.
There are no ratings yet!
Very useful - for DEV/UAT instances.
by
BORIS STEFANOV
on 6/21/22, 8:53 AM

I wish it worked on multi-language website.

I have EN_us and BG_bg website - and it crashes badly with error 500 and entry in logfile

KeyError: ('ir.qweb', <function IrQWeb.compile at 0x7f26ca953b90>, 1453, ('en_US', None, None, None, None, 1))

Template not found

Odoo tries to translate "User-agent: *
Sitemap:" to Bulgarian, which makes no sense as crawlers will not recognize the tags.