Robots.txt 生成器
为你的网站生成 robots.txt 文件。
在您的浏览器中运行。您的文件不会离开设备。 了解如何验证
…
使用方法
- 1填写各项
输入数字或选择所需选项。
- 2查看结果
更改任何值时，答案会立即更新。
- 3使用结果
复制结果或记下来。不会向任何地方发送任何内容。
About this tool
Choose the crawler, list the paths you do not want crawled and any paths to allow, and add your sitemap address. Copy the result into a file named robots.txt in the root of your site. Remember that robots.txt is a request to crawlers, not a way to hide private pages.
When to use it
Create a robots.txt file for your website, with sitemap and rules.
Tips
Do not block pages you want indexed. Test the file.
Privacy
Everything runs in your browser, so your data is not uploaded or stored.
计算示例
With the boxes at their starting values (Crawler (user-agent): All crawlers (*); Allow everything when no paths are listed: Yes; Paths to block (one per line): /admin /private/), the tool shows: User-agent: * Disallow: /admin Disallow: /private/. Change any box to see your own numbers. The result updates as you type, and nothing leaves your browser.
获得最佳结果的提示
在相信结果之前先检查每一个输入项，因为一个错误的数字就会改变整个答案。请使用工资单、账单、证书或合同上的准确数字，并记下计算日期。税率、门槛和规则会不时变化，因此对于税费和法律事务，请将结果视为估算，并与本页注明的官方来源核对。您可以尝试任意多个方案；不会保存或发送任何内容，刷新页面会清空输入。
要点
- 分类: 文档
- 在浏览器中运行，无需注册，无需上传。
- 您输入的信息保留在设备上。
- 提供多种语言。
- 内容最后审核日期:
常见问题
Where does robots.txt go?
In the root of your website, so it is available at yourdomain.com/robots.txt.
Does it hide pages from search?
It asks crawlers not to visit them, but pages can still appear if linked elsewhere. Use noindex or a password for private pages.
Where do I put it?
In the root of your site.
Does it hide pages?
No. It only asks crawlers to skip them.