Kitengeneza Robots.txt

Jenga faili ya robots.txt kwa tovuti yako.

Hufanya kazi kwenye kivinjari chako. Faili zako hazitoki kamwe kwenye kifaa. Tazama jinsi ya kuthibitisha

…

Jinsi ya kufanya

  1. 1
    Jaza visanduku

    Andika namba zako au chagua chaguo unazohitaji.

  2. 2
    Angalia matokeo

    Jibu husasishwa mara moja unapobadilisha thamani.

  3. 3
    Litumie

    Nakili matokeo au yaandike. Hakuna kinachotumwa popote.

About this tool

Choose the crawler, list the paths you do not want crawled and any paths to allow, and add your sitemap address. Copy the result into a file named robots.txt in the root of your site. Remember that robots.txt is a request to crawlers, not a way to hide private pages.

When to use it

Create a robots.txt file for your website, with sitemap and rules.

Tips

Do not block pages you want indexed. Test the file.

Privacy

Everything runs in your browser, so your data is not uploaded or stored.

Mfano uliotatuliwa

With the boxes at their starting values (Crawler (user-agent): All crawlers (*); Allow everything when no paths are listed: Yes; Paths to block (one per line): /admin /private/), the tool shows: User-agent: * Disallow: /admin Disallow: /private/. Change any box to see your own numbers. The result updates as you type, and nothing leaves your browser.

Vidokezo vya matokeo bora

Angalia kila kisanduku kabla ya kuamini matokeo, kwa sababu nambari moja isiyo sahihi hubadilisha jibu zima. Tumia nambari kamili kutoka kwenye hati ya mshahara, ankara, cheti au mkataba na uandike tarehe uliyohesabu. Viwango, vizingiti na sheria hubadilika mara kwa mara, kwa hivyo kwa kodi, ada na masuala ya kisheria chukulia matokeo kuwa makadirio na uyathibitishe na chanzo rasmi kilichotajwa kwenye ukurasa huu. Unaweza kujaribu hali nyingi unavyotaka; hakuna kinachohifadhiwa wala kutumwa na kupakia upya ukurasa husafisha visanduku.

Kwa ufupi

Weka kikokotoo hiki kwenye tovuti yako

Nakili msimbo huu ili kuonyesha kikokotoo kwenye ukurasa wako. Unajumuisha kiungo cha kurudi shobfree.com.

Maswali yanayoulizwa mara kwa mara

Where does robots.txt go?

In the root of your website, so it is available at yourdomain.com/robots.txt.

Does it hide pages from search?

It asks crawlers not to visit them, but pages can still appear if linked elsewhere. Use noindex or a password for private pages.

Where do I put it?

In the root of your site.

Does it hide pages?

No. It only asks crawlers to skip them.

Bila malipo kabisaHakuna ada, hakuna usajili
Faili hubaki za faraghaKila kitu hufanya kazi kwenye kivinjari chako
Rahisi katika lugha yakoInapatikana kwa lugha nyingi