Fayil robots.txt ɗin yana a da mahimmanci ga dabarun SEO na gidan yanar gizon ku. Yana gaya wa injunan bincike waɗanne sassa na rukunin yanar gizon ku ya kamata a ba da lissafi kuma waɗanda yakamata a yi watsi da su. Ta amfani da a Robots.txt Generator , zaku iya ƙirƙirar a ingantaccen ingantaccen robots.txt fayil da sauri don sarrafa yadda injunan bincike ke rarrafe da ƙididdige abubuwan ku, inganta hangen nesa na gidan yanar gizon ku da aikin SEO gabaɗaya.
Menene a Robots.txt Fayil?
Fayil robots.txt fayil ne a bayyanannen rubutu wanda ke zaune a tushen adireshin gidan yanar gizon ku. Yana ba da "hukunce-hukuncen jan hankali" ga bots ɗin injin bincike, yana gaya musu waɗanne sassa na rukunin yanar gizon ku ya kamata a yi maƙasudi da waɗanne sassa ya kamata a cire su daga sakamakon bincike. Wannan fayil ɗin yana ɗaya daga cikin abubuwan farko da a injin bincike ke nema lokacin da ake rarrafe rukunin yanar gizon ku.
Me yasa Amfani da a Robots.txt Fayil?
Sarrafa Injin Bincike: Hana injunan bincike fiɗa wasu shafuka ko kundayen adireshi.
Kare Abubuwan da ke Keɓaɓɓe: Toshe shafuka masu mahimmanci, wuraren gudanarwa, da albarkatun ciki.
Haɓaka Budget Crawl: Mayar da hankalin injin bincike akan mahimman shafukanku.
Haɓaka Ayyukan SEO: Rage abun ciki mai kwafi kuma hana ƙananan shafuka masu inganci daga fihirisa.
Saurin Haɓaka Shafi: Rage nauyin uwar garken ta hanyar taƙaita damar bot zuwa manyan albarkatu.
Umarnin gama gari a ciki Robots.txt
Wakilin mai amfani: Yana ƙayyadad da bot ɗin da ƙa'idodin ke aiki(misali, Googlebot, Bingbot).
Hana: Yana toshe damar zuwa takamaiman shafuka ko kundayen adireshi.
Ba da izini: Ba da damar isa ga takamaiman shafuka ko kundayen adireshi, ko da an hana littafin adireshi na iyaye.
Taswirar Yanar Gizo: Yana ba da wurin wurin taswirar rukunin yanar gizon ku don saurin fiddawa.
Crawl-Delay: Yana saita a jinkiri tsakanin buƙatun shafi don rage nauyin uwar garken(babu goyon bayan duk bots).
Misalai na Robots.txt Fayiloli
Fayil na asali Robots.txt:
User-Agent: *
Disallow: /admin/
Disallow: /private/
Allow: /public/
Sitemap: https://yourwebsite.com/sitemap.xml
Toshe Duk Bots:
User-Agent: *
Disallow: /
Bada Duk Bots:
User-Agent: *
Allow: /
Toshe a Takamaiman Bot:
User-Agent: Googlebot
Disallow: /private/
Toshe a Takamaiman Fayil:
User-Agent: *
Disallow: /private-data.html
Yadda Ake Amfani da Robots.txt Generator
Zaɓi a Wakilin Mai Amfani: Zaɓi a bot(misali, Googlebot, Bingbot, Yandex) ko "Duk Injin Bincike" .
Ƙara Hannun Hannu: Shigar da kundayen adireshi ko fayilolin da kuke son toshewa(misali, /admin/ , /private/ ).
Ƙara Hanyoyi Ba da izini: Ƙayyade hanyoyin da kuke son ba da izini(misali, /jama'a/ , /blog/ ).
Ƙara a URL ɗin Taswirar Yanar Gizo: Samar da URL ɗin taswirar rukunin yanar gizon ku(misali, < a href="https://yourwebsite.com/sitemap.xml">https://yourwebsite.com/sitemap.xml ).
Ƙirƙirar Fayil ɗin: Danna "Ƙirƙirar Robots.txt " don ƙirƙirar fayil ɗin ku.
Kwafi da Amfani: Kwafi robots.txt fayil ɗin da aka samar kuma loda shi zuwa tushen tushen gidan yanar gizon ku.
Mafi kyawun Ayyuka don Robots.txt Fayiloli
Toshe Shafukan da ake buƙata kawai: Kar a toshe shafukan da kuke son sanya matsayi a cikin injunan bincike.
Yi amfani da Cikakkun URLs don Taswirar Yanar Gizo: Tabbatar cewa URL ɗin shafin yanar gizon ku ya cancanta.
Guji Toshe CSS da Fayilolin JS: Waɗannan fayilolin suna da mahimmanci don fassarawa da ƙididdigewa.
Gwada Fayil ɗin ku: Yi amfani da Robots.txt Mai Gwaji a cikin Console Bincike na Google don tabbatar da ƙa'idodin ku.
Ci gaba da Sauƙi: Guji ƙayyadaddun ƙa'idodi waɗanda zasu iya rikitar da bots.
Kammalawa
Ƙirƙirar ingantaccen robots.txt fayil yana da mahimmanci don sarrafa yadda injunan bincike ke rarrafe da lissafin gidan yanar gizon ku. Zai iya taimakawa inganta aikin SEO na rukunin yanar gizonku, kare abun ciki mai mahimmanci, da haɓaka albarkatun sabar ku. Yi amfani da Robots.txt janareta na mu kyauta don ƙirƙirar fayil ɗinku cikin sauri da sauƙi, da kuma ɗaukar cikakken ikon ganin injin binciken gidan yanar gizon ku.