Create a robots.txt file for your website without writing code. Set allow and disallow rules for each bot, add your sitemap URL and download the file. https://www.seomate.in/robots-txt-generator/