# 屏蔽垃圾爬虫 User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / # 正确的 sitemap 地址 Sitemap: https://yansourcing.com/sitemaps.xml # 屏蔽无价值页面 User-agent: * Disallow: /?s= Disallow: /page/*/?s= Disallow: /search/ Disallow: /tag/ Disallow: /author/ Disallow: /date/ Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php