Skip to content

Commit

Permalink
robots.txt
Browse files Browse the repository at this point in the history
  • Loading branch information
sean-david-welch committed Aug 25, 2024
1 parent aff4771 commit e80d9db
Showing 1 changed file with 33 additions and 0 deletions.
33 changes: 33 additions & 0 deletions client/public/robots.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
# Allow all search engines to index public pages
User-agent: *
Disallow: /admin
Disallow: /login
Disallow: /forms
Disallow: /delete
Disallow: /account
Disallow: /warranty
Disallow: /warranty-form
Disallow: /supplier-form
Disallow: /spareparts-form
Disallow: /blogs-form
Disallow: /exhibition-form
Disallow: /users
Disallow: /settings

# Block query parameters (optional, but prevents potential duplicate content issues)
Disallow: /*?

# Allow search engines to crawl important sections
Allow: /blogs
Allow: /blogs/*
Allow: /suppliers
Allow: /suppliers/*
Allow: /spareparts
Allow: /spareparts/*
Allow: /exhibitions
Allow: /exhibitions/*
Allow: /products
Allow: /products/*

# Sitemap location
Sitemap: https://www.farmec.ie/sitemap.xml

0 comments on commit e80d9db

Please sign in to comment.