Bot

We responsibly crawl your website while looking for the jobs. During crawl we try not to degrade the performance of your website for other users. Below are the details about our crawling policies:

• Our crawling bot is called harsilbot/1.1
• Our bot respects robots.txt on your website and understands the following fields
  • user-agent
  • allow
  • disallow
• The minimum duration between crawls for a website is 24 hours.
• Our bots avoid aggressive crawling by limiting parallel requests.