NomadicExperts
Menu
For site owners

NomadicExpertsBot

The crawler behind NomadicExperts: who we are, what we read and how to opt out.

Who we are

NomadicExpertsBot is run by Zakomo FZCO, Dubai, for NomadicExperts, a service that helps senior contractors find freelance and contract assignments. It reads the public job listings of staffing agencies and project boards once a day.

User-Agent

Our requests carry this User-Agent string:

NomadicExpertsBot/0.1 (+https://nomadicexperts.com/bot; low-volume daily job index)

The product token for robots.txt rules is NomadicExpertsBot

What we read and how

  • Only public pages with job listings, plus sitemaps and robots.txt. No logins, no paywalls, no forms.
  • robots.txt is read before any page; its Crawl-delay is kept, and a rule that names NomadicExpertsBot is always followed.
  • We never try to get past bot checks, captchas or access controls. A site that blocks us is left alone.
  • Requests go one after another per site, at low volume, and each page is fetched once.
  • We pause at least 3 seconds between requests to the same site.

What we show

We show only the title, key facts such as location, rate, work mode and start date, and a link back to your original listing. We do not republish the full text.

Candidates apply on your site, so the link sends them to you.

How to opt out

To stop us reading your site, add a rule for our product token to your robots.txt. We respect it from our next visit:

User-agent: NomadicExpertsBot
Disallow: /

Or write to us and name your domain; we will switch your site off and remove its listings: [email protected]

If you would rather have your listings reach more senior contractors, write to us too — for example about a feed.

The sources page describes the kinds of sites we read.