The other day, I sent an email to info@eu-searchperspective.com, asking them about how they crawl.
Today, I got a response that is very likely the result of some slop wrangling, because it's asking me how I wish to use their API.
I very explicitly told them I have no such desire. Lets see if I can get through to a human!
You've reached out to us regarding our Staan API and we thank you for your interest.
I didn't. I reached out asking about how the European Search Perspective's index is built, whether there's a specific crawler user agent or IP range I can block, or any other way to opt out of being indexed.
My question remains: how do I opt out of being indexed by the European Search Perspective? I have no desire to debate whether opting out is good for me (it is, and that is my decision). I want to know how I can do so.
For the record, I have the following in my /robots.txt:
User-Agent: *
Disallow: /
I also set the x-robots-tag HTTP response tag like such:
x-robots-tag: noindex, nofollow, nosnippet, noimageindex, noarchive, nocache, notranslate
What else do I need to do to stay out of the index?
Can you confirm your interest goes to the API web search for AI ?
It is not. I have no desire to use the API. I want to opt out of being indexed.
What is your main use case you plan to build with our services? do you have any test queries to share ?
None whatsoever. I want to opt out of being indexed.
Which are your targeted territories or languages ?
None. I want to opt out of being indexed.
Do you have an idea on the volumes expected ?
None. I want to opt out of being indexed.
Please note that our Staan API is available in French so far, and will be available shortly in German and end of the year in English.
This is irrelevant, I have no plans to use the API. I merely want to opt out of being indexed.
The pricing is as follow :
...also irrelevant. I want to opt out of being indexed, is all.
Please get back to me with as many information as possible in order to deliver an API key and send you the order form.
I have no need for an API key, and I very much do not wish to order anything, except to stay the heck out of Qwant's and the EU Search Perspective's index.
How do I achieve THAT?
I should send them a formal GDPR data erasure request or something.
@buherator It's full on AI pilled bullshit on top of that too. :(
Well noted Gergely
We'll handle with THAT
Warm regards
What the fuck does that mean. Am I talking to a human here?
We'll handle with THAT
Just so we're clear: is my understanding correct, that this means that having a robots.txt that disallows everything and/or an x-robots-tag that also opts out of everything will result in my sites not being included in the index, and they will not appear in search results, nor will they be used for any other purpose?
Thank you for your swift answer, and the clarification in advance.
Yes you wont' be crawled neither indexed
Thank you!
So it looks like whatever this EU Search Perspective is, they will respect /robots.txt and/or x-robots-tag. Misguided as they may be, at least they honor these.
That already puts them far above most other search engines and crawlers. They're still misguided, but they aren't making that my problem.
@krnlg I'm in a good mood, so I'll assume I did talk to a human afterall. One that may have used a misinfo machine to summarize my original question (it wasn't exactly short, mostly because it was submitted through their API request form, 'cos I found that earlier than their email address), but human otherwise.