Active search engines
with own crawler and database at 12/12/2010:
|
| Search engine |
URL search engine |
Bot/crawler |
URL bot/crawl help |
URL add/sumit website |
Result keyword "copyright" |
Result keyword "majesticseo" |
| Yahoo |
http://search.yahoo.com |
Slurp |
http://help.yahoo.com/help/us/ysearch/slurp |
http://siteexplorer.search.yahoo.com/submit |
83,000,000 |
4,350 |
| |
http://nl.yahoo.com |
|
|
|
26,600,000,000 |
25,200 |
| |
http://fr.yahoo.com |
|
|
|
25,900,000,000 |
25,100 |
| |
http://uk.yahoo.com |
|
|
|
25,900,000,000 |
24,800 |
| Google |
http://www.google.com |
Googlebot |
http://www.google.com/bot.html |
http://www.google.com/addurl/?continue=/addurl |
2,660,000,000 |
17,400 |
| |
http://www.google.nl |
|
|
|
2,640,000,000 |
17,300 |
| |
http://www.google.be |
|
|
|
2,670,000,000 |
17,400 |
| |
http://www.google.fr |
|
|
|
2,680,000,000 |
17,300 |
| |
http://www.google.co.uk |
|
|
|
2,750,000,000 |
17,400 |
| Bing |
http://www.bing.com |
bingbot |
http://www.bing.com/bingbot.htm |
http://www.bing.com/webmaster/SubmitSitePage.aspx |
88,000,000 |
4,660 |
| |
http://www.bing.com/?cc=nl |
msnbot |
http://search.msn.com/msnbot.htm |
|
86,600,000 |
4,660 |
| |
http://www.bing.com/?cc=be |
|
|
|
86,500,000 |
4,920 |
| |
http://www.bing.com/?cc=fr |
|
|
|
28,700,000 |
4,480 |
| |
http://www.bing.com/?cc=gb |
|
|
|
93,800,000 |
17,700,00 |
| Exalead |
http://www.exalead.com/search/ |
Exabot |
http://www.exabot.com/go/robot |
http://www.exalead.com/search/web/submit/ |
1,709,495,598 |
1,882 |
| |
http://www.exalead.fr/search/ |
|
|
|
1,709,495,598 |
1,882 |
| Teoma |
http://www.teoma.com |
Ask Jeeves/Teoma |
http://about.ask.com/en/docs/about/webmasters.shtml |
http://about.ask.com/en/docs/about/webmasters.shtml#18 |
1,320,000,000 |
4,580 |
| Ask |
http://us.ask.com |
Ask Jeeves/Teoma |
http://about.ask.com/en/docs/about/webmasters.shtml |
http://about.ask.com/en/docs/about/webmasters.shtml#18 |
- |
- |
| |
http://nl.ask.com |
|
|
|
254,050,000 |
509 |
| |
http://fr.ask.com |
|
|
|
255,570,000 |
518 |
| |
http://uk.ask.com |
|
|
|
1,040,000,000 |
4,570 |
| Goo |
http://search.goo.ne.jp |
ichiro |
http://help.goo.ne.jp/help/article/704/ |
http://addurl.goo.ne.jp/mobile/ |
1,310,000,000 |
12,000 |
| Gogo |
http://go.mail.ru |
Mail.Ru |
http://go.mail.ru/help_robots.html |
http://go.mail.ru/addurl |
1,220,000,000 |
4,290 |
| Rambler |
http://nova.rambler.ru/search |
StackRambler |
http://help.rambler.ru/article.html?id=327&s=221 |
http://robot.rambler.ru/cgi-bin/addsite.cgi |
438,000,000 |
488 |
| Blekko |
http://blekko.com |
ScoutJet |
http://www.scoutjet.com |
- |
266,000,000 |
2,000 |
| Gigablast |
http://www.gigablast.com |
Gigabot |
http://www.gigablast.com/spider.html |
http://www.gigablast.com/addurl |
266,621,632 |
557 |
| Naver |
http://web.search.naver.com/search.naver |
Yeti |
http://help.naver.com/robots |
- |
319,553,692 |
24 |
| Become |
http://www.become.com |
BecomeBot |
http://discoverourtown.become.com/site_owners.html |
- |
152,147,217 |
19 |
| Yandex |
http://www.yandex.com |
Yandex |
http://yandex.com/bots |
- |
191,000,000 |
2,120 |
| Baidu |
http://www.baidu.com |
Baiduspider |
http://www.baidu.com/search/spider.htm |
http://www.baidu.com/search/url_submit.html |
100,000,000 |
2,120 |
| Seznam |
http://search.seznam.cz |
SeznamBot |
http://fulltext.sblog.cz/robot/ |
http://search.seznam.cz/pridej-stranku |
88,409,667 |
34 |
| Gais |
http://gais.cs.ccu.edu.tw |
Gaisbot |
robot06@gais.cs.ccu.edu.tw |
- |
77,126,658 |
0 |
| Voila |
http://search.ke.voila.fr |
VoilaBot |
support.voilabot@orange-ftgroup.com |
- |
1,790,000,001 |
3,871 |
| Entireweb |
http://www.entireweb.com |
Speedy Spider |
http://www.entireweb.com/about/search_tech/speedy_spider |
http://www.entireweb.com/free_submission/ |
49,800,000 |
561 |
| Daum |
http://ws.daum.net |
Daumoa |
http://ws.daum.net/aboutWebSearch.html |
- |
64,783,317 |
160 |
| Kobala |
http://www.kobala.nl |
Vagabondo |
http://webagent.wise-guys.nl |
- |
- |
- |
| |
http://www.kobala.be |
|
|
|
- |
- |
| Botje |
http://www.botje.com |
Plukkie |
http://www.botje.com/plukkie.htm |
http://85.17.171.225/searchall/addurl.aspx |
11,165,556 |
86 |
| |
http://www.botje.nl |
|
|
|
24,593,839 |
105 |
| |
http://www.botje.be |
|
|
|
7,724,121 |
31 |
| |
http://www.botje.fr |
|
|
|
8,208,232 |
39 |
| |
http://www.botje.co.uk |
|
|
|
12,290,490 |
26 |
| Sogou |
http://www.sogou.com |
Sogou web spider |
http://www.sogou.com/docs/help/webmasters.htm#07 |
http://www.sogou.com/feedback/urlfeedback.php |
11,923,979 |
277 |
| Mojeek |
http://www.mojeek.com |
MojeekBot |
http://www.mojeek.com/bot.html |
http://www.mojeek.com/addurl |
22,187,817 |
202 |
| |
http://www.mojeek.co.uk |
|
|
|
22,187,817 |
202 |
| Ayell |
http://www.ayell.eu |
Eurobot |
http://eurobot.ayell.eu |
http://www.ayell.de/url/add/type/simple |
21,071,809 |
40 |
| |
http://www.ayell.nl |
|
|
|
- |
- |
| |
http://www.ayell.be |
|
|
|
- |
- |
| |
http://www.ayell.co.uk |
|
|
|
21,071,809 |
40 |
| Guruji |
http://www.guruji.com |
GurujiBot |
http://www.guruji.com/en/WebmasterFAQ.html |
http://dir.guruji.com/misc/SubmitSite.php |
16,560,861 |
1,981 |
| Jyxo |
http://jyxo.vybereme.cz |
Jyxobot |
- |
http://jyxo.vybereme.cz/d/submit |
14,203,920 |
129 |
| Webwombat |
http://www.webwombat.com.au |
www.webwombat.com.au |
- |
http://www.webwombat.com.au/submit/index.htm |
9,369,477 |
1 |
| Setooz |
http://nl.setooz.com |
SETOOZBOT |
http://www.setooz.com/oozbot.html |
- |
704,600 |
32,700 |
| Zscho |
http://www.zscho.de/en/ |
Zscho.de |
http://zscho.de/de/bot.html |
http://www.zscho.de/submit_page.jsp |
- |
- |
| Acoon |
http://www.acoon.com |
Acoon Robot |
- |
http://www.acoon.de/addurl.asp |
- |
2 |
| Soso |
http://www.soso.com |
Sosospider |
http://help.soso.com/webspider.htm |
http://www.soso.com/help/usb/urlsubmit.shtml |
6,180,000 |
817 |
| Iltrovatore |
http://www.iltrovatore.it |
Iltrovatore-Setaccio |
http://www.iltrovatore.it/bot.html |
- |
4,514,370 |
0 |
| Abacho |
http://www.abacho.com |
AbachoBOT |
|
http://www.abacho.de/url-anmeldung/ |
- |
- |
|
http://www.abacho.co.uk |
|
|
|
- |
- |
| Wotbox |
http://www.wotbox.com |
Wotbox |
bot@wotbox.com |
http://www.wotbox.com/addurl |
281,917 |
0 |
| |
http://fr.wotbox.com |
|
|
|
- |
- |
| |
http://www.wotbox.co.uk |
|
|
|
- |
- |
| Amfibi |
http://www.amfibi.com |
Cabot |
http://www.amfibi.com/cabot/ |
http://www.amfibi.com/addurl/ |
1,370,933 |
2 |
| Walhello |
http://www.walhello.info |
appie |
- |
http://www.walhello.com/addlinkgl.html |
186,492 |
3 |
| Yacy |
http://www.yacy.de |
yacybot |
http://yacy.net/bot.html |
- |
227,139 |
0 |
| Yioop |
http://www.yioop.com |
YioopBot |
http://www.yioop.com/bot.php |
- |
436,876 |
0 |
| Youdao |
http://www.youdao.com |
YoudaoBot |
http://www.youdao.com/help/webmaster/spider |
http://tellbot.youdao.com/report?keyFrom=help |
67,500 |
185 |
| Zhongsou |
http://www.zhongsou.com |
- |
- |
http://ads.zhongsou.com/register/page.jsp |
48,400,000 |
0 |
Not active any more or domain active but bought and use other
crawler/database or changed in meta search engine at 12/12/2010:
|
| Cuil |
http://www.cuil.com |
Twiceler |
http://www.cuil.com/twiceler/robot.html |
Stopped 9/10/2010 out of
money |
|
|
| Searchme |
http://www.searchme.com |
Charlotte |
http://www.searchme.com/support/ |
Stopped 07/24/2009 out of money |
|
|
| Wisenut |
http://www.wisenut.com |
ZyBorg |
http://www.wisenutbot.com |
Stopped 09/28/2007 3/12/2002 bought by Looksmart
$9.25mln all-stocks deal |
|
|
| Accoona |
http://www.accoona.com |
Accoona-AI-Agent |
aicrawler at accoonabot dot
com |
Stopped 10/2008 11/5/2008 bought by Masterseek |
|
|
| Openfind |
http://www.openfind.com |
Openbot |
robot-response@openfind.com.tw |
Stopped started search for companies |
|
|
| Sproose |
http://www.sproose.com |
sproose |
http://www.sproose.com/bot.html |
Stopped started
recommendation engine at same domain |
|
|
| Majestic12 |
http://search.majestic12.co.uk |
MJ12bot |
http://majestic12.co.uk/bot.php |
Stopped started search for SEO
http://www.majesticseo.com |
|
|
| Wikia |
http://search.wikia.com |
wikia-robot |
|
Stopped 5/14/2009 |
|
|
| Boitho |
http://www.boitho.com |
boitho.com-dc |
http://www.boitho.com/dcbot.html |
Stopped started search for companies
http://www.searchdaimon.com |
|
|
| Mozdex |
http://www.mozdex.com |
mozDex |
http://www.mozdex.com/bot.html |
Down |
|
|
| Euroseek |
http://www.euroseek.com |
Arachnoidea |
arachnoidea@euroseek.com |
Stopped 11/2001 out of money bought by
WorldLight now later renamed to Entireweb |
|
|
| Ilse |
http://www.ilse.nl |
INGRID |
http://webmaster.ilse.nl/jsp/webmaster.jsp |
Use Google? |
|
|
| Vindex |
http://www.vindex.nl |
|
|
Use Google? |
|
|
| Fireball |
http://www.fireball.de |
Firefly |
|
Use Google? |
|
|
| Tricus |
http://www.tricus.com |
BlitzBOT |
BlitzBOT@tricus.net |
Stopped started Cogisum
Intermedia search for companies
http://www.cogia.de |
|
|
| OsO |
http://oso.octopodus.com |
OsO |
http://oso.octopodus.com/abot.html |
Down |
|
|
| Altavista |
http://www.altavista.com |
Scooter |
|
02/20/2003 bought by Overture from Digital
Equipment
for $140mln cash and stock |
|
|
| Alltheweb |
http://www.alltheweb.com |
FAST-WebCrawler |
http://fast.no/support/crawler.asp |
02/25/2003 bought by
Overture from Fast for 530mln Norway Kroner |
|
|
| Lycos |
http://www.lycos.com |
Lycos_Spider |
|
08/18/2010 bought by Ybrant digital from Daum
communications for $36mln |
|
|
| Hotbot |
http://www.hotbot.com |
Slurp |
http://www.inktomi.com/slurp.html |
12/23/2002 bought by Yahoo from Inktomi for
$235mln |
|
|
| Excite |
http://www.excite.com |
ArchitextSpider |
|
01/19/1999 bought by Home Network |
|
|
| Infoseek |
http://www.infoseek.com |
Infoseek Sidewinder |
|
1998 bought by Wall Disney |
|
|
| Go |
http://go.com |
|
|
Disney redirect to Yahoo |
|
|
| Iask |
http://www.iask.com |
iaskspider |
http://iask.com/help/help_index.html |
Sina.com redirect to Google |
|
|
| Webcrawler |
http://www.webcrawler.com |
WebCrawler |
|
Bought by Excite |
|
|
| Northern
Light |
http://www.northernlight.com |
Gulliver |
|
Stopped 01/16/2002 out of
money |
|
|