Wiecie może jakie są ip, hosty najpopularniejszych robotow internetowych? Prowadze katalog linkow i chcialbym usunac ze statystyk linki otwarte wlasnie przez nie.
Z gory dzieki
0
0
Zajrzyj do pliku 404.php z Coyote'a tam są hosty kilku robotów.
0
tu masz IP robotów googla:
209.185.253.167 c2.googlebot.com
209.185.253.168 c3.googlebot.com
209.185.253.169 c1.googlebot.com
209.185.253.170 c4.googlebot.com
209.185.253.171 c5.googlebot.com
209.185.253.172 c6.googlebot.com
209.185.253.173 c7.googlebot.com
209.185.253.174 c8.googlebot.com
209.185.253.175 c9.googlebot.com
209.185.253.176 c10.googlebot.com
209.185.253.177 c11.googlebot.com
209.185.253.178 c12.googlebot.com
209.185.253.179 c13.googlebot.com
209.185.253.180 c14.googlebot.com
209.185.253.181 c15.googlebot.com
209.185.253.182 c16.googlebot.com
209.185.253.183 c17.googlebot.com
209.185.253.184 c18.googlebot.com
209.185.253.185 c19.googlebot.com
209.185.253.186 c20.googlebot.com
209.185.253.187 c21.googlebot.com
209.185.253.188 c22.googlebot.com
209.185.108.138 a1.google.com
209.185.108.139 a2.google.com
209.185.108.140 a3.google.com
209.185.108.141 a4.google.com
209.185.108.142 a5.google.com
209.185.108.143 a6.google.com
209.185.108.144 a7.google.com
209.185.108.145 a8.google.com
209.185.108.146 a9.google.com
209.185.108.147 a10.google.com
209.185.108.148 a11.google.com
209.185.108.149 a12.google.com
209.185.108.150 a13.google.com
209.185.108.151 a14.google.com
209.185.108.152 a15.google.com
209.185.108.153 a16.google.com
209.185.108.154 a17.google.com
209.185.108.155 a18.google.com
209.185.108.156 c2.google.com
209.185.108.157 c3.google.com
209.185.108.158 c1.google.com
209.185.108.159 a19.google.com
209.185.108.160 a20.google.com
209.185.108.161 c4.google.com
209.185.108.162 a21.google.com
209.185.108.163 a22.google.com
209.185.108.164 a23.google.com
209.185.108.165 a24.google.com
209.185.108.134 ns.google.com
209.185.108.135 ns2.google.com
64.209.181.52 crawler1.googlebot.com
64.208.33.33 crawl1.googlebot.com
64.209.181.53 crawler2.googlebot.com
64.68.82.22
64.68.82.23
64.68.82.24
64.68.82.25
64.68.82.26
64.68.82.27
64.68.82.28
64.68.82.29
64.68.82.30
64.68.82.1
64.68.82.2
64.68.82.3
64.68.82.4
64.68.82.5
64.68.82.6
64.68.82.7
64.68.82.8
64.68.82.9
64.68.82.10
64.68.82.11
64.68.82.12
64.68.82.13
64.68.82.14
64.68.82.15
64.68.82.16
64.68.82.17
64.68.82.18
64.68.82.19
64.68.82.20
64.68.82.21
64.68.82.50
64.68.82.51
64.68.82.52
64.68.82.53
64.68.82.54
64.68.82.55
64.68.82.56
64.68.82.57
64.68.82.58
64.68.82.59
64.68.82.60
64.68.82.31
64.68.82.32
64.68.82.33
64.68.82.34
64.68.82.35
64.68.82.36
64.68.82.37
64.68.82.38
64.68.82.39
64.68.82.40
64.68.82.41
64.68.82.42
64.68.82.43
64.68.82.44
64.68.82.45
64.68.82.46
64.68.82.47
64.68.82.48
64.68.82.49
64.68.82.76
64.68.82.77
64.68.82.78
64.68.82.79
64.68.82.80
64.68.82.61
64.68.82.62
64.68.82.63
64.68.82.64
64.68.82.65
64.68.82.66
64.68.82.67
64.68.82.68
64.68.82.69
64.68.82.70
64.68.82.71
64.68.82.72
64.68.82.73
64.68.82.74
64.68.82.75
altavista:
204.123.9.76 add-url.altavista.com Scooter/2.0 G.R.A.B. V1.1.0
204.152.191.47 scooter.pa.alta-vista.net Scooter/2.0 G.R.A.B. V1.1.0
204.123.9.123 test-scooter.av.pa-x.dec.com Scooter/2.0 G.R.A.B. V1.1.0
204.123.9.18 av-dev2.av.pa-x.dec.com Scooter/2.0 G.R.A.B. V1.1.0
204.123.9.19 scooter2.av.pa-x.dec.com Scooter/2.0 G.R.A.B. V1.1.0
204.123.9.20 scooter.pa-x.dec.com Scooter/2.0 G.R.A.B. V1.1.0
204.123.9.23 brillo.av.pa-x.dec.com Scooter/2.0 G.R.A.B. V1.1.0
204.123.9.47 vscooter.av.pa-x.dec.com vscooter/2.0 G.R.A.B. V1.1.0
204.123.9.76 add-url.altavista.com Scooter/1.0
204.123.9.95 av-dev3.av.pa-x.dec.com Scooter/2.0 G.R.A.B V1.0
204.152.191.41 av-dev4.pa.alta-vista.net Scooter/2.0 G.R.A.B. V1.1.0
204.152.191.47 scooter.pa.alta-vista.net Scooter/2.0 G.R.A.B. V1.1.0
204.152.191.52 vscooter.pa.alta-vista.net
204.152.190.148
204.152.191.57
128.177.243.155 scooter2.sv.alta-vista.net
204.152.191.47 scooter.pa.alta-vista.net
204.152.191.58
128.177.243.82 test-scooter.sv.alta-vista.net
128.177.243.86 bigip-nat.sv.alta-vista.net
212.187.226.111 scooter.aveurope.co.uk ??? (don't know if this is alta)
Lycos:
166.48.225.254 lycosinc.NorthRoyalton.cw.net Mozilla/4.0 (compatible; MSIE 5.0; Windows NT)
206.79.171.157 sjc-fe13-1.sjc.lycos.com
206.79.171.18 sjc-fe2-2.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.19 sjc-fe3-1.sjc.lycos.com
206.79.171.20 sjc-fe3-2.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.21 sjc-fe4-1.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.22 sjc-fe4-2.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.23 sjc-fe5-1.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.24 sjc-fe5-2.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.25 sjc-accipiter1f.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.81 sjc-fe8-1.sjc.lycos.com Lycos_Spider_(T-Rex)
206.79.171.89 sjc-fe10-1.sjc.lycos.com
206.79.171.97 sjc-fe12-1.sjc.lycos.com
206.79.171.85 sjc-fe9-1.sjc.lycos.com
207.77.90.136 www-jp.lycos.com Lycos_Spider_(T-Rex)
207.77.90.14 icreport.lycos.com Lycos_Spider_(T-Rex)
207.77.90.183 lycosidae.lycos.com Lycos_Spider_(T-Rex)
207.77.90.185 lycosidae.lycos.com Lycos_Spider_(T-Rex)
207.77.90.186 lycosidae.lycos.com Lycos_Spider_(T-Rex)
207.77.90.187 lycosidae.lycos.com Lycos_Spider_(T-Rex)
207.77.90.20 a2z.lycos.com Lycos_Spider_(T-Rex)
207.77.91.184 spider4.srv.pgh.lycos.com Lycos_Spider_(T-Rex)
208.146.26.19 res5.eng.pgh.lycos.com Lycos_Spider_(T-Rex)
208.146.26.233 zebra.eng.pgh.lycos.com Lycos_Spider_(T-Rex)
208.146.27.123 srd09.ma.lycos.com
208.146.27.124 srd10.ma.lycos.com
208.146.27.94 srd06.ma.lycos.com
208.146.27.95 srd07.ma.lycos.com
208.146.27.96 srd08.ma.lycos.com
209.67.228.109 bos-fe8-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.15 bos-fe1-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.159 bos-fe6-4.bos.lycos.com
209.67.228.166 bos-fe9-1.bos.lycos.com
209.67.228.17 bos-fe2-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.174 bos-fe11-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.178 bos-fe12-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.182 bos-fe13-1.bos.lycos.com
209.67.228.19 bos-fe3-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.21 bos-fe4-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.23 bos-fe5-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.228.42 bos-fe6-1.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.229.100 bos-spider9b.bos.lycos.com
209.67.229.101 bos-spider10b.bos.lycos.com
209.67.229.102 bos-spider11b.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.229.137 bos-catalog1.bos.lycos.com
209.67.229.138 bos-spider1.bos.lycos.com
209.67.229.139 bos-spider2.bos.lycos.com
209.67.229.140 bos-spider3.bos.lycos.com
209.67.229.141 bos-spider4.bos.lycos.com
209.67.229.142 bos-spider5.bos.lycos.com
209.67.229.143 bos-spider7.bos.lycos.com Lycos_Spider_(T-Rex)
209.67.229.143 bos-spider6.bos.lycos.com
209.67.229.144 bos-spider7.bos.lycos.com
209.67.229.62 bos-catalog4.bos.lycos.com
209.67.229.85 bos-catalog2.bos.lycos.com
216.35.194.183
216.35.194.184
216.35.194.185
216.35.194.186
216.35.194.187
216.35.194.188
216.35.194.189
216.35.194.190