[aprssig] Screen scraper

[Andrew Rich]

When I was watching the http server here the other day I saw some really
weird stuff.

It was like search engine robots where trying to access the kml file i had
written.

here is an example

69.214.117.165 - - [20/Dec/2005:14:41:48 +1000] "GET /vkaprs.kml HTTP/1.1"
200 56865
"http://us.f815.mail.yahoo.com/ym/ShowLetter?MsgId=1980_19419092_53826_3622_
1023_0_44380_2914_4221209191&Idx=3&YY=11993&inc=25&order=down&sort=date&pos=
0&view=a&head=b&bo
=APRS%5fFOLDER" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1;
.NET CLR 1.1.4322)"


-----------------------------------------
Andrew Rich - VK4TEC
vk4tec at tech-software.net <mailto:vk4tec at tech-software.net>
www.tech-software.net
Brisbane AUSTRALIA



-----Original Message-----
From: aprssig-bounces at lists.tapr.org
[mailto:aprssig-bounces at lists.tapr.org]On Behalf Of Robbie, wa9inf
Sent: Wednesday, 21 December 2005 1:48 AM
To: TAPR APRS Mailing List
Subject: Re: [aprssig] Screen scraper


Gregg,

Thank you, and as I speak, I am using your wonderful program along with
Google-Earth, and it is terrific.

What I was speaking of with Andy's server, was that I was using his
service and left it running for several hours. Was hopeing that I wasn't
one of the "gooses" Andy mentioned, Hi Hi..

With your script, it sits here running flawlessly, except, everyone it
plots is in their cars!! :-) I wonder if you will parse the Icon data
out of the lat/lon one day? No worry now, what I got I like!! You guys
are great... We are having a lot of fun...

Robbie

Gregg Wonderly wrote:
> Robbie - WA9INF wrote:
>
>> I was one of the connecties, and had it running for a few hours
>> following a friend on his way to California. I had it refreshing every
>> minute. So, if I understand, I was accessing the cgi-bin 240 times in
>> the last 4 hours.. It would be nice if that data could be pulled from
>> the APRS-IS without taxing any server??? But someone has to have the
>> cgi-bin running?
>
>
> As I posted earlier, I have another variation of this that can just
> listen to the APRS-IS with an appropriate filter and thus not hit findu
> at all.  It's a Java application that you just download and run (you
> need JRE1.5 or later) on your desktop.  I provides a "server" that
> listens to APRS-IS, (and TNC traffic Real soon now) and then emits KML
> to connected applications.  So, in your google earth network-link setup,
> you put in "http://localhost:<myport>" as the address.  The application
> caches data itself and just returns data to connectees for all stations
> that have a non-0/0 location.
>
> To download and try this out, go to http://aprskml.dev.java.net.  Send
> me an email if you have questions or comments!
>
> Gregg Wonderly
> W5GGW
>
> _______________________________________________
> aprssig mailing list
> aprssig at lists.tapr.org
> https://lists.tapr.org/cgi-bin/mailman/listinfo/aprssig
>
>



_______________________________________________
aprssig mailing list
aprssig at lists.tapr.org
https://lists.tapr.org/cgi-bin/mailman/listinfo/aprssig