For the past few weeks, Wikileaks has drawn a lot of attention from the media. Mostly because of the Cablegate.
Whether Julian Assange should be considered as a Hero (by publishing information) or Terrorist is an open question. Because of threats from governments, companies in the USA started to ban payment, hosting and dns services to Wikileaks. Soon Wikileaks moved from servers based in the USA to Sweden/Switzerland.
For now Wikileaks seem to be safe, however, they also started a call for mirrors.
Interested to see which people in the world are supporting Wikileaks, I had the idea to visualize the Wikileaks mirrors on Google Earth.
* update 09-12-2010 8pm CET *
– Added Google Earth web plugin links
* update 10-12-2010 10am CET *
– Got featured on ReadWriteWeb / NY Times, thanks guys!
– Stay tuned for more updates!
* update 23-12-2010 10pm CET *
– Embedded Google Earth web plugin in demo section
Data mining
In order to get the data, I went to the official Wikileaks website which had all mirrors listed on this page: mirrors. I wrote a small PHP script that would open up the mirror page and scanned the document for URLs. If a mirror was found, it would be stored in a file. At this moment there are about 1334 mirrors on the website.
Data manipulation
At this point I only have the URLs of the mirrors, but how do I know where these servers are located?
In order to know where the server is located, I used GeoLite City which is a service from MaxMind. GeoLite City allows you to resolve most IPs to a geospatial location. Of course it doesn’t gives the exact location, but usually it is able to show in which City the server is located, which is good enough for my purpose.
After obtaining the GeoLite City database (there is a free version!) I used PHP to write a script that would first resolve the URL to an IP address (PHP function: gethostbyname() ) and then use this IP address to look up the longtitude and latitude.
The last step was converting the data into the KML format (and adding some artificial altitude information) for use with Google Earth.
Data visualization
Below are some of the early results.
Currently the main server (http://46.59.1.2) seem to be located in Sweden, when we view the data in Google Earth we can see that a lot of mirrors are actually located in Europe.
Europe Red pin: Wikileaks server
Yellow pins: Wikileaks mirrors
Greenlines: Connections from the Wikileaks server to a Wikileaks mirror
USA
Wikileaks mirrors in the USA
Sweden
Since some of the servers are at the same location (probably sharing the same data center), we can click on a pin and it will expand to show all mirrors located at this data center.
Screencast / Video
Short screencast (Watch it in HD 720p, in fullscreen mode)
Online Demo
To view this demo you will need to install the Google Earth Browser Plug-in
KML source
Want to try it out locally on your computer?
No problem! Here is how:
- Make sure you’ve installed Google Earth.
- Next download and unzip the file following file Wikileaks Google Earth KML files
- Open the KML files one by one.
- Enjoy!
8 responses
What song’s that on the video? Cheers, Dave.
Superbus - Finest Morning Free dl: http://www.sojusrecords.com/loopjazz/superbus-debut-sjslp1201
Hi! Nice work! Can you please publish the scripts, too?
There’s another visualization, also showing the growing number of mirrors across time: http://labs.vis4.net/wikileaks/mirrors/
@Himpel: i created the other wikileaks mirror visualization and I published the php script that does the scraping at scraperwiki.com You can find it here: http://scraperwiki.com/scrapers/wikileaks-mirror-list/edit/
Thanks for the fine work. For the app loaded and running in a few minutes. Question: how can I display the green mirror-to-central links?
Open up the wikileaks-edges.kml file in Google Earth
Thanks. Do you mind publishing the map and the plotting, too?