• Remember this is the date, time, sender and tags for each cable - NOT the text of the cable itself
WikiLeaks embassy cables revelations cover a huge dataset of official documents: 251,287 dispatches, from more than 250 worldwide US embassies and consulates. It's a unique picture of US diplomatic language - including over 50,000 documents covering the current Obama administration. But what does the data include?

The cables themselves come via the huge Secret Internet Protocol Router Network, or SIPRNet. SIPRNet is the worldwide US military internet system, kept separate from the ordinary civilian internet and run by the Department of Defense in Washington. Since the attacks of September 2001, there has been a move in the US to link up archives of government information, in the hope that key intelligence no longer gets trapped in information silos or "stovepipes". An increasing number of US embassies have become linked to SIPRNet over the past decade, so that military and diplomatic information can be shared. By 2002, 125 embassies were on SIPRNet: by 2005, the number had risen to 180, and by now the vast majority of US missions worldwide are linked to the system - which is why the bulk of these cables are from 2008 and 2009.
An embassy dispatch marked SIPDIS is automatically downloaded on to its embassy classified website. From there, it can be accessed not only by anyone in the state department, but also by anyone in the US military who has a security clearance up to the 'Secret' level, a password, and a computer connected to SIPRNet - which astonishingly covers over 3m people. There are several layers of data in here - ranging up to the "SECRET NOFORN" level, which means that they are designed never be shown to non-US citizens. Instead, they are supposed to be read by officials in Washington up to the level of current Secretary of State Hillary Clinton. The cables are normally drafted by the local ambassador or subordinates. The "Top Secret" and above foreign intelligence documents cannot be accessed from SIPRNet.
We've broken down the data for you - and you can download the basic details of every cable (without the actual content) below. Each cable is essentially very structured data. This is what's included:
• A source, ie the embassy or body which sent it
• There is a list of recipients - normally cables were sent to a number of other embassies and bodies
• There is a subject field - basically a summary of the cable
• Tags - each cable was tagged with a number of keyword abbreviations. We've put together a downloadable Google glossary spreadsheet of most of the important ones here
• Body text - the cable itself. We have opted not to publish these in full for obvious security reasons
Thanks to Guardian developer Daithi Ó Crualaoich we've performed some analysis of the data - which you can download for yourself below. The key points are:
• 251,287 dispatches
• The state department sent the most cables in this set, followed by Ankara in Turkey, then Baghdad and Tokyo
• 97,070 of the documents were classified as 'Confidential'
• 28,760 of them were given the tag 'PTER' which stands for prevention of terrorism
• The earliest of the cables is from 1966 - with most, 56,813, from 2009
What can you do with the data?
Download the data
• DATA: every cable with date, time and tags, EXCLUDING BODY TEXT (via Google fusion tables, subject to heavy traffic)
• DATA: every cable with date, time and tags, EXCLUDING BODY TEXT (Zipped CSV file, 3.1MB)
• DATA: our analysis of the cable by location and tag
• DATA: glossary of keywords and tags
World government data
• Search the world's government with our gateway
Development and aid data
• Search the world's global development data with our gateway
Can you do something with this data?
• Flickr Please post your visualisations and mash-ups on our Flickr group
• Contact us at data@guardian.co.uk
• Get the A-Z of data
• More at the Datastore directory
• Follow us on Twitter
Comments
28 November 2010 6:29PM
Without the substance this is a non-story. What's the difference between the US Gov restricting this information and the Guardian doing so>
Link to this comment:
Share28 November 2010 6:40PM
@hsutreal
why don't you head over to wikileaks.org and find out (once the US DOS attacks have stopped)
Link to this comment:
Share28 November 2010 6:51PM
I agree, hsutreal. Given the DoS attack, it falls to the fourth estate to ensure the empire builders can't operate in secrecy. The Guardian has given us nothing.
Link to this comment:
Share28 November 2010 7:03PM
Tried to download data but could not; why is the Guardian using Google, an American Company to publish this information via Google documents and Google products? Looks like Google or someone else is censoring this information.
Link to this comment:
Share28 November 2010 7:08PM
That's what happens when you go up against the Military Industrial Complex.
Link to this comment:
Share28 November 2010 7:10PM
Please host this data on a non-Google site - constantly getting Error 502 here
Link to this comment:
Share28 November 2010 7:12PM
This comment was removed by a moderator because it didn't abide by our community standards. Replies may also be deleted. For more detail see our FAQs.
28 November 2010 7:15PM
Google error here too.
I wonder if this is a legal thing, the Guardian not wanting to be held liable for having this controversial material on its own servers.
Link to this comment:
Share28 November 2010 7:17PM
The wikileaks insurance file is out there now. DOS is a panic move.
Link to this comment:
Share28 November 2010 7:19PM
Thanks a lot Guardian - it is not possible to export the fusion table data and the spreadsheet is denying me permission to even access it.
Guys - even if you get access to the fusion tables, you WON'T be able to download them.
FFS!
Link to this comment:
Share28 November 2010 7:28PM
@lucitex - What, they allow you to go ahead with the leak and then attempt to feebly bring the site down temporarily? What a dystopian horror!
Link to this comment:
Share28 November 2010 7:30PM
These "one man against the Empire" cyber wars were predicted in numerous works of cyberpunk fiction.
Link to this comment:
Share28 November 2010 7:42PM
What makes you think it is a DOS?
It could be millions of people trying to access the same resource. That is in essence a DOS attack.
Link to this comment:
Share28 November 2010 7:43PM
Can we just have a nice, fat zip archive please?
Also, your map shows 1,490 cables from Wellington, NZ, but they're not in your visualisation. We here in NZ would love to know what the Merkins were doing behind our backs.
Link to this comment:
Share28 November 2010 7:43PM
TO EVERYONE WHO CAN'T DOWNLOAD THE DATA:
1) you need to log into your google account
2) then, the "export" button magically is enabled, and you can download it.
have fun.
Link to this comment:
Share28 November 2010 7:44PM
700c: presumably because it looks different to sysadmins who poke it. Also, it started before the data actually went up.
Link to this comment:
Share28 November 2010 7:48PM
It's amazing that while the Guardian is trying not only to publish the leak of this data to people like myself who are not regular 'Wikki Leaks' surfers, and to provide means by which to 'digest' what is a massive amount of data, people are attacking the Guardian.
There is probably a big move to ensure the lowest possible distribution of this information - I doubt very much that the Guardian is complicit in such a move.
A little respect where it is due and understanding of the impact that the release of such data is having in the US administration might be more appropriate.
Link to this comment:
Share28 November 2010 7:48PM
Just gets me the same old blank-screen fuck-up. This sucks.
Link to this comment:
Share28 November 2010 7:53PM
download the wikileaks insurance file here (torrent).
Link to this comment:
Share28 November 2010 7:56PM
It doesn't really matter that if the fusion table works or not, the key phrase here is "without the actual content". It only contains the subject and to/from fields, it's pretty much useless.
Link to this comment:
Share28 November 2010 8:00PM
You'd have thought the US administration would have learned by now surely! Or not...
"A little respect"? eh? What respect have governments showed other countries when they bomb, maim and lie to them?
Very poor.
Link to this comment:
Share28 November 2010 8:18PM
I love the way the US government denounces the leaks as 'irresponsible' after occupying an innocent country and killing hundreds of thousands of innocent civilians.
Link to this comment:
Share28 November 2010 8:25PM
Should we not be concentrating on whats happening over in North Korea with American forces about to test out sea Defences along side south Korean forces. Surely with all the bad publicity that America could well and truly do without right now is digging an even deeper hole towards possible war? It is time to start to watch whats about to happen, not what has Happened. Gisky1
Link to this comment:
Share28 November 2010 8:31PM
There's probably several million people trying to access this stuff.
Server overload.
Despite the pathetic attempts to control this by various Governments - the truth will come out, given time.
Link to this comment:
Share28 November 2010 8:37PM
This comment was removed by a moderator because it didn't abide by our community standards. Replies may also be deleted. For more detail see our FAQs.
28 November 2010 8:58PM
Zip archive of the cable headers (4MB) - http://bit.ly/gPqi67 - much easier to use than 26MB spreadsheet. Download it and grep it yourself.
Link to this comment:
Share28 November 2010 9:42PM
Hello
Obviously, the traffic for this has been very high - we've now added a straight 16MB CSV download of the data - which you can get here. Please shout if that doesn't work either.
If you can get into the Google Fusion version, just go to FILE and DOWLOAD to download it.
Remember, it's just the date, time, sender and tags for each cable, not the body text itself, which we've decided not to publish
Link to this comment:
Share28 November 2010 9:48PM
anyone know if wikileaks have any intention of releasing the complete original files?
Link to this comment:
Share28 November 2010 9:54PM
The date, time, sender and tags for each cable are totally meaningless without the body text. Why even bother providing it?
You've effectively censored the content. Looks like the UK's mainstream media is just as corrupt as ours here in the States.
Link to this comment:
Share28 November 2010 10:31PM
Go to http://cablegate.wikileaks.org/
ALL the text is there!
Link to this comment:
Share28 November 2010 10:36PM
Torrent of the Guardian csv file here.
The official Cablegate site only has the full text from 219 of the transmissions at present (they're staggering the release of the data).
Here's a Coral Cache link to the Cablegate site for much faster browsing:
http://cablegate.wikileaks.org.nyud.net/
Link to this comment:
Share28 November 2010 10:36PM
Riveting X sent Y a secret cable about Z.
What did it say?
We're not telling you.
Hilariously useless guff from the Guardian. They want Cif'ers to take the risk by going onto Wiki then coming back to the Graun & posting the interesting stories. All the news; none of the risks.
Link to this comment:
Share28 November 2010 10:45PM
I was flabbergasted to receive an e-mail from the Guardian alerting me to the articles they are running on this and inviting me to visit the site to read them.
Link to this comment:
Share28 November 2010 11:01PM
note to administrator: why not use an FTP site with multiple mirrors!!! i just don't get this method of data distribution..
Link to this comment:
Share28 November 2010 11:05PM
wikileaks was intercepted by government. but they set up a new one. click here, serch by 'origin' or location/city and find embassy communications.
Link to this comment:
Share28 November 2010 11:05PM
wikileaks was intercepted by government. but they set up a new one. click here, serch by 'origin' or location/city and find embassy communications.
http://cablegate.wikileaks.org/
Link to this comment:
Share28 November 2010 11:31PM
This comment was removed by a moderator because it didn't abide by our community standards. Replies may also be deleted. For more detail see our FAQs.
28 November 2010 11:51PM
Having readthe comments on this thread I can only conclude that most of the contributors are on a par with the british public who think that Anne Widdecombe can dance. Grow up it's a nast little world beyond Islington and Teffnel Park.
Link to this comment:
Share29 November 2010 12:05AM
What a lot of whingers.
Link to this comment:
Share29 November 2010 12:07AM
some of the stuff I quite interesting the king of Saudi has said if Iran gets nuclear weapons so will we and from what the Kuwaitis are say Iran is basically sabre rattling about Israel with the aim of gaining more influence in Iraq and Egypt etc
http://cablegate.wikileaks.org/cable/2010/02/10KUWAIT142.html
http://cablegate.wikileaks.org/cable/2010/02/10RIYADH178.html
Link to this comment:
Share29 November 2010 12:09AM
Isn't there a DA notice on this, which means the UK govt has asked the Guardian not to publish.. wonder how this applies to comments?
http://www.ianfraser.org/the-wikileaks-d-notice-in-full-but-will-it-work/
Link to this comment:
Share29 November 2010 12:12AM
All these leakings only make all of us more insecure and more imperiled. Now, diplomats and nations would hesitate communicating or seeking the opinons and advice of other nations. In short, nations would be more predispose to acting unilaterally instead of being in counsultation with each other. STOP ALL THESE LEAKINGS NOW.
Link to this comment:
Share29 November 2010 12:13AM
- you have to be joking? Do you really think US diplomats are spying on the UN to make us more secure?
Link to this comment:
Share29 November 2010 12:18AM
The real reason behind not releasing the content of the cables, is money. The Guardian, NYT, Der Spiegel and El Pais, made an arrangement with Assange, and they will milk into news as much as possible the content of the cables, which will remain as secret as they were before.
Basically, all these media giants have been used as bullhorns about the existence of classified, secret info, but they want to get as much mileage as they can before the cables become public property, and readers don't care about TG, NYT, DS or EP reselling and rehashing the cables, since they will have the real thing.
Same reason for Assange and Wikileaks to release the cables by drops, that being part of the agreement with the media giants, who are all doing a disservice to themselves, the readers, and freedom of the press.
Tao
Link to this comment:
Share29 November 2010 12:27AM
sohail20
You'll get put on the naughty step.
We need a leak from wikileaks.
Link to this comment:
Share29 November 2010 12:40AM
Taoist think most people will pay for the analysis - few will bother to download and trawl through all this so there will be something to sell regardless. You seem to be ignoring the DA notice also but. obviously the Guardian strives to be a profitable product but that doesn't necessarily mean it is without values
Link to this comment:
Share29 November 2010 1:19AM
Journalism doesn't mean satisfying the squawking demands of the obsessive-compulsive for raw data dumps. I'll take whatever the grauniad chooses to publish, when it chooses to publish it. Thanks guys.
Link to this comment:
Share29 November 2010 1:30AM
The report headlined on this website's homepage, along with its 900+ reader comments, seems to have has disappeared. Did some hypocrite in management get cold feet or what?
Link to this comment:
Share29 November 2010 1:57AM
I enjoyed the part where US embasy staff are requested to collect DNA, biometric and other data on world leaders, UN staff, etc. I can just imagine Americans all over the world sneaking behing people to pull a hair out or running into the toilets to collect stool samples. A subjet for a very funny movie indeed.
I also loved the parts about the Middle East where Egyptian and other Arab officials clearly act as informers to US agencies. Also noted that, judging by their names, many of the American officials meeting with Israelis may be Jewish themselves, so imagine the scenario where Israelis and Jewish Americans are running Middle Eastern Affairs. No wonder Middle East peace is not happening.
Many people will have a ball reading these papers, but I tell you, many US and world leaders will need extra courage to show their faces in public...
Jeez...
Link to this comment:
Share29 November 2010 2:42AM
The data is easier to read from wikileaks itself. For example, using L as the origin (London Embassy) will pull up the text.
http://cablegate.wikileaks.org
Link to this comment:
Share