|
October 16, 2006 7:17 AM
Interior Dialogue: An Investigative Report![]() When PJM learned last week that certain web sites were being blocked at the US Department of the Interior, we asked Baron Bodissey to take an up-close and personal look at what was going on. What he found does not increase trust in the transparency of big government — “In addition to Penpal, I had a second source at the Department of the Interior who confirmed the selective blocking, but would not go public or consent to be quoted. A third source said this: Ordinarily I would put this in the internet rumor file. But as chance would have it, I do know some people who work at the Department of Interior. Sure enough, it looks like the right side of the blogosphere is being blocked while the left side is wide open.” by Baron Bodissey of Gates of Vienna Last Wednesday an urgent email arrived from a woman I’ll call Penpal, an employee at the Department of the Interior. She alerted me to the selective blocking of conservative blogs on the internal network at DOI, and wanted to get the word out to the right-leaning side of the blogosphere. Since she had no contact information for Charles Johnson at Little Green Footballs, she wrote to me instead. She soon followed up with a list of blocked and unblocked blogs. Among those blocked were LGF, Gates of Vienna, Michelle Malkin, Belmont Club, and a number of other prominent conservative sites. Left unblocked were Daily Kos, Atrios, Democratic Underground, and other lefty favorites. “In fact,” she said, “every blog linked to off of DailyKos seems to work.” I quickly put up a post about it and contacted Charles, who posted his own account and updated it with additional information. It quickly spread from there, passing through Instapundit, Atlas Shrugs, Michelle Malkin, and many other blogs, forums, and news sites. That evening Roger Simon asked me to do an investigation and report on the subject for Pajamas Media. This sounded like a job for the 910 Group. I started a topic there, asking for help investigating the internet-filtering software used by the Department of the Interior. By the next morning, the intrepid 910 sleuths had tips and information about the software used, the way it was likely to have been implemented, and details about the internal organization and contact information at DOI. The Interior Department uses software written and supported by a company called 8e6. Its head office is in California, and I am in Virginia, so there was no point in calling them up for several hours. However, there are two branch offices on the East Coast, and I was able to contact the sales representative at the New York branch of 8e6. He had little technical information on their product, but promised to contact headquarters and have them call me. I then placed phone calls to the Department of the Interior, beginning with the office of the Chief Information Officer, Hord Tipton. I spoke with his secretary and explained my mission. She took my number and said that Mr. Tipton would return my call. When California office hours arrived, Eric Lundbohm, 8e6’s Vice President of Marketing, contacted me. He was pleasant and informative about his company’s product, explaining that 8e6 sells software for network use. It classifies websites and provides updates; however, it does not specify which sites will be blocked; the end user performs that function. This made sense — I had already read the company’s 8e6 white paper. I asked him whether any changes to the software settings made by employees at the sub-group levels were automatically communicated to the upper levels. He said that they were, and as long as the administrators at the top read the logs, they will be aware of all such changes. “In other words,” I concluded, “they either know what their subordinates are doing, or they are incompetent.” When asked, he declined to tell me who his company contact was at DOI. However, he was willing to say that it was “at the network administrator level.”. The next task was to locate the Network Administrator for the Department of the Interior. Web searches failed to turn up a name or phone number, so my only hope was to find someone at DOI who would refer me to the appropriate person. Mr. Tipton, the CIO, never returned my call, so the next step was to call the Secretary of the Interior, Dirk Kempthorne. I had to go through two gatekeepers for Secretary Kempthorne. The second one said, “Oh, I know what you’re calling about! We’ve had enquiries about it from two other people today.” Evidently the word had already got out to the media. She passed me on to the Director of Communications, Mr. Frank Quimby. He was pleasant, and explained that the Department most emphatically did not selectively block conservative blogs. “We block all blogs. We’re still getting the glitches out of the system, so some get through here and there, but we’re blocking all blogs.” I told him that I would report what he said, but that it strained credulity, because the chance of the system randomly blocking blogs that just happen to have a conservative political content — and not blocking liberal ones — was so small as to be negligible. Someone, somewhere had to have done this intentionally. Mr. Quimby passed me on to to his deputy, Mr. Ed Meagher, who was more familiar with the technical aspects of their internet filtering system. Mr. Meagher was not as friendly as Mr. Quimby — he bristled at any suggestion that the Interior Department was selectively blocking blogs based on their political orientation. “I can guarantee you 100% that we do not do that,” he told me. “We block all blogs.” When I explained to him what Penpal had said, Mr. Meagher became quite vehement. “It didn’t happen. If your sources say that, then your sources are lying. Nobody here ever did anything like that.” That was as unequivocal a denial as one can get He refused to refer me to his network administrator, nor would he allow me to come into a DOI office and test the system myself, because that would “breach security”. So I returned to my sources and my network security experts for more information. Ordinarily I would put this in the internet rumor file. But as chance would have it, I do know some people who work at the Department of Interior. Sure enough, it looks like the right side of the blogosphere is being blocked while the left side is wide open.Three separate people at DOI were apparently lying, if we are to accept Mr. Meagher’s version of events. I wrote back to Penpal, and she was quite irate at being called a liar: As far as the guy insisting categorically that all blogs are blocked, he’s lying himself! I’d guess he’s also technically incompetent. Maybe he even thinks that they are all supposed to be blocked, but they aren’t. Of course, IT Security Managers with DOI are complete idiots. [detailed technical examples followed here] Until recently, the division of DOI that I work for ran all their stuff in the complete free and clear. No firewalls, no filters, nothing. Anything and everything on the network was free for anyone at all to take who was interested.As of last Thursday evening, October 12, the situation was still the same: conservative blogs were still being blocked, while the major liberal ones were not. In all fairness, Mr. Meagher is not necessarily lying when he makes his assertions; it’s quite possible that his subordinates are assuring him that what he says is true. My sources have no particular reason, absent sheer malice, to fabricate these tales, whereas Mr. Meagher has a definite interest in maintaining the purity of his position. Occam’s razor tells me that my sources are truthful, and that Deputy Director Meagher is mistaken. How does the 8e6 software work? The general idea is this: the program classifies websites, by their URLs and/or their IP addresses, according to a certain schema that includes news, educational, pornography, gambling, blogs, opinion, and so on. The end user can choose to block any of these categories within the network and its subdomains. The user may also choose, for business reasons, to list some websites specifically as exceptions, and these will be allowed through. Mr. Quimby had said as much, implying that the Department of the Interior has a business reason to make exceptions of Daily Kos and the Huffington Post. That doesn’t make any sense. He also told me that blogs often have obscene or hateful content, which may earn them a “Hate Site” or “Pornography” classification, and hence cause them to be blocked. Once again, that doesn’t make sense, as anyone who has visited Democratic Underground will attest. Christine, an investigator at the 910 Group, reported: It seems that 8e6 creates categories, identifies sites to go in those categories and then daily provides a download of updates them for all clients (who can select from categories to block within a common database). There is a correction functionality, but it is used for everyone. They use human content analysts who will review a proposed correction and recategorize if they agree, then resend the new categorization in the next update. There’s even a function to submit a site (presumably to be blocked but maybe for recategorization as well). ——— Comments (14)Sean Gleeson :Baron Bodissey :Sean -- Remember -- if my theory is right, it's not really that conservative blogs were blocked, it's that liberal blogs were unblocked, probably by somebody with a personal interest in reading them. But given the stonewall at Interior, we'll probably never know. Beach Girl :Excellent article. Good work Christine. Baron, the blocking of conservative blogs and this excellent report should do much to help us get the publicity that we need. Kudos. Douglas Boldt :Yes, I agree.. this is great work.. Sounds to me like the DOI has some problems. Clearly you know their software, as you read the whitepaper.. for them to suggest that their software is 'randomly blocking blogs' is apparently a blatant lie, and insults our intelligence. A Network Tech :I'm "the poor schmoe at the bottom of the heap" for a local government in the north east that I'd prefer to not identify (beyond saying that when you think of the most liberal part of the most liberal state in the area, you're likely pretty close to where I work) and I have to say that your explanation has one slight problem from my point of view: John McAdams :A source I contacted at Interior insists that all blogs are blocked, and confirmed that DailyKos and Democratic Underground are blocked. http://mu-warrior.blogspot.com/2006/10/department-of-inte rior-censoring.html Sissy Willis :I'm sure they still don't know what hit them. DZ Sokol :Frankly, it seems preposterous that our Federal Government -- keeper of democracy and free speech -- is blocking access to any blog sites... My assumption is that they're probably providing open access to all sorts of porno sites. Subvet :Great investigative work. Your idea of an employee selectively unblocking his favorite sites definetly passes the smell test. Who was it that said the problem with making things foolproof is that fools are so ingenious? cort wrotnowski :'fraid it's time to sue the DOI for violation of first amendment rights. It's a can of worms that needs to be opened. Of all forms of speech protected, above all, political speech is supposed to be protected - McCain-Feingold not withstanding (And maybe someday that one will get straightened out) A Network Tech :Following up on my previous comment, and thinking about the environment here, I wonder if the following scenario might not be more likely than the network tech unblocking sites for his own use, especially with the apparent situation being that blocking of blogs is a new thing for their proxy... One day the proxy begins blocking all the blogs. Poor schmoe network tech answers the phone that morning to find an angry, suited higher-up (say, one who controls purse strings for the IT department) demanding to know why they can't reach the sites they check every morning, possibly sprinkling in a liberal (no pun intended) collection of "what does IT think it's doing?" and "why can't you guys make this work right?" type statements. Network schmoe, trying to keep Those Who Pay The Bills happy, adds the requested sites to the bypass list. Everyone is happy until one day someone notices that, while most of the blogs are unblocked, certain ones are getting through. How does that work for a smell test? Given my experience down here in the IT dungeon, it makes more sense to me than the tech unblocking sites for his own use, but still doesn't have to invoke intentional anti-right/pro-left censorship, just the poor tech trying to keep the higher-ups happy while trying his/her best to comply with directives coming down the IT pipe. legalize :Sounds like a great opportunity for a Freedom of Information Act Request for obtaining the logs of the blocking software. What they are blocking cannot be classified as "secure", since this is not a list of information internal to the agency, but a list of sites external to the agency that they block. lumberjack :Section 15:Dubious/Unsavory, that's me to the bone. And I don't mind telling you that it's taken lots of hard work to bring myself up to dubious. Course, unsavory comes naturally. Worker Bee :(None of the below-offered comments should be construed as official DOI positions... I speak for myself, not for any Department or other Agency) I work at one of the agencies within DOI, and I'm directly involved with dealing with a lot of the fallout from this implementation. While much of the information posted above is accurate, there is some that is flat-out wrong. DOI has outsourced this implementation to an organization run by Verizon Business, know as ESN (Enterprise Services Network). They act as the "upstream ISP", if you will, for agencies within the DOI. ESN stood up the 8E6 R3000 product, IMO largely because of the ease of administration. They are a very thinly-stretched organization, with more than a few areas of technical weakness. They had originally had a project underway to slowly and carefully transition to a centralized web-filtering solution for the DOI, but the Secretary's decision brought the implementation to a head... clearly before they were ready. Agencies within DOI were told that this was going to be implemented in a warning-only mode for roughly three months, giving users an opportunity to override any inaccurate classifications. Their attempt to implement the override process failed. Badly. Within three days the experiment was abandoned in favor of full-on blocking mode. Unfortunately, at the same time, they were scrambling to determine which categories were going to be blocked, and which ones weren't. A great many categories were initially blocked, and that gave us some insight into just how poor of a job 8E6 does in categorization. This is not a case of minor-bits-and-pieces bad. This is flat-out horrific. Incompetence on a massive scale. One of the initially blocked categories was "Tickets", which covers online travel. This allowed us to determine that Travelocity was blocked by 8E6 in that category... but Expedia and Orbitz were not. There's no bias there... that's just flat-out incompetence. You can't just "accidentally" miss two out of the top three online travel websites and have anything like an accurate database. The USO was also blocked in the category "Tickets", too. Even as of today, Instapundit wasn't categorized as a blog. It's not blocked. Neither is Hot Air, Pajamas Media, Anti-Idiotarian Rottweiler, Hugh Hewitt, Ace of Spades, American Thinker, Right Wing News, Real Clear Politics, nothing on Town Hall, nor at least twenty other sites I pulled from Insty's blogroll before I stopped trying. You want to know just how bad their classification engine is? LGF is blocked if you go to the root domain, but it is UNBLOCKED if you add the /weblog/ that the blog actually uses. Groups.google.com was classified as "free web hosting". Kos, Atrios, Talking Points Memo, Democratic Underground *are* all blocked. These folks are just flat-out BAD at categorizing things. The major input into their categorization is a custom web-crawler with a so-called artificially intelligent classification engine. After the crawler classifies something, a human apparently reviews it to make sure that that it picked an appropriate category (or more than one). After that, the only other inputs are user suggestions via their online form (to help them correct mis-categorizations), and there's a feedback process where the daily top surfing destinations that have no categories assigned are forwarded to the humans. Instapundit must have been classified as *something*, but apparently not a blog. So until and unless someone reports it to 8E6, it remains "not a blog" to their software. Someone has apparently seen the Gates of Vienna article, and used that form to "correct" the problem of some of the well-known lefty sites not being categorized correctly (I suspect they may have been tagged as "Political Opinion" instead, which is one of the categories that ESN doesn't have blocked). People, I very strongly doubt it was any kind of political bias that was driving what was categorized as a blog and what wasn't... it's just stone-cold incompetence on the part of the vendor. The partial list provided above should show that there were (and still are) gaping holes on the right side of the blogosphere too. When the DOI rep says that "all blogs are being blocked", I'm sure he's approaching it from the perspective that they've selected the category "weblogs", and they haven't performed any whitelisting or blacklisting overrides. They're taking whatever the vendor gives them... which is complete crap. I'm not interested in helping 8E6 improve their lousy implementation by suggesting re-evaluations of the long list of blogs I can still access. I suspect, however, that over time the noose will slowly be tightened. Until then, it is leaking like a sieve, without much preference in any given political direction. If you want details on what categories are being blocked (and the rationale), here's a link. Snag it before it disappears: Comments have been archived for this page. |
Support Pajamas Media; Visit Our Advertisers
RSS FeedsPajamas MediaA Taste of The Future in Obama’s Justice Department My Post-Election Resolution for Political Unity How the GOP Can Get Its Mojo Back German Students Lay Waste to Holocaust Exhibit A Happy Ending (and Beginning) for a Brave Iraqi Friend The Impossible Obama Dream LAPD Treats Gay Marriage Protests With Kid Gloves Obama’s Inevitable Crackberry Withdrawal
Support Pajamas Media; Visit Our Advertisers
|
Kudos. Great work on tracking down the technical details, and even better speculation about the proximate cause of the apparent bias. Your reasoning is valid.
As you know, I disagree with the "block all blogs" policy to begin with. There is nothing about blogs, as a class, to justify lumping them together with porn and gaming sites. But blocking only conservative blogs is of course even worse.
Oct 16, 2006 09:36 AM