CIA’s CTO Gus Hunt On Big Data: We ‘Try To Collect Everything And Hang Onto It Forever’ — And a Few Things Most CTOs Do Not Compute

Government, IO Impotency
Theophillis Goodyear
Theophillis Goodyear

CIA's Gus Hunt On Big Data: We ‘Try To Collect Everything And Hang Onto It Forever'

NEW YORK — The CIA's chief technology officer outlined the agency's endless appetite for data in a far-ranging speech on Wednesday.

VIDEO 28:30

Speaking before a crowd of tech geeks at GigaOM's Structure:Data conference in New York City, CTO Ira “Gus” Hunt said that the world is increasingly awash in information from text messages, tweets, and videos — and that the agency wants all of it.

“The value of any piece of information is only known when you can connect it with something else that arrives at a future point in time,” Hunt said. “Since you can't connect dots you don't have, it drives us into a mode of, we fundamentally try to collect everything and hang onto it forever.”

CIA CTO Gus Hunt
CIA CTO Gus Hunt

Hunt's comments come two days after Federal Computer Week reported that the CIA has committed to a massive, $600 million, 10-year deal with Amazon for cloud computing services. The agency has not commented on that report, but Hunt's speech, which included multiple references to cloud computing, indicates that it does indeed have interest in storage and analysis capabilities on a massive scale.

The CIA is keenly interested in capabilities for so-called “big data” — the increasingly massive data sets created by digital technology. The agency even has a page on its website pitching big data jobs to prospective employees.

Hunt acknowleded that at some scale, data storage becomes impractical, adding that he meant “forever being in quotes” when he said the agency wants to keep data “forever.” But he also indicated that he was interested in computing capabilities like 1 petabyte of RAM, a massive capacity for on-the-fly calculations that has heretofore been seen only in computers that simulate nuclear explosions.

He referenced the failure to “connect the dots” in the case of Umar Farouk Abdulmutallab, the “underwear bomber” who was able to board a plan with an explosive device despite repeated warnings of his intentions. In that case, a White House review found that the CIA had all of the data it needed to identify the would-be bomber, but still failed to stop him. Nevertheless, the agency does not seem to have curbed its ambitions for an endless amount of data.

“It is really very nearly within our [NSA's] grasp to be able to compute on all human generated [digital] information,” Hunt said. After that mark is reached, Hunt said, the agency would also like to be able to save and analyze all of the digital breadcrumbs people don't even know they are creating.

“You're already a walking sensor platform,” he said, nothing that mobiles, smartphones and iPads come with cameras, accelerometers, light detectors and geolocation capabilities.

“You are aware of the fact that somebody can know where you are at all times, because you carry a mobile device, even if that mobile device is turned off,” he said. “You know this, I hope? Yes? Well, you should.”

Hunt also spoke of mobile apps that will be able to control pacemakers — even involuntarily — and joked about a “dystopian” future where self-driving cars force people to go to the grocery store to pick up milk for their spouses.

Hunt's speech barely touched on privacy concerns. But he did acknowledge that they exist.

“Technology in this world is moving faster than government or law can keep up,” he said. “It's moving faster I would argue than you can keep up: You should be asking the question of what are your rights and who owns your data.”

Related:

Penguin: The CIA About To Sign $600 Million Deal With Amazon — Six Years After Robert Steele Proposed Amazon as the Hub for (an Open) World Brain

Continue reading “CIA's CTO Gus Hunt On Big Data: We ‘Try To Collect Everything And Hang Onto It Forever' — And a Few Things Most CTOs Do Not Compute”

Penguin: The CIA About To Sign $600 Million Deal With Amazon — Six Years After Robert Steele Proposed Amazon as the Hub for (an Open) World Brain

Advanced Cyber/IO, Architecture, Cloud, Government
Who, Me?
Who, Me?

Have no idea what this means:

The CIA Is About To Sign A Game-Changing $600 Million Deal With Amazon

The CIA is on the verge of signing a cloud computing contract with Amazon, worth up to $600 million over 10 years, reports Frank Konkel at Federal Computer Week.

If the details about this deal are true, it could be a game-changer for the enterprise cloud market.

That's because Amazon Web Services will help the CIA build a “private cloud” filled with technologies like big data, reports Konkel, citing unnamed sources.

The CIA is pretty closed-lipped about its business, as spies are apt to be. This is no exception. It won't confirm the deal or comment on it, so details are sketchy. But the contract is expected to be for a “private” cloud, which is not what AWS is known for.

AWS is the largest “public” cloud provider. In general, the term “private cloud” means using cloud computing technologies in a company's own data center. Public clouds are in hosted facilities, where the hardware is shared with many users. Sharing the hardware saves money.

Continue reading “Penguin: The CIA About To Sign $600 Million Deal With Amazon — Six Years After Robert Steele Proposed Amazon as the Hub for (an Open) World Brain”

Thomas Devenport: Those Good at Analytics Not Good at Visualization

IO Impotency, IO Mapping
Thomas Davenport
Thomas Davenport

Q&A: Tom Davenport urges more clarity in data analytics

By Joe McKendrick | March 19, 2013, 4:00 AM PDT
0Comments

Businesses may be seeking to compete on analytics, but it’s often difficult for business decision-makers to get their heads around data.

I recently had the opportunity to chat with Tom Davenport, visiting professor at Harvard University and co-author of the seminal work Competing on Analytics: The New Science of Winning, about the difficulties of converting to an analytics-driven culture. Davenport, who is also co-founder and research director of the International Institute for Analytics, and a senior advisor to Deloitte Analytics, is working on a new book, dicussing on how analytics need to be better communicated to business decision-makers. He shared some of the thinking behind his forthcoming work:

Q: BI and analytics vendors have been coming out with all sorts of graphic tools — dashboards, balanced scorecards and so on — for years. Do we need more than a nice splashy presentation on the tool to communicate analytics?

TD: We’ve all grown up on pie charts and bar charts or whatever, but there are probably at least tens, if not hundreds of alternative approaches to visual analytics. Narratives are a pretty good way to convey information in the past, so maybe we should be converting our data and analysis into stories. People are starting to do that more. Most analysts were unfortunately not trained in how you communicate effectively about analytics, so we’ve got a long way to go in terms of doing a better job of that.

Q: More and more data is flowing through enterprises. Is it a challenge to get C-level executives interested in turning this data into analytics?

TD: Not for all applications. Because increasingly people are feeding data into computers and the results go into another computer, and the decisions are getting more automated. Any time you have a human involved, it’s important to try to help them extricate the meaning of the data and analysis. And there a variety of ways to do that. Historically, we haven’t been too terribly good at it, the quantitative people among us.

Read full interview.

Steve Aftergood: Drake Classification Complaint Dismissed and Court Severely Critical of Executive Over-Classification, Arbitrary Classification, and Lack of Accountability for Same

Cultural Intelligence, Government, Ineptitude, IO Impotency, IO Secrets, Military
Steven Aftergood
Steven Aftergood

CLASSIFICATION COMPLAINT ARISING FROM THOMAS DRAKE CASE DISMISSED

In July 2011, J. William Leonard, a former director of the Information Security Oversight Office (ISOO), took the extraordinary step of filing a formal complaint with the Office he once led charging that a document used to indict former NSA official Thomas Drake under the Espionage Act had been wrongly classified in violation of the executive order on classification. (“Complaint Seeks Punishment for Classification of Documents” by Scott Shane, New York Times, August 2, 2011; “Ex-federal official calls U.S. classification system ‘dysfunctional'” by Ellen Nakashima, Washington Post, July 21, 2012)

Last December, in a newly disclosed response, John P. Fitzpatrick, the current ISOO director, concluded that Mr. Leonard's complaint did not warrant the sanctions that Mr. Leonard had urged.  Neither the original classification of the NSA document, titled “What a Wonderful Success,” nor its continued classification “rise to the level of willful acts in violation of the Order,” Mr. Fitzpatrick wrote in his December 26, 2012 response.

With that, the matter was officially closed.  But the divergent views underlying the complaint remain unresolved and continue to fester.

“I have devoted over 34 years to Federal service in the national security arena, to include the last 5 years of my service being responsible for Executive branch-wide oversight of the classification system,” Mr. Leonard wrote in his 2011 complaint. “During that time I have seen many equally egregious examples of the inappropriate assignment of classification controls to information that does not meet the standards for classification; however, I have never seen a more willful example.”

Continue reading “Steve Aftergood: Drake Classification Complaint Dismissed and Court Severely Critical of Executive Over-Classification, Arbitrary Classification, and Lack of Accountability for Same”

Stephen E. Arnold: Which Vendor Will Be the Next Autonomy and Endeca?

Advanced Cyber/IO
Stephen E. Arnold
Stephen E. Arnold

Which Vendor Will Be the Next Autonomy and Endeca?

At a recent search conference, I sat in the audience and marveled at the disconnect between the past that was and the present which is unfolding now. Several speakers dismissed the notions of precision and recall. In their place, the search wizards (who shall remain nameless) emphasized that search had to be “good enough.” The challenge, therefore, was to define “good enough.”

I sat quietly. At my advanced age I don’t have the energy to revisit the long and mostly disappointing trajectory of one of the most overhyped and misrepresented enterprise solutions—information retrieval. The list of companies which have spouted grandiose promises of universal information access, real time search, and actionable information reaches back to the early days of RECON and Orbit, STAIRS III, the long forgotten InQuire with its forward truncation, and Smart.

Where are these game changing vendors now?

Subscribe to LIMDIS Email

 

John Robb: How Drones Can Recharge from Power Lines and Remain Active for Years

Drones & UAVs

John Robb
John Robb

How Drones Can Live off the Land for Years

Cyberweapons and synthetic biological weapons (GMOs) can self provision.

They have the ability to live off the land (hosts, like human bodies and PCs) once they are unleashed.

NOTE:  In many cases, they can also make perfect copies of themselves (copies in the trillions).

But what about drones?

Aren't they limited by quantity of energy in their batteries?

Yes, drones do have the capacity to self provision too.  One of the more elegent ways is for a drone to use power lines to “induct” the energy it needs.

drone forever croppedA drone that can recharge itself from a power line has the potential to operate for years — monitoring, relaying, etc. — without returning to base.

If the decision making software is good enough it could source its energy and target data for years without referencing any command system.

In fact, with wireless access to the Internet (including RSS feeds), GPS, and other easily accessible data sources… it decision making can be very dynamic.

Here's a video showing some US DoD contractors working on making that a reality, right now:

Chuck Spinney: The Truth About the Cuban Missile Crisis

Corruption, Government, IO Impotency, Peace Intelligence
Chuck Spinney
Chuck Spinney

The below article, which appeared in the Atlantic last January, is a very important illustration of how domestic politics determine foreign policy.  Bear in mind, the behaviour described below occurred when there was (and still is) a consensus among the pol-mil intellectuals that domestic politics stops at the water's edge and that foreign policy was and should be bi-partisan — the conclusion is a good analysis of where this kind of romantic intellectualization leads.

The Real Cuban Missile Crisis

EVERYTHING YOU THINK YOU KNOW ABOUT THOSE 13 DAYS IS WRONG.

By Benjamin Schwarz, The Atlantic, 11 January 1913

EXTRACT

On that very first day of the ExComm meetings, McNamara provided a wider perspective on the missiles’ significance: “I’ll be quite frank. I don’t think there is a military problem here … This is a domestic, political problem.” In a 1987 interview, McNamara explained: “You have to remember that, right from the beginning, it was President Kennedy who said that it was politically unacceptable for us to leave those missile sites alone. He didn’t say militarily, he said politically.” What largely made the missiles politically unacceptable was Kennedy’s conspicuous and fervent hostility toward the Castro regime—a stance, Kennedy admitted at an ExComm meeting, that America’s European allies thought was “a fixation” and “slightly demented.”

Read full article.