Data – Page 3 – Public Intelligence Blog

Weighing Open Source’s Worth for the Future of Big Data

“If you’re trying to overcome a technology like relational databases, which have been developed over decades and had gestation from every major university in the world that does computer science research, it takes a long time to climb that hill,” Kreps says. “What’s very different for us is there hasn’t really been this incredibly well-developed infrastructure layer in the space we’re entering. We get to kind of make it up as we go along, which is a huge advantage. “

This perhaps is the reason why — despite the availability of MySQL, MariaDB, and PostgreSQL RDBMs, the advent of modern NoSQL and NewSQL solutions, and scalable Hadoop and object-storage alternatives — proprietary RDBMs continue to drive the lion’s share of enterprise spending in the data management space.

Continue reading “Penguin: Open Source and Big Data”

2017/11/182017/11/17

Mongoose: CIA Blows Again – Open Source Information Is Information Operations Untapped Weapon

Data, IO Impotency, Knowledge

Open Source Information Is Information Operations Untapped Weapon

Carmen Landa Middleton

My experience, both as a long-time practitioner of the open source discipline and as a former leader of the CIA branch responsible for it, is that there are two stubborn myths that continue to impede the true unleashing of OSINT’s power and potential. First, that open source is “cheap.” And second, that anyone with little more than a good internet connection can be an open source practitioner.

Continue reading “Mongoose: CIA Blows Again – Open Source Information Is Information Operations Untapped Weapon”

2017/11/152017/11/14

Yoda: 1% Win in Court, Lose in Life — Sci-Hub Marches On…. #GoogleGestapo Expands to Blocking Scientific Information

#OSE Open Source Everything, Access, Autonomous Internet, Data, Governance

Court demands that search engines and internet service providers block Sci-Hub

The American Chemical Society (ACS) has won a lawsuit it filed in June against Sci-Hub, a website providing illicit free access to millions of paywalled scientific papers.

Extracts & Comment Below the Fold

Continue reading “Yoda: 1% Win in Court, Lose in Life — Sci-Hub Marches On…. #GoogleGestapo Expands to Blocking Scientific Information”

2017/07/11

Yoda: Open Source is the New Normal in Data & Analytics

#OSE Open Source Everything, Data

Dead, dead, dead — secret, stovepipe, proprietary.

Open Source Is The New Normal In Data and Analytics

I’ve argued for a while now that we’re at or near a data tipping point beyond which lies a new world where companies analyze many fundamentally new types of data in real-time and use it to make business decisions that were previously impossible.

2016/09/282016/09/26

Yoda: Open Source Climate Data — Finally — Time for ALL Data to be Open Source!

Data

Open-Source Climate Change Data From NASA, NOAA, & Others Available For 1st Time

There is a need to make that data available in a jargon-free format and with guidance on how to use it effectively. A new organization will do just that. On September 22, PREP, the Partnership for Resilience and Preparedness, was launched by the White House Office of Science and Technology Policy, World Resources Institute, U.S. Global Change Research Program, and a host of industry supporters including Microsoft and Google. PREP will harness the data revolution to strengthen climate resilience efforts, streamline climate data delivery, and inform researchers and data providers which climate data are most valuable.

Continue reading “Yoda: Open Source Climate Data — Finally — Time for ALL Data to be Open Source!”

2016/06/032016/06/02

Robert Steele: An Open Letter to All European Ministers on Peace Through Open Everything

#OSE Open Source Everything, Data, Design, Economics/True Cost, Governance, Innovation, Knowledge, P2P / Panarchy, Politics, Resilience, Science, Software, Sources (Info/Intel), Transparency

Robert David Steele

An Open Letter to All European Ministers

Esteemed Ministers,

On 27 May the Competitiveness Council in Brussels announced a European decision to achieve Open Access to all scientific research data by 2020. This decision, and the implementing European framework programme for research and innovation Horizon 2020, will be recognized by future generations as the first serious step toward the creation of a prosperous world at peace. With this one decision Europe is turning away from centuries of war and waste; away from scientific reductionism, away from corporate ownership of public knowledge, away from legal barriers to innovation, and away from government neglect of the public interest.

Continue reading “Robert Steele: An Open Letter to All European Ministers on Peace Through Open Everything”

2016/05/052016/05/04

Stephen E. Arnold: A Non-Profit Search Engine

Data, Design, Knowledge, Software

A Not-For-Profit Search Engine? That’s So Crazy It Just Might Work

The Common Search Project has a simple and straightforward mission statement. They want a nonprofit search engine, an alternative to the companies currently running the Internet (ahem, Google.) They are extremely polite in their venture, but also firmly invested in three qualities for the search engine that they intend to build and run: openness, transparency, and independence. The core values include,

“Radical transparency. Our search results must be explainable and reproducible. All our code is open source and results are generated only using publicly available data. Transparency also extends to our governance, finances and day-to-day operations.

Independence. No single person, company or special interest must be able to influence the order of our search results to their benefit. …

Public service. We want to build and operate a free service targeted at a large, mainstream audience.”

Read full post.