Stephen E. Arnold: Now Big Data Has to Be Fast (But We Still Only Process 1%)

Now Big Data Has to Be Fast I read “Big Data Is No Longer Enough: It’s Now All about Fast Data.” The write up is interesting because it shifts the focus from having lots of information to infrastructure which can process the data in a timely manner. Note that “timely” means different things in different …

Stephen E. Arnold: How Big Data Is Missing the Mark

How Big Data Is Missing the Mark At this point in the Big Data sensation, many businesses are swimming in data without the means to leverage it effectively. TechWeek Europe cites a recent survey from storage provider Pure Storage in its write-up, “Big Data ‘Fails Businesses’ Due to Access, Skills Shortage.” Interestingly, most of the …

Stephen E. Arnold: When Big Data Becomes Bad Data Through Algorithmic Bias, Discrimination, and Distortion

Algorithmic Bias and the Unintentional Discrimination in the Results The article titled When Big Data Becomes Bad Data on Tech In America discusses the legal ramifications of relying on algorithms for companies. The “disparate impact” theory has been used in the courtroom for some time to ensure that discriminatory policies be struck down whether they …

Patrick Meier: Automating Visual Heuristics — Human Clicks Train Computer Algorithms on Big Data (Aerial)

Using Computer Vision to Analyze Big (Aerial) Data from UAVs During Disasters Recent scientific research has shown that aerial imagery captured during a single 20-minute UAV flight can take more than half-a-day to analyze. We flew several dozen flights during the World Bank’s humanitarian UAV mission in response to Cyclone Pam earlier this year. The imagery we captured would’ve taken …

Review: Big Data, Little Data, No Data – Scholarship in the Networked World

Christine L. Borgman 5 Stars Major Contribution with Some Oversights This book is extremely well-developed and and a major contribution, not least because it it one of the best explorations of information ecologies that are vastly more intricate and cover vastly more time, energy, and locational space, than most realize. It was recommended to me …

Stephen E. Arnold: Big Data vs Small Brain

Big Data Shockers: Not Big The statement that “we have too much data” underscores the individual’s inability to think about information in a way that is helpful. Both the craziness about Big Data and the too much to do approach to work are cover ups. The issue is rooted deep within many individuals who are …

Stephen E. Arnold: Is Human Collaboration Key to Big Data Progress and Future of Internet?

Is (Human) Collaboration the Key to Big Data Progress? The article titled Big Data Must Haves: Capacity, Compute, Collaboration on GCN offers insights into the best areas of focus for big data researchers. The Internet2 Global Summit is in D.C. this year with many exciting panelists who support the emphasis on collaboration in particular. The …