Stephen E. Arnold: Now Big Data Has to Be Fast (But We Still Only Process 1%)

Now Big Data Has to Be Fast I read “Big Data Is No Longer Enough: It’s Now All about Fast Data.” The write up is interesting because it shifts the focus from having lots of information to infrastructure which can process the data in a timely manner. Note that “timely” means different things in different …

Stephen E. Arnold: How Big Data Is Missing the Mark

How Big Data Is Missing the Mark At this point in the Big Data sensation, many businesses are swimming in data without the means to leverage it effectively. TechWeek Europe cites a recent survey from storage provider Pure Storage in its write-up, “Big Data ‘Fails Businesses’ Due to Access, Skills Shortage.” Interestingly, most of the …

Stephen E. Arnold: When Big Data Becomes Bad Data Through Algorithmic Bias, Discrimination, and Distortion

Algorithmic Bias and the Unintentional Discrimination in the Results The article titled When Big Data Becomes Bad Data on Tech In America discusses the legal ramifications of relying on algorithms for companies. The “disparate impact” theory has been used in the courtroom for some time to ensure that discriminatory policies be struck down whether they …