Mutters – Big Data Doesn’t Make You Smarter
Have you heard ….. big data relies on a very big assumption: that having more data gives organisations better understanding of their environment. The apostles of big data preach that it will make organisations smarter. In fact, the opposite is true: big data dulls an organisation’s strategic senses. Here’s how…
3. Data, big or small, is only as useful as the questions you ask it: Big data produces myopia, or “tyranny of small decisions” where responding to the short-term pressures that ultra-fine data produces lays the groundwork for much bigger problems later. For example Ford, GM and Chrysler got into trouble in the 1970’s because they obsessively watched each other and missed the strategic threat of Toyota and Nissan. All the data in the world won’t help if the right questions aren’t asked, and big data does not generate such questions, or even contribute to their formulation. Nevertheless, organisations keep accumulating data and there is no denying it can be useful. It is essential to question and make explicit the core assumptions held by analysts and managers, because these assumptions will drive the search for and analysis of data. These assumptions are a reflection of our personality, biases and beliefs. How you see the world will determine the questions you ask and those you don’t ask.
Big data is useful when it is non-ambiguous: web-site connection logs for fraud detection, gene sequencing, sales statistics etc. Big data will keep your engineers busy, and make IT vendors rich, but because data is always backward looking, it will not deliver a vision of the future. So what should you do?
- Keep in touch with the field and the plant floor, and avoid quasi-scientific detachment from the top of the executive office;
- Know when “scientific” data is useful and relevant, and when it is deceptive and dangerous;
- Interrogate your hypotheses or assumptions with at least twice the rigour with which you question your data.
In a complex and uncertain world, these tips might help you avoid unexpected surprises in a way that big data won’t.
Adapted from: Three Reasons Why Big Data Doesn’t Make You Smarter – Lessons From the World of Intelligence by Milo Jones and Philippe Silberzahn, Forbes