The Challenge of Big Data is “BIG”

Updated: Jun 10, 2020

Analytics and Big Data is becoming a necessity in our modern day lives. The abundance of unstructured data scattered around the internet and stored in private databases must be mined and polished to produce valuable information crown jewels. Information that could potentially save lives, prolong our lifespan, predict hurricane patterns more accurately, help modify genomes to prevent genetic diseases, improve health, help build better cities through better planning, produce more clean energy, help find the cure for chronic diseases or pandemics, and other priceless discoveries that with the right combination of data and information manipulation, all the answers to all these hidden complex equations now could just be a click away.

However, the challenge of Big Data is “BIG” and the problem of Analytics is the analysis part itself and how to arrive at the “accurate analysis”. Analysis is a complex process which often includes, but not limited to: identification of facts, patterns, relationships, trends, root causes, and sway factors. Unfortunately, not a lot of people were gifted with this don. Even with high tech tools and systems, everything boils down to establishing correct and accurate models and flawless algorithms first, which must be verifiable and replicable to be trustworthy in making crucial, critical, and life-changing decisions.

To to explain the 4 facets of Big Data Analytics, please click on the video below:

[Short Video Courtesy of SkillLogic]

4 Types of Analytics:

1. Descriptive Analytics - is a preliminary stage of data processing that creates a summary of historical data to yield useful information and possibly prepare the data for further analysis. It provides information or rather a report on what happened, why, and when. Most of us are very keen and familiar with this type of analytics as we see them regularly in our daily, weekly, monthly, annual reports. It is good for those WOW (What Went Wrong) analyses, to understand the root causes.

2. Predictive Analytics - is the branch of advanced analytics which is used to make predictions about unknown future events. Predictive analytics uses many techniques from data mining, statistics, modeling, machine learning, and artificial intelligence to analyze current data to make predictions about the future. It intends to foretell what is likely to happen given certain parameters, however we need to note that it merely forecasts what are the probabilities of the occurrence of the event base on certain accuracy rate, otherwise everybody will bring this model to Las Vegas and bet on it. A more common example of this is weather forecasting, like analyzing the probability of rain in specific area.

3. Discovery or Diagnostic Analytics - is the process of mining data by correlating patterns and behaviors to provide feedback base on the relationship it discovered. It takes an in-depth look at data to understand the root causes of certain events. It is particularly useful to determine what factors and events contributed to the outcome. Auditing robot AI's are good example of this type, you send this robot to discover any pattern related to finding patterns on any auditing policy violation.

4. Prescriptive Analytics - is the area of advance analytics dedicated to finding the best course of action for a given situation. Prescriptive analytics typically combines some level of descriptive, predictive, and discovery/diagnostic analytics. A good example of this is the algorithm you use to arrive at your destination using the fastest route. This type of prescriptive analytics combines the other type analytics to provide you with the most accurate prediction.

Again, with more data and less professionals who could manipulate them, we could have a huge number of information in front of our noses that we could not see. There could be a lot of valuable data that we could not interpolate and extrapolate, not because of the lack of tools nor datasets, but because of the lack of knowledge and skills to extract and pull them out to make an intelligent use of those analytical information.

29 views0 comments

Recent Posts

See All