What does Big Data and Predictive Analysis Really Mean ?

One of the problems with understanding Big Data, is that the term itself means different things to different people !

Some of the most common questions asked are :

 – What is Big Data all about?

 – What is the Big Data Market?

 – Why is it important to use Data?

 – What is Strong Data?

 – What si Big Data Used For

There are however two main areas of the term that most people recognise, and in reality cover the present reality. It is important to realize that we are really only just at the beginning of what Big Data means, what the implications are and its relationship to Artificial Intelligence.

The two main areas referred to above are the amount of information posted by and about people online, and the amount of information made available by governments, business’s etc. The scale of the amount of information that is posted online is almost too big to quantify.

What is important to realize is that this type of information, i.e. blog posts, social media posts, videos etc don’t fit into the traditional format of a database, and as such cannot be analysed in the same way. In relation to Big data, this mean new ways have to be found to both store and analyse this information.

In terms of governmental information, Big data is at its simplest just that. Huge amounts of data/information that are produced by governments, businesses and other organisations, some of which is made public, some of which is kept private.

The issues around big data are complex and varied. The primary concerns have to be those of privacy and cyber insurance/cyber security.

The sheer volume of big data, however you may come to define that term, means that a significant number of different people and different networks will be involved in processing and using the information. The privacy issues of big data are significant.

However much the information is anonamized, the implications regarding the data being hacked and personal information on individuals being gathered is significant. Identity theft is a significant cyber insurance and cyber security issue, yet one that remains under the radar for many people.

In most instances, cyber security has at its core the issue of a data breach occurring, and the implications thereof. Given the sheer fact that big data implies a huge increase in the volume of data being processed, both structured and unstructured data, the number of servers and networks involved also going to be significantly increased.

The logic therefore dictates that the risk of cyber security threats that would apply to one network within a company or organisation will be multiplied many times over.

Big Data – Government

Most governments in the West actively encourage the release of big data relating to many areas of government and life generally. This in part is because governments believe it shows an openness in their storage of information, which may be true or not, and because it allows an unprecedented level of predictive analysis of trends and behaviour in society generally.

The US government website has huge amounts of big data available relating to a wide range of areas, listed below.

Agriculture

Climate

Consumer

Ecosystems

Education

Energy

Finance

Health

Local Government

Manufacturing

Maritime

Oceans

Public Safety

Science and research

BIG DATA and BUSINESS

Whether or not many businesses want to get involved with big data, often they do not really have a choice.  It is more an issue of how they analyse and use the data that is flowing through them, both to enhance their business and also to promote their industry.

The issue is really about how to make sense of the huge volumes of data in ways that benefit their company as opposed to being overwhelmed by it.

Predictive Analysis

Predictive analysis is the phrase that has given to the manipulation of data into formats and charts that make sense of the information in a way that is useful. Predictive analysis of the data as to add value to any organisation, government or business.

It has to help them understand potential future trends, both in their underlying business as well as consumer or citizen habits. Predictive Analysis will to a large extent also show likely developments in individuals lifestyles and behaviours, as part of a wider pattern.

Such analysis will inevitably mean more information being gathered from consumers/ordinary people in order that predictive analysis have some meaning. This inevitably raises even more privacy concerns and cyber security threats and need for cyber insurance planning.

BIG DATA and ARTIFICIAL INTELLIGENCE

The whole area of artificial intelligence is relatively new, but one being heavily invested in by the major tech companies. The aim behind a lot of artificial intelligence research is to allow it to automatically analyse and manipulate the data by itself, without the need for human intervention.

The growth of artificial intelligence and robotics is one that will profound effect on the issue of big data and how it is used. The cyber security implications need to be part of any process of form regarding the storage, usage and predictive analysis of the data by whoever is storing it.

BIG DATA and HADOOP

Hadoop is an open source structure that can be used to store and manipulate sets of big data. Hadoop acts as a system that allows it to monitor clusters of computers to allocate types and amounts of different  jinformation in the most efficient manner possible.

About the Author

Comments are closed.