Big Data Concept

What is Big Data? We are dealing with data for so many years. But in today's landscape the emphasis has shifted to analytics and Big Data. Best result can be expected from analytics only when it is provided with high quantity and high quality of data. The more data we have, the better decision we get. Currently data of size of data we deal with is in petabytes which will in future will scale to zeta bytes. With the evolution of technology over the year we are proficient in dealing with massive database, data marts and data warehouses. But now things have changed. We are getting data from different sources which are largely unstructured. So it is a new challenge for the organization how to handle that vast amount of data both structured and unstructured. This situation is dealt with Big Data. We have reached a point of Data Explosion. From where we are getting all these data. The below diagram explain this. The data comes from multiple source sensors that gather cl...

Big Data is used for storing enormous data which is both structured and unstructured and coming from different sources like sensors. In this post I am going to explain Real Time Analytics of Big Data. The data that we deal with can be analyzed by two ways. When the data is in motion. That mean when data is still running and it has not been inserted into database. After data has been inserted into database. Now the world has become so fast that if we wait for the data to be inserted into database and then analyze it, sometimes it becomes useless. Let me give some example. We have CCTV camera at every traffic signal. It generates millions of data every second. Now traditionally we follow the technique where when some crime happens then we analyze the database and try to figure out the criminal. This is the bottom up approach. The better option is to analyze every things at source in real time. We will put face scanner at every source and the moment it find some suspects it ...