by Joey L
The amount of data created in the world is growing at an exponential rate every day. Statistical information shows that in 2010, the amount of data information in the world has grown over a zettabyte in size. This is equivalent to one trillion gigabytes of information! Millions of data information is retrieved and inputted into the server systems every day. For example, Facebook has over 700 million active users on its social network. On average, the community of users creates 30 billion pieces of content over the web. These range from posts and messages to photo and video content. Another active social network such as Tweeter, which serves about 200 million users, is also creating an excess amount of data. Statistics shows that on an average day, Twitter creates over 12 gigabytes of data through its system. Other communities like Boeing, create 10 terabytes of data every 30 minutes. The volume of data is growing beyond what was intended. With so much big data moving across the network every day, there is a need to create a new system that is more efficient and lower cost than the current open source software, Hadoop. With so much data creating every day, there will need to be a further advancement in data integration and database systems.
I find this article to be quite interesting as it does tie to this week topic, data. I never looked into how much data the world is creating until I read this article, which I find to be very true. This will certainly bring new challenges to data systems. Currently there are already many data sets that are difficult to managed or analyze due to its size. With the wide variety of data producing sources that we currently have in our society as well as new technologies emerging every year, there is a need to innovate the current data integration systems. Many of the common tools we have for management and infrastructures will need to be upgraded to carry a high volume of data structures.
I think that because there is a need to innovate the current system, there will be ample amount of job openings for analytics and business intelligence. Enterprises are of course trying to find a better platform to help execute their objective. Data will become more manageable by producing a new platform. Overall, by producing a new framework, high volumes of data can be accessed and stored more efficiently which will thus lower computing workloads.
Rogers, S. (2011 September/October). Big Data is Scaling BI and Analytics. Retrieved from http://www.information-management.com/issues/21_5/big-data-is-scaling-bi-and-analytics-10021093-1.html?pg=1