Too Much Data?

by Joey L
Summary:

The amount of data created in the world is growing at an exponential rate every day.  Statistical information shows that in 2010, the amount of data information in the world has grown over a zettabyte in size.  This is equivalent to one trillion gigabytes of information! Millions of data information is retrieved and inputted into the server systems every day.    For example, Facebook has over 700 million active users on its social network.  On average, the community of users creates 30 billion pieces of content over the web.  These range from posts and messages to photo and video content.  Another active social network such as Tweeter, which serves about 200 million users, is also creating an excess amount of data.  Statistics shows that on an average day, Twitter creates over 12 gigabytes of data through its system.  Other communities like Boeing, create 10 terabytes of data every 30 minutes.  The volume of data is growing beyond what was intended.  With so much big data moving across the network every day, there is a need to create a new system that is more efficient and lower cost than the current open source software, Hadoop.  With so much data creating every day, there will need to be a further advancement in data integration and database systems.

Reflection:

I find this article to be quite interesting as it does tie to this week topic, data.  I never looked into how much data the world is creating until I read this article, which I find to be very true.  This will certainly bring new challenges to data systems.  Currently there are already many data sets that are difficult to managed or analyze due to its size.  With the wide variety of data producing sources that we currently have in our society as well as new technologies emerging every year, there is a need to innovate the current data integration systems.  Many of the common tools we have for management and infrastructures will need to be upgraded to carry a high volume of data structures.

I think that because there is a need to innovate the current system, there will be ample amount of job openings for analytics and business intelligence. Enterprises are of course trying to find a better platform to help execute their objective.  Data will become more manageable by producing a new platform.  Overall, by producing a new framework, high volumes of data can be accessed and stored more efficiently which will thus lower computing workloads.

Rogers, S. (2011 September/October). Big Data is Scaling BI and Analytics. Retrieved from http://www.information-management.com/issues/21_5/big-data-is-scaling-bi-and-analytics-10021093-1.html?pg=1

Tags

3 thoughts on “Too Much Data?”

  1. I agree with you, systems will definately have to be improved since the number of people accessing and uploading data is increaing daily. It is fascinating how much data is being produced by only the few business that you mentioned, now imagine every single one across the world. You did say that one trillion gigabytes of data was produced in 2010, i wonder if that included all the classified information from the government and private entetities. Just food for thought.

  2. I’m impressed with how much data Boeing creates every 30 minutes, 10 terabytes that’s a lot of date. I think that now that cloud computing has become more popular the data that we now use will be store in clouds. Clouds will be able to store the data that Facebook and Twitter use in a more effective and economical manner.

  3. ive always wondered about this. when facebook started the “infinite wall” i was able to back track for what seemed like forever through all my information. at that point i knew we had a data storage problem. we never let anything go, it jsut keeps on building up, and we just keep throwing stuff at it. we store data about everything, weather, test results, ocean temperatures. i dont think we need to find a way to better store it we need to start cycling it out.

Comments are closed.