|
|
View Full Version : The Glory of Big Data
KilljoyKlown 11-14-11, 04:56 PM Until I read this article I never heard of a zettabyte before (proof you can never have enough storage). However I am now wondering if we will ever be able to catch up on our ability to analyze all the data we are creating year after year.
The amount of data available to us is increasingly vast. In 2010 we played, swam, wallowed, and drowned in 1.2 zettabytes of the stuff, and in 2011 the volume is predicted to continue along its exponential growth curve to 1.8 zettabytes. (A zettabyte is a trillion gigabytes; that’s a 1 with 21 zeros trailing behind it.) The IDC Digital Universe study from which I’ve plucked these numbers helpfully notes that if you were inclined to store all that data on the hard drives of 32-gigabyte iPads, doing so would require 57.5 billion devices—enough to erect a 61-foot-high wall 4,005 miles long, from Miami all the way to Anchorage.
http://www.popsci.com/technology/article/2011-10/glory-big-data
scheherazade 11-14-11, 07:33 PM Until I read this article I never heard of a zettabyte before (proof you can never have enough storage). However I am now wondering if we will ever be able to catch up on our ability to analyze all the data we are creating year after year.
http://www.popsci.com/technology/article/2011-10/glory-big-data
Does this qualify as verification that life as we know it is nothing more than 'Trivial Pursuit' on the mega-scale, and that we are all born 'players'? :D
KilljoyKlown 11-14-11, 07:42 PM Does this qualify as verification that life as we know it is nothing more than 'Trivial Pursuit' on the mega-scale, and that we are all born 'players'? :D
Damn! I was never that good at Trivial Pursuit. But I would like to know what comes after zettabyte? Just in case I'm still alive when I hear the term for that much data.:D
KilljoyKlown 11-14-11, 07:47 PM Never mind I found the answer.
What comes after zettabyte?
The yottabyte (derived from the SI prefix yotta-) is a unit of information or computer storage equal to one septillion (one long scale quadrillion or 1024) bytes (one quadrillion gigabytes). The unit symbol for the yottabyte is YB.
After Terabyte comes a Petabyte then Exabyte then Zettabyte then Yottabyte
(not spelled after the great Jedi Master :-(
(interesting fact: 2 Pedabytes would store the entire contents of ALL US
academic libraries).
Megabyte = 1/1152921504606846976 yottabyte
= 1/1125899906842624 zettabyte
= 1/1099511627776 exabyte
= 1/1073741824 petabyte
= 1/1048576 terabyte
= 1/1024 gigabyte
= 1 megabyte
= 8 Megabits
= 1024 kilobytes
= 8192 Kilobits
= 1048576 bytes
= 2097152 nibbles
= 8388608 bits
gigabyte = 1/1125899906842624 yottabyte
= 1/1099511627776 zettabyte
= 1/1073741824 exabyte
= 1/1048576 petabyte
= 1/1024 terabyte
= 1 gigabyte
= 1024 megabytes
= 8192 Megabits
= 1048576 kilobytes
= 8388608 Kilobits
= 1073741824 bytes
= 2147483648 nibbles
= 8589934592 bits
terabyte = 1/1099511627776 yottabyte
= 1/1073741824 zettabyte
= 1/1048576 exabyte
= 1/1024 petabyte
= 1 terabyte
= 1024 gigabytes
= 1048576 megabytes
= 8388608 Megabits
= 1073741824 kilobytes
= 8589934592 Kilobits
= 1099511627776 bytes
= 2199023255552 nibbles
= 8796093022208 bits
petabyte = 1/1073741824 yottabyte
= 1/1048576 zettabyte
= 1/1024 exabyte
= 1 petabyte
= 1024 terabytes
= 1048576 gigabytes
= 1073741824 megabytes
= 8589934592 Megabits
= 1099511627776 kilobytes
= 8796093022208 Kilobits
= 1125899906842624 bytes
= 2251799813685248 nibbles
= 9007199254740992 bits
Exabyte = 1/1048576 yottabyte
= 1/1024 zettabyte
= 1 exabyte
= 1024 petabytes
= 1048576 terabytes
= 1073741824 gigabytes
= 1099511627776 megabytes
= 8796093022208 Megabits
= 1125899906842624 kilobytes
= 9007199254740992 Kilobits
= 1152921504606846976 bytes
= 2305843009213693952 nibbles
= 9223372036854775808 bits
Zettabyte = 1/1024 yottabyte
= 1 zettabyte
= 1024 exabytes
= 1048576 petabytes
= 1073741824 terabytes
= 1099511627776 gigabytes
= 1125899906842624 megabytes
= 9007199254740992 Megabits
= 1152921504606846976 kilobytes
= 9223372036854775808 Kilobits
= 1180591620717411303424 bytes
= 2361183241434822606848 nibbles
= 9444732965739290427392 bits
yottabyte = 1 yottabyte
= 1024 zettabytes
= 1048576 exabytes
= 1073741824 petabytes
= 1099511627776 terabytes
= 1125899906842624 gigabytes
= 1152921504606846976 megabytes
= 9223372036854775808 Megabits
= 1180591620717411303424 kilobytes
= 9444732965739290427392 Kilobits
= 1208925819614629174706176 bytes
= 2417851639229258349412352 nibbles
= 9671406556917033397649408 bits
KilljoyKlown 11-14-11, 07:54 PM But now I want to know what nibbles are between bits and bytes? They seem to be low enough down on the list that I should have heard about them by now.:shrug:
scheherazade 11-14-11, 07:56 PM Damn! I was never that good at Trivial Pursuit. But I would like to know what comes after zettabyte? Just in case I'm still alive when I hear the term for that much data.:D
When one contemplates the scale of life as we presently know it, and how recently our species actually evolved written language and began to record our history and observations, now advancing to digital data, the number of zeros after the numeral is nothing more than a tribute to our human vanity.
We have barely scratched the frost on the window pane, that we might peer at the larger picture beyond, IMO.
At the presently increasing rate of proliferation of information, there's a reasonably good chance that you may come to know what follows zettabyte, KJ. :D
scheherazade 11-14-11, 07:58 PM See? That was quick, LOL..... ;)
KilljoyKlown 11-15-11, 04:15 PM Okay I found more.:D
What comes after a Yottabyte?
Share
1024 Bytes = 1 Kilobyte
1024 Kilobytes = 1 Megabyte
1024 Megabytes = 1 Gigabyte
1024 Gigabytes = 1 Terabyte
1024 Terabytes = 1 Petabyte
1024 Petabytes = 1 Exabyte
1024 Exabytes = 1 Zettabyte
1024 Zettabyte = 1 Yottabyte
What comes after 1 Yottabyte? Well, there have been some proposals put forward for the following, and apparently a decision should have been made this year in order to finalize these terms:
1024 Yottabytes = 1 Brontobyte
1024 Brontobytes = 1 Geobyte
1024 Geobytes = 1 Zotzabyte
According to CSIRO, in the next decade, astronomers expect to be processing 10 petabytes of data every hour from the Square Kilometre Array telescope. The telescope is expected to generate around 1 exabyte of data every four days. According to Cisco, annual global IP traffic for 2013 is estimated to be around 667 exabytes. With augmented reality on its way and a number of other exciting things, I’m estimating global IP traffic to be around a couple 100 Zotzabytes by 2018.
KilljoyKlown 11-15-11, 06:52 PM As long as we are on big data it's only fair to include big numbers.
The names for larger numbers, based on the "short scale" where each value is a multiple of 1000:
1,000 X 1 thousand = 1 million (106)
1,000 X 1 million = 1 billion (109)
1,000 X 1 billion = 1 trillion (1012)
1,000 X 1 trillion = 1 quadrillion (1015)
1,000 X 1 quadrillion = 1 quintillion (1018)
1,000 X 1 quintillion = 1 sextillion (1021)
1,000 X 1 sextillion = 1 septillion (1024)
1,000 X 1 septillion = 1 octillion (1027)
1,000 X 1 octillion = 1 nonillion (1030)
1,000 X 1 nonillion = 1 decillion (1033)
1,000 X 1 decillion = 1 undecillion (1036)
1,000 X 1 undecillion = 1 duodecillion (1039)
Other very large numbers are:
One googol = 10100
One googolplex = 10googol
One googolplexian = 10googolplex
Even larger numbers exist. One is called "Graham's Number", which is so large that it could never be written out using ordinary number notations.
Read more: http://wiki.answers.com/Q/What_are_the_numbers_that_come_after_a_trillion#ix zz1dpDJNCZx
leopold 11-17-11, 08:07 PM But now I want to know what nibbles are between bits and bytes? They seem to be low enough down on the list that I should have heard about them by now.:shrug:
a nibble is 4 bits, half a byte.
Until I read this article I never heard of a zettabyte before (proof you can never have enough storage). However I am now wondering if we will ever be able to catch up on our ability to analyze all the data we are creating year after year.
http://www.popsci.com/technology/article/2011-10/glory-big-data
Isn't that just storage?
Analysis-wise, bigger is getting more common, but analysis is still pretty fast. On my cheesy, 4-yr old machine, I run 40,000 individuals for 15 traits and a dozen covariates in about 5 seconds. Throw in a million SNP chip and maybe you'd have a two-day run for a univariate model. But that much data takes up less than a gig. Only solution: fill the available space with more breeding and more assays.
quadraphonics 11-17-11, 08:20 PM a nibble is 4 bits, half a byte.
Yeah, popular amongst embedded programmers and hackers who express numbers in hexidecimal - in that case, each digit represents 4 bits, or 1 nibble.
KilljoyKlown 11-17-11, 08:24 PM a nibble is 4 bits, half a byte.
Yeah! I got that much, but I've been working with computers for 40 years now and this is the first I've ever heard of a nibble.
leopold 11-17-11, 08:31 PM Yeah! I got that much, but I've been working with computers for 40 years now and this is the first I've ever heard of a nibble.
since BCD, HEX, and the archaic octal use 4 bits they had to call it something.
i found out about nibbles during my college days, back in the early 80s.
KilljoyKlown 11-17-11, 08:36 PM Isn't that just storage?
Analysis-wise, bigger is getting more common, but analysis is still pretty fast. On my cheesy, 4-yr old machine, I run 40,000 individuals for 15 traits and a dozen covariates in about 5 seconds. Throw in a million SNP chip and maybe you'd have a two-day run for a univariate model. But that much data takes up less than a gig. Only solution: fill the available space with more breeding and more assays.
The article stated the total world data went up 1.2 zettabytes last year and will go up 1.8 zettabytes this year and so on and on. This is a very diverse data and doesn't lend itself to easy analysis. Just the data we are pulling in from all our space activities takes many years of analysis, so we are always playing catch up. The information is coming in faster than we can process it all. Sure we prioritize, but that will mean a very big pool of data will be left waiting who knows how long if ever.
Even as fast as our storage and processing power is advancing, it's way to slow to keep up.
KilljoyKlown 11-17-11, 08:42 PM since BCD, HEX, and the archaic octal use 4 bits they had to call it something.
i found out about nibbles during my college days, back in the early 80s.
I think I may have heard one of the other names it went by or something or it just wasn't something I needed to remember so I didn't.
|