26 Aug '14, 4pm

What's the big deal with BigData? @lifehacker provides a beginners guide for understanding BigData

What's the big deal with BigData? @lifehacker provides a beginners guide for understanding BigData

Messy and poorly defined data is another challenge of Big Data. Due to its size, it tends to circumvent relational database schemas (i.e. it has none). So when reading it, let alone analyzing it in real time (think of the Firehose twitter feed that spits thousands of long, dense lines of concatenated key-pair values every millisecond) requires a lot of work. We need to find and only extract relevant data out of a huge ocean of comma delimited text. This may entail building a schema on the fly while extracting the data, meaning you check the data each time it is read that it fits a set of parameters and data types. Anything that doesn't fit is ignored, assumed different, or erroneous. Fault tolerance has to be built-in as the process of sifting through billions of rows cannot afford to stop and ask why one line of data looks different.

Full article: http://hackerspace.lifehacker.com/do-you-speak-big-data-5...

Tweets

BEGINNERS: An A-Z guide to common running terms

runnersworld.com 26 Aug '14, 8am

Elite runners train at altitude to increase their number of red blood cells, improving oxygen delivery to their muscles. A...

BP Wins Big In Offshore Oil Drilling Lease Auction

desmogblog.com 25 Aug '14, 9pm

For all of his administration’s tough talk on protecting our environment, President Obama doesn’t seem to have any problem...

The Road to Data Maturity for #SupplyChain Resi...

ebnonline.com 25 Aug '14, 4pm

One of the questions that supply chain managers ask is if there are solutions that are both simple and efficient, approach...

The Road to Data Maturity for #SupplyChain Resi...

ebnonline.com 25 Aug '14, 2pm

One of the questions that supply chain managers ask is if there are solutions that are both simple and efficient, approach...

New: Understanding, Measuring and Comparing Rates of Return in Property Investing

New: Understanding, Measuring and Comparing Rat...

propwise.sg 26 Aug '14, 2pm

By Gerald Tay (guest contributor) I’ve received feedback, both positive as well as negative, on my previous article Proper...

China is about to make a really big bet on electric cars (100 billion yuan!)

China is about to make a really big bet on elec...

treehugger.com 27 Aug '14, 7pm

Any way you slice it, a hundred billion yuan is a lot of moolah (equivalent to about 16.3 billion US dollars at today's ex...

Golf Channel Reveals 12-Member Cast for Big Bre...

golfchannel.com 26 Aug '14, 4pm

Emily Tubert (22, Burbank, Calif.) – A three-time All-American at the University of Arkansas, Tubert is competing on Big B...

#energyefficiency

#energyefficiency

switchboard.nrdc.org 26 Aug '14, 1pm

All of our online activity -- including email, internet use, social media, and conducting business -- is delivered through...

#BigData News » Intel's Big Data to Fight Parki...

eetimes.com 14 Aug '14, 2pm

NEW YORK — Intel is collaborating with the Michael J. Fox Foundation (MJFF) to use big data analytics in research and trea...

#Startup #Jobs: Paktor is looking for a Lead Da...

startupjobs.asia 26 Aug '14, 1am

Paktor is the leading SE Asian provider of various social networking platforms that are dedicated to helping Asian singles...

The Metro Big Sale is on from now till 14th Sep; see what offers are in store for you!

The Metro Big Sale is on from now till 14th Sep...

metro.com.sg 25 Aug '14, 12am

The Metro Big Sale is back this year and it’s better than ever with big savings! From 22 August - 14 September, don’t miss...

Ocean temperature changes are a big alarm call https://t.co/9mH3uFpxJn

Ocean temperature changes are a big alarm call ...

earthtimes.org 25 Aug '14, 9am

The sperm whale dives down to the depths of the Atlantic where heat energy is being stored, ready for release back to the ...