Hackaday Prize Entry: An Oven Of Raspberry Pis

When the Raspberry Pi was introduced, the world was given a very cheap, usable Linux computer. Cheap is good, and it enables one kind of project that was previously fairly expensive. This, of course, is cluster computing, and now we can imagine an Aronofsky-esque Beowulf cluster in our apartment.

This Hackaday Prize entry is for a 100-board cluster of Raspberry Pis running Hadoop. Has something like this been done before? Most certainly. The trick is getting it right, being able to physically scale the cluster, and putting the right software on it.

The Raspberry Pi doesn’t have connectors in all …read more

Continue reading Hackaday Prize Entry: An Oven Of Raspberry Pis

Cray’s latest supercomputer runs OpenStack and open source big data tools

Cray Urika-GX super computer Cray has always been associated with speed and power and its latest computing beast called the Cray Urika-GX system has been designed specifically for big data workloads. What’s more, it runs on OpenStack, the open source cloud platform and supports open source big data processing tools like Hadoop and Spark. Cray recognizes that the computing world had evolved since Seymour Cray… Read More Continue reading Cray’s latest supercomputer runs OpenStack and open source big data tools

Three Tips for Optimizing Big Data Analytics

Every year, the amount and type of data companies must manage increases. Commonly called Big Data, this information—everything from social media posts, audio and images to transaction records, sensor data and video—continues growing unabated. According to IDC, data is growing at 40 percent per year and will continue to do so into the next decade.

read more

Continue reading Three Tips for Optimizing Big Data Analytics

Newcomer Galactic Exchange can spin up a Hadoop cluster in five minutes

Business running with computer to illustrate speed. A new company with a cool name, Galactic Exchange, came out of stealth today with a great idea. It claims it can spin up a Hadoop cluster for you in five minutes, ready to go. That’s no small feat if it works as advertised and greatly simplifies what has traditionally been a process wrought with complexity.
The new product called ClusterGX is being released in Beta this week… Read More Continue reading Newcomer Galactic Exchange can spin up a Hadoop cluster in five minutes

Altiscale’s latest cloud service brings Hadoop to business users

Man reaching for tablet with lots of data on it. Altiscale, a company that has always been about reducing the complexity related to using Hadoop, has taken that to the next level today with the release of Altiscale Insight Cloud, a cloud service aimed at making Hadoop accessible to business users.
Altiscale Insight Cloud provides services for data ingestion, processing, analysis and visualization. That includes the ability to… Read More Continue reading Altiscale’s latest cloud service brings Hadoop to business users

LinkedIn open-sources its WhereHows data discovery and lineage portal

linkedin chocs LinkedIn today open-sourced WhereHows, a meta data-centric tool the company has long used internally to make it easier for its employees to discover data the company generates and to track the lineage of its datasets as they move around its various internal tools and services. Now that almost every modern business creates massive amounts of data, simply managing how all this information… Read More Continue reading LinkedIn open-sources its WhereHows data discovery and lineage portal