Musings from the Karmasphere Team

Develop MapReduce Applications for Hadoop from Eclipse

Thursday, 17 June 2010 00:00 | Written by MartinH

eclipse-new-project-a1-300x269

We’ve been asked many times by boatloads of organizations and developers to make our MapReduce developer product for Apache Hadoop available for Eclipse. Well we’ve been working on it and I’m happy to say that today, Karmasphere Studio is available for Eclipse.

The product is based on the Karmasphere Application Framework™, our native client-side Hadoop technology stack which incorporates core functionality for working with Hadoop clusters and jobs across all versions of Hadoop, from all major desktop operating systems and through firewalls.

What can you do with it? Here’s a flavor…

Easily develop and test Hadoop jobs in Eclipse, with full integration with Eclipse’s Java editor.
Enjoy visual runtime debugging of jobs on your Hadoop cluster from Eclipse.
Work with Amazon Elastic MapReduce and S3 from Eclipse and submit and manage jobs from the GUI.
Browse HDFS and S3, treating files as if they were local in Eclipse.
Use embedded Hadoop libraries for all released versions

As always, we’re happy to get This e-mail address is being protected from spambots. You need JavaScript enabled to view it on what you like, what you don’t, what you’d like us to add.

New Version of Karmasphere Studio Available

Monday, 14 June 2010 00:00 | Written by Shevek

Continuing our commitment to innovation and bringing the latest capabilities to Karmasphere Studio for Big Data professionals, we’ve released a new version of the product for NetBeans which includes:

* Support for Bootstrap Actions scripts on Amazon EMR clusters.
* Support for Hadoop 0.20 on Amazon EMR clusters.
* File chooser for remote filesystems (such as HDFS and Amazon S3).
* Updated embedded Hadoop libraries.
* Improved API on job submission.
* Support for new Amazon regions.
* Bandwidth used by monitor windows reduced.
* Monitor windows now asynchronous.
* Support for multiple filesystem roots in windows.
* Improved generic reflection in the MapReduce editor.
* Support for Hadoop 0.20 OutputFormat in MapReduce editor.

Up next and soon … Karmasphere Studio will be available for Eclipse

Big Data Camp Unconference and Hadoop Summit

Monday, 07 June 2010 00:00 | Written by MartinH

Hadoop Summit 2010 and Big Data Camp are just around the corner on Monday June 28 and Tuesday June 29 in Santa Clara, CA.

Seems like just yesterday when Hadoop Summit 2009 sold out in the worst economy in a century or so. I walked in the doors and couldn’t believe the combination of open source committers, enterprise big data professionals and all the signs of a disruptive force and new market. There were even some VCs there!

One year on, thanks to Yahoo!’s help, monthly Hadoop User Groups (HUGs) in Silicon Valley have grown from attendance around 30 to nearing 300. Karmasphere is one of several companies who’ve received funding, IBM have made a Hadoop announcement and this year’s Hadoop Summit is likely to be a significant step up again in attendance, announcements and maturation of a new ecosystem for big data intelligence.

To give attendees even more opportunity to network and learn about new technologies, products and services, we’re supporting Big Data Camp and Hadoop Summit. Attendance is free AND the format is unconference, facilitated by Dave Nielsen, Mr. Cloudcamp. This means you, the attendee, get to influence what you hear about. And the drinks and food are on us and our fellow underwriters.

Data Intelligence Expertise on our Board

Wednesday, 26 May 2010 00:00 | Written by MartinH

Our new board member, Gail Ennis, brings a unique combination of experience and talent to our growing team. Her key role in a business that extracts intelligence from large customer data sets and transforms it into business gold together with first hand knowledge of high growth environments makes Gail an invaluable addition to our board.

We’re working to add even more high caliber people to our team in the very near future.

Karmasphere and IBM’s Big Data Announcement

Wednesday, 19 May 2010 00:00 | Written by MartinH

Karmasphere is honored to be part of IBM”s “Big Data” announcement that was made this morning at the global Information on Demand Conference in Rome. We will have more to say about our work with IBM in the future, but for now read about it here, and for more background, here.

More Articles...