Karmasphere Studio
Karmasphere Studio is a graphical development environment that accelerates the Hadoop development process. Available in a free Community Edition and an enhanced Professional Edition, it was designed from the ground up to dramatically reduce the time and effort required to produce a MapReduce job, from initial conception through to deployment and production.
Karmasphere Studio increases productivity by shielding users from the intricacies of Hadoop and enables them to do more in fewer steps. It makes it easy to learn and to implement MapReduce jobs. In addition, it can be deployed from any operating system, through any proxy and firewall, and to any version of Hadoop in private or public clouds.
Benefits
Karmasphere Studio helps you develop, debug and deploy Hadoop jobs in a fraction of the time it would otherwise take:- Job Developer: Simplifies and speeds up the prototyping, development and debugging of Hadoop jobs through the use of Hadoop emulation and a visual workflow.
- Real-Time Monitoring and Insight: Define, manage, visualize and monitor jobs, clusters and file systems in real-time, including navigating and utilizing file systems from a desktop and monitoring file systems on the cluster. Get real-time insight into jobs, including workflow views of inputs, outputs and intermediate results to manage job execution time.
- Deploy Anywhere from Anywhere through Anywhere: Deploy from any operating system, through any proxy and firewall, and to any version of Hadoop in private or public clouds.
- Visual Job Profiling: Includes job timelines, diagnostic tools and charts to ensure production readiness (and to facilitate job debugging after deplyment to production)
- Job Export Capabilities: Export jobs for production development, configurable for multiple deployment scenarios
Whether you are a Java programmer (with or without prior MapReduce or Hadoop experience) or a development manager simply interested in learning more about Hadoop, Karmasphere Studio will simplify your job and increase your productivity:
| Activity | Productivity Enhancement |
|
Design |
Prototype Web Templates on the desktop: Get going with MapReduce job development quickly. No need for a cluster; Hadoop emulation is included. |
|
Deploy |
Deploy to a private or cloud-based cluster: Whether you're using a cluster in your own network or in a cloud, deploy your jobs easily (even through proxies and firewalls!). |
|
Debug |
Debug on the cluster: One of the most challenging areas in MapReduce programming is debugging your job on the cluster. Visual tools deliver real-time insight into your job, including support for viewing and charting Hadoop jobs and task counters. |
|
Visualize |
Graphically review and manipulate: Whether you're debugging clusters, file systems, job configuration, counters, log files or other information, you'll save time and get better insight by accessing it all in one place with a powerful GUI. Observe and analyze your jobs in real-time: Get real-time, workflow views of inputs, outputs and intermediate results -- including map, partition, sort, and reduce phases -- to manage job execution time. |
You do NOT need to set up a Hadoop cluster in order to begin prototyping! Once you are ready to deploy your job on a large data set, you'll need a virtual or real cluster in your data center or in a public cloud such as Amazon Web Services.
Watch an introductory video to Karmasphere Studio.
Edition Comparison
| Features | Community Edition |
Professional Edition |
| Desktop Prototyping (no cluster required) |  |
|
| GUI to Manipulate Clusters, File Systems and Job Development | |
|
| Job Portability Across Hadoop Flavors | |
|
| Deploy through Proxies and Firewalls | |
|
| Monitor and Analyze your Jobs in Real-time | |
|
| Job Performance Timelines |  |
|
| Execution Diagnostics | |
|
| Job Charting | |
|
| Job Export | |
|
| Support | |
|
Technical Details
- Runs on Linux, Apple Mac OS and Windows
- Works with all major distributions and versions of Hadoop including Apache, Yahoo!, IBM InfoSphere BigInsights and Cloudera
- Works with Amazon Elastic MapReduce
- Supports Eclipse and NetBeans design environments
- Supports local, networked, HDFS and Amazon S3 file systems
- Support for Cascading
- Enables job submission from all major platforms including Windows
- Operates with clusters and file systems behind firewalls