IBM InfoSphere BigInsights Enterprise Edition analytics platform enables new class of solutions for gaining rapid insight through large-scale analysis of diverse data

IBM United States Software Announcement 211-196
May 24, 2011


Table of contents
Overview Overview Technical information Technical information
Key prerequisites Key prerequisites Ordering information Ordering information
Planned availability date Planned availability date Terms and conditions Terms and conditions
Description Description Prices Prices
Program number Program number Order
now Order now
Publications Publications


Top rule
At a glance
Bottom rule

IBM® InfoSphere® BigInsights Enterprise Edition is an analytics platform that enables a new class of solutions, such as text analytics, to gain rapid insight through large-scale analysis of unconventional and diverse data.

  • Built on the IBM distribution of Apache Hadoop to meet Big Data requirements
  • Enables rapid exploratory analysis and modeling of unconventional data
  • Provides powerful text analytics capabilities
  • Supports unstructured, semistructured, and structured data for maximum flexibility; data structure can be interpreted on the fly
  • Supports massive scale-out
    • Runs on commonly available hardware
  • Is inherently highly resilient and fault tolerant
  • Supports and integrates with existing traditional information management infrastructure

For ordering, contact your IBM representative, an IBM Business Partner, or IBM Americas Call Centers at 800-IBM-CALL (Reference: YE001).



Back to topBack to top
 
Top rule
Overview
Bottom rule

IBM InfoSphere BigInsights is a new class of analytics platform based on open source Hadoop and innovation from IBM. It can store raw data as-is and help clients gain rapid insight through large-scale analysis of unconventional and diverse data that is ever increasing in volume, variety, and velocity. IBM InfoSphere BigInsights Enterprise Edition provides enterprise-class capabilities to enable analytic solutions that turn data complexity into insight cost-effectively through massive scale-out data processing and analysis on commonly available hardware, with built-in resiliency and fault tolerance.

IBM InfoSphere BigInsights Enterprise Edition includes:

  • The IBM distribution of Apache Hadoop to support massive scale-out data processing and analysis on commonly available hardware, with inherent resiliency and fault tolerance
  • Jaql, a Query Language for JavaScript™ Object Notation (JSON) to facilitate analysis of unconventional data, and integration with traditional data stores
  • Various open source components from the Hadoop ecosystem, including:
    • Pig (programming language)
    • Flume (data collection/aggregation)
    • Hive (data summarization/querying)
    • Lucene (text search)
    • Zookeeper (process coordination)
    • Avro (data serialization)
    • HBase (real time read/write)
  • A management console for easy administration
  • Capability to easily integrate with IBM InfoSphere Warehouse, and DB2® for Linux™, UNIX™, and Windows™
  • A powerful text analytics engine
  • An integrated web-based management console, LDAP authentication and security
  • An integrated workflow engine
  • A flexible scheduler
  • IBM Optim™ Development Studio 2.2.1


Back to topBack to top
 
Top rule
Key prerequisites
Bottom rule

Refer to the Hardware requirements and Software requirements sections of this announcement.



Back to topBack to top
 
Top rule
Planned availability date
Bottom rule

May 27, 2011: Electronic availability

June 24, 2011: Media availability



Back to topBack to top
 
Top rule
Description
Bottom rule

Many enterprises are experiencing rapid, difficult to manage, information growth. Over 80% of this information is semistructured or unstructured including web pages, web log files, click-streams, search indexes, instant messages, text messages, email, documents, and so on. These large and untapped data sets define a new category of information: Big Data. They offer tremendous potential for deep insights, including understanding customer behavior, from which business decisions could be made. IBM InfoSphere BigInsights Enterprise Edition provides the tools to build an information strategy for analyzing and understanding this unconventional information, similar to how structured information is processed for business gain using traditional approaches.

IBM InfoSphere BigInsights Enterprise Edition allows rapid exploration of Big Data by creating distributed jobs capable of running on clusters of computers. This infrastructure can be used to tackle very large data sets by breaking the data into "chunks" and coordinating the processing of the data across a massively parallel environment, with inherent resilience and fault tolerance.

Once the raw data has been stored across the nodes of a distributed cluster, follow-up queries and analysis of the data can be handled efficiently, with dynamic interpretation of the data format at read time.

IBM InfoShere BigInsights Enterprise Edition consists of the following for a solution-ready platform:

  1. The IBM distribution of Apache Hadoop including:
    • MapReduce - Highly parallel flexible data processing framework supports structured, semistructured, and unstructured for maximum flexibility; structure can be interpreted on the fly
    • Hadoop Distributed File System (HDFS) - Scalable, self-healing data storage
  2. Jaql - A Query Language for JavaScript Object Notation (JSON) for advanced analytics. It is designed to facilitate analysis of large-scale semistructured data. Jaql is simple to use with built-in flexibility to model complex data and add user extensibility. It uses Hadoop to extend parallelism.
  3. Open source components from the Hadoop ecosystem:
    • Pig (programming language)
    • Flume (data collection/aggregation)
    • Hive (data summarization/querying)
    • Lucene (text search)
    • Zookeeper (process coordination)
    • Avro (data serialization)
    • HBase (real time read/write)
  4. Capability to easily integrate with InfoSphere Warehouse, and DB2 for Linux, UNIX, and Windows. This includes a set of DB2 user-defined functions that enable invocation of Hadoop jobs through SQL, and easy exchange of data between Hadoop File System and DB2 tables.
  5. A powerful text analytics engine, that allows users to easily specify rules in an SQL-similar syntax, optimizes this specification, and executes it in a highly efficient manner using the parallelism provided by the IBM InfoSphere BigInsights engine, to analyze large amounts of text and produce annotated documents that provide valuable insights into unconventional stored data.
  6. An integrated web console that includes management console, LDAP Authentication, and security functionality
  7. A workflow engine to define, manage, and deploy analytic workflows.
  8. A flexible scheduler that provides the capability to set a scheduling policy for analytic jobs, such as average response time and weighted number of tardy jobs.
  9. IBM Optim Development Studio 2.2.1, that provides a Java™ integrated development environment (IDE) based on the Eclipse platform - one of the most popular environments for developing Java applications. Java is the core development language for working with IBM InfoSphere BigInsights. Optim Development Studio's extensive database development and administration tools are especially productive when developing integrated applications that leverage BigInsights and relational databases or data warehouses together.

IBM InfoSphere BigInsights can be used with other products for advanced analytics and a more comprehensive information strategy. It enables clients to combine traditional data warehouse analysis with dynamic insights from unstructured and semistructured data, enabling a more complete view of the business not possible before. Combined with IBM InfoSphere Streams and IBM InfoSphere Warehouse, it can extend analysis to encompass information-in-motion, and information accumulated over a long period of time.

For additional information on IBM InfoSphere BigInsights, refer to

http://www.ibm.com/software/data/infosphere/biginsights


Back to topBack to top
 
Top rule
Program number
Bottom rule

Program    VRM                          Program name
number
 
5725-C09   1.1.0                        IBM InfoSphere BigInsights
                                        Enterprise Edition



Back to topBack to top
 
Top rule
Offering Information
Bottom rule

Product information is available via the Offering Information website

http://www.ibm.com/common/ssi

Also, visit the Passport Advantage® website

http://www.ibm.com/software/passportadvantage


Back to topBack to top
 
Top rule
Publications
Bottom rule

No hardcopy publications are shipped with this product.

The IBM Publications Center

http://www.ibm.com/shop/publications/order

The Publications Center is a worldwide central repository for IBM product publications and marketing material with a catalog of 70,000 items. Extensive search facilities are provided. Payment options for orders are via credit card (in the US) or customer number for 20 countries. A large number of publications are available online in various file formats, and they can all be downloaded by all countries.



Back to topBack to top
 
Top rule
Technical information
Bottom rule

Specified operating environment

Hardware requirements
  • x86 64-bit systems with a minimum of 4 GB memory
  • Minimum 30 GB of disk storage
Software requirements
  • Red Hat Enterprise Linux (RHEL) 5.0 Update 3 Advanced Platform x86-64
    or
  • Red Hat Enterprise Linux (RHEL) 5.0 Update 4 Advanced Platform x86-64
    or
  • Red Hat Enterprise Linux (RHEL) 5.0 Update 5 Advanced Platform x86-64
    or
  • SUSE Linux Enterprise Server (SLES) 11.0 x86-64

The program's specifications and specified operating environment information may be found in documentation accompanying the program, if available, such as a readme file, or other information published by IBM, such as an announcement letter. Documentation and other program content may be supplied only in the English language.

Limitations

For additional information, refer to the license information document that is available on the IBM Software License Agreement website

http://www.ibm.com/software/sla/sladb.nsf

Planning information

Packaging

Physical media:

  • IBM InfoSphere BigInsights Enterprise Edition V1.1.0 - CD
  • IBM Optim Development Studio V2.2.1.0 (PID = 5724-X83)

Downloadable:

  • IBM InfoSphere BigInsights Enterprise Edition V1.1.0 software
  • IBM InfoSphere BigInsights Enterprise Edition V1.1.0 Quick Start Guide

Security, auditability, and control

IBM InfoSphere BigInsights Enterprise Edition uses the security and auditability features of the host hardware or software.

The customer is responsible for evaluation, selection, and implementation of security features, administrative procedures, and appropriate controls in application systems and communication facilities.



Back to topBack to top
 
Top rule
Ordering information
Bottom rule

This product is only available via Passport Advantage. It is not available as shrinkwrap.

Product information

Licensed function title             Product group   Product
                                                    category
 
IBM InfoSphere BigInsights          BigInsights     InfoSphere
                                                    BigInsights

Program name                          PID        Charge unit
                                      number     description
 
IBM InfoSphere BigInsights            5725-C09   Per Resource
                                                 Value Unit

Charge metrics definitions

Resource Value Unit (RVU)

RVU is the unit of measure by which this program is licensed. RVU entitlements are based on the quantity of a specific designated measurement for the given program. A Proof of Entitlement (PoE) must be obtained for the appropriate number of RVUs required for your environment as defined by the specific program terms. The RVU entitlements are specific to the program and may include, but are not limited to the following: client devices, data source records, messages, and servers, and may not be exchanged, interchanged, or aggregated with RVU entitlements of another program. To understand these benefits of RVU licensing, and to determine how many RVUs to obtain for the program, contact your IBM representative.

The resource for the purpose of the RVU calculation is the number of Terabytes of storage managed by the program. A Terabyte is 2 to the 40th power bytes. Licensee must obtain RVU entitlements for this program sufficient to cover the storage managed by the program in the Licensee's environment.

Value Unit Exhibit 027 (VUE027) is used for the purpose of calculating the number of RVUs required. Value Unit Exhibit 027 (VUE027) is shown in the table below.

The following examples are provided to illustrate your licensing requirements.

IBM InfoSphere BigInsights Enterprise Edition requires entitlement for all resources managed (terabytes of storage). In this case, the resources to enter into the volume tiering table to calculate Resource Value Units are the total terabytes of storage being managed by IBM InfoSphere BigInsights Enterprise Edition.

Units to order

Resource Value Units are calculated based upon the following volume tiering table and are rounded up to the next whole number.

Value unit exhibit 027 (VUE027)

Cumulative Usage Level            Value Units per Terabyte
 
1 - 12 Terabytes                  1 vu/Terabyte
13-32 Terabytes                   0.8455 VUs/Terabyte
33-64 Terabytes                   0.6137 VUs/Terabyte
65-100 Terabytes                  0.4639 VUs/Terabyte
101-250 Terabytes                 0.3870 VUs/Terabyte
251+ Terabytes                    0.3097 VUs/Terabyte

Products may also have program-specific licensing terms, which are described later in this document. Consult the program-specific licensing terms to determine total licensing requirements for the applicable products.

Pricing scenario for IBM InfoSphere BigInsights Enterprise Edition

Transaction 1

Assume customer ABC is starting off by setting up an IBM InfoSphere BigInsights Enterprise Edition cluster with 10 machines and plans to store 3 Terabytes of data per machine in the cluster. The total terabytes are entered into the volume tiering table to get Resource Value Units to order. In this case, there are 30 chargeable Terabytes.

Resource Value Units required

Total Resource Value Units to order to entitle ABC's environment for the 30 Terabytes are determined as follows.

Resource         Total            Resource         Resource
value            terabytes (A)    value            value units
unit                              units per        required (A)
metric                            terabytes(C)     x (B)
 
1 - 12           12               1.0000           12.0000
 Terabytes
13-32 Terabytes  18               0.8455           15.2190
33-64 Terabytes  -                0.6137           0.0000
65-100           -                0.4639           0.0000
 Terabytes
101-250          -                0.3870           0.0000
 Terabytes
251+ Terabytes   -                0.3097           0.0000
Total resources  30               -                -
Total RVUS       -                -                27.2190

Total Resource Value Units to order (rounded up): 28

Customer ABC would order 28 Resource Value Units to entitle their environment for the 30 Terabytes managed.

Transaction 2

In Phase 2, customer ABC looks to increase the Terabytes managed on the cluster that they had already installed IBM InfoSphere BigInsights Enterprise Edition on. They will add another 1 Terabyte of data on each of the 10 machines in the cluster. The new total of Terabytes managed in customer ABC's environment would be the previous 30 plus 10 incremental for a new total of 40 Terabytes.

The new total of Resource Value Units required to entitle their environment would be calculated as follows.

Resource         Total            Resource         Resource
value            terabytes (A)    value            value units
unit                              units per        required (A)
metric                            terabytes(C)     x (B)
 
1 - 12           12               1.0000           12.0000
 Terabytes
13-32 Terabytes  20               0.8455           16.9100
33-64 Terabytes  8                0.6137           4.9096
65-100           0                0.4639           0.0000
 Terabytes
101-250          0                0.3870           0.0000
 Terabytes
251+ Terabytes   0                0.3097           0.0000
New total        40               -                -
 resources
New total RVUS   -                -                33.8196

Total RVUs required to entitle new environment (rounded up): 34

Previous/existing RVU entitlements from first Transaction: (28)

Total Resource Value Units to order: 6

Customer ABC would need to order an additional 6 Resource Value Units to entitle their new total of 40 terabytes.

Note that the discount for the new storage is greater based on existing RVU entitlement.

Transaction 3

In Phase 3, customer ABC looks to increase the Terabytes managed by IBM InfoSphere BigInsights Enterprise Edition to 140 Terabytes. They will add another 50 machines in the cluster, and a 100 Terabytes of additional data. The new total Terabytes managed in the ABC's environment would be the previous 40 plus 100 Terabytes which equals 140 terabytes.

The new total of Resource Value Units required to entitle their environment would be calculated as follows.

Resource         Total            Resource         Resource
value            terabytes (A)    value            value units
unit                              units per        required (A)
metric                            terabytes(C)     x (B)
 
1 - 12           12               1.0000           12.0000
 Terabytes
13-32 Terabytes  20               0.8455           16.9100
33-64 Terabytes  32               0.6137           19.6384
65-100           36               0.4639           16.7004
 Terabytes
101-250          40               0.3870           15.4800
 Terabytes
251+ Terabytes   0                0.3097           0.0000
New total        140              -                -
 resources
New total RVUS   -                -                80.7288

Total RVUs required to entitle new environment (rounded up): 81

Existing RVU entitlements from previous transactions: (34)

Total Resource Value Units to order: 47

Customer ABC would need to order an additional 47 Resource Value Units to entitle their new total of 140 Terabytes managed.

Passport Advantage program licenses

InfoSphere BigInsights

Part description                                         Part
                                                         number
 
IBM InfoSphere BigInsights
InfoSphere BigInsights Per Resource Value Unit Annual    E0C4JLL
 SW S&S Rnwl
InfoSphere BigInsights Per Resource Value Unit Lic + SW  D0JIFLL
 S&S 12 Mo
InfoSphere BigInsights Per Resource Value Unit SW S&S    D0JIGLL
 Reinstate 12 Mo

Passport Advantage supply

Program name/description                                 Part
                                                         number
 
InfoSphere BigInsights V1.1.0
InfoSphere BigInsights SUSE Linux Enterprise Server      BB175EN
 (SLES),Red Hat Enterpr

Passport Advantage customer: Media pack entitlement details

Customers with active maintenance or subscription for the products listed are entitled to receive the corresponding media pack.

InfoSphere BigInsights V1.1.0

Entitled maintenance        Media packs description     Part
offerings description                                   number
 
IBM InfoSphere BigInsights  InfoSphere BigInsights      BB175EN
per Resource Value Unit     SUSE Linux Enterprise
                            Server (SLES),Red Hat
                            Enterpr



Back to topBack to top
 
Top rule
Terms and conditions
Bottom rule

The information provided in this announcement letter is for reference and convenience purposes only. The terms and conditions that govern any transaction with IBM are contained in the applicable contract documents such as the IBM International Program License Agreement, IBM International Passport Advantage Agreement, and the IBM Agreement for Acquisition of Software Maintenance.

Licensing

IBM International Program License Agreement including the License Information document and Proof of Entitlement (PoE) govern your use of the program. PoEs are required for all authorized use.

Part number products only, offered outside of Passport Advantage, where applicable, are license only and do not include Software Maintenance.

License Information form number
Program name                              Program    Form number
                                          number
 
InfoSphere BigInsights                    5725-C09   L-MLOY-8DNSTR

The program's License Information will be available for review on the IBM Software License Agreement website

http://www.ibm.com/software/sla/sladb.nsf
Limited warranty applies

Yes

Limited warranty

IBM warrants that when the program is used in the specified operating environment, it will conform to its specifications. The warranty applies only to the unmodified portion of the program. IBM does not warrant uninterrupted or error-free operation of the program or that IBM will correct all program defects. You are responsible for the results obtained from the use of the program.

IBM provides you with access to IBM databases containing information on known program defects, defect corrections, restrictions, and bypasses at no additional charge. For further information, consult the IBM Software Support Handbook found at

http://www.ibm.com/support/handbook

IBM will maintain this information for at least one year after the original licensee acquires the program (warranty period).

Program technical support

Technical support of a program product version or release will be available for a minimum of five years from the general availability date, as long as your Software Maintenance is in effect. This technical support allows you to obtain assistance (via telephone or electronic means) from IBM for product-specific, task-oriented questions regarding the installation and operation of the program product. Software Maintenance also provides you with access to updates (modifications or fixes), releases, and versions of the program. You will be notified, via announcement letter, of discontinuance of support with 12 months' notice. If you require additional technical support from IBM, including an extension of support beyond the discontinuance date, contact your IBM representative or IBM Business Partner. This extension may be available for a fee.

Money-back guarantee

For clarification, note that if for any reason you are dissatisfied with the program and you are the original licensee, you may obtain a refund of the amount you paid for it, if within 30 days of your invoice date you return the program and its PoE to the party from whom you obtained it. If you downloaded the program, you may contact the party from whom you acquired it for instructions on how to obtain the refund.

  • For clarification, note that for programs acquired under the IBM International Passport Advantage Agreement, this term applies only to your first acquisition of the program.
Volume orders (IVO)

No

Passport Advantage applies

Yes, and through the Passport Advantage website at

http://www.ibm.com/software/passportadvantage

This product is only available via Passport Advantage. It is not available as shrinkwrap.

Usage restriction

No

For additional information, refer to the License Information Document that is available on the IBM Software License Agreement website

http://www.ibm.com/software/sla/sladb.nsf
IBM Operational Support Services - SoftwareXcel

No

System i Software Maintenance applies

No

Educational allowance available

Not applicable.



Back to topBack to top
 
Top rule
Prices
Bottom rule

Passport Advantage

For Passport Advantage information and charges, contact your IBM representative or authorized IBM Business Partner, or authorized IBM Business Partner for Software ValueNet®, if applicable. Additional information is also available at

http://www.ibm.com/software/passportadvantage

Business Partner information

If you are an IBM Business Partner -- Distributor for Workstation Software acquiring products from IBM, you may link to Passport Advantage Online for resellers where you can obtain Business Partner pricing information. An IBM ID and password are required.

https://www.ibm.com/software/howtobuy/passportadvantage/paoreseller


Back to topBack to top
 
Top rule
Order now
Bottom rule

To order, contact the Americas Call Centers or your local IBM representative, or your IBM Business Partner.

To identify your local IBM representative or IBM Business Partner, call 800-IBM-4YOU (426-4968).

Phone:      800-IBM-CALL (426-2255)
Fax:        800-2IBM-FAX (242-6329)
Internet:   callserv@ca.ibm.com
Mail:       IBM Teleweb Customer Support
            ibm.com® Sales Execution Center, Americas North
            3500 Steeles Ave. East, Tower 3/4
            Markham, Ontario
            Canada
            L3R 2Z1

Reference: YE001

The Americas Call Centers, our national direct marketing organization, can add your name to the mailing list for catalogs of IBM products.


Note: Shipments will begin after the planned availability date.
Trademarks

Optim is a trademark of IBM Corporation in the United States, other countries, or both.

IBM, InfoSphere, DB2, Passport Advantage, ValueNet and ibm.com are registered trademarks of IBM Corporation in the United States, other countries, or both.

Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.

UNIX is a registered trademark of The Open Group in the United States and other countries.

Windows is a trademark of Microsoft Corporation in the United States, other countries, or both.

Other company, product, and service names may be trademarks or service marks of others.

Terms of use

IBM products and services which are announced and available in your country can be ordered under the applicable standard agreements, terms, conditions, and prices in effect at the time. IBM reserves the right to modify or withdraw this announcement at any time without notice. This announcement is provided for your information only. Additional terms of use are located at

http://www.ibm.com/legal/us/en/

For the most current information regarding IBM products, consult your IBM representative or reseller, or visit the IBM worldwide contacts page

http://www.ibm.com/planetwide/us/

Terms of use