Gather and synthesize information from a great number of sources
1 © Copyright 2012 EMC Corporation. All rights reserved.
2 © Copyright 2012 EMC Corporation. All rights reserved.
BIG DATA TRANSFORMS BUSINESS
3 © Copyright 2012 EMC Corporation. All rights reserved.
Sources: “How Much Information?” Peter Lyman and Hal Varian, UC Berkeley,. 2011 IDC Digital Universe Study.
IN 2000 THE WORLD GENERATED
TWO EXABYTES OF NEW INFORMATION
4 © Copyright 2012 EMC Corporation. All rights reserved.
Sources: “How Much Information?” Peter Lyman and Hal Varian, UC Berkeley,. 2011 IDC Digital Universe Study.
IN 2000 THE WORLD GENERATED
TWO EXABYTES OF NEW INFORMATION
EVERY DAY
5 © Copyright 2012 EMC Corporation. All rights reserved.
What’s Driving The Data Deluge?
Oil Exploration Medical Imaging
Video Surveillance Mobile Sensors Video Rendering
Gene Sequencing Smart Grids
Social Media
FACEBOOK UPLOADS
250 MILLION PHOTOS EACH DAY
COST TO SEQUENCE
ONE GENOME
HAS FALLEN FROM
$100M IN 2001 TO $10K IN 2011
READING SMART METERS
EVERY 15 MINUTES IS
3000X MORE DATA INTENSIVE
OIL RIGS GENERATE
25000 DATA POINTS PER SECOND
6 © Copyright 2012 EMC Corporation. All rights reserved.
The Value Of Data Is Growing New Business Models Are Based On Data!
290,000,000 Updates / Day
250,000,000 New Photos / Day
1,000,000,000 Queries / Day
4,000,000 Claims / Day
2,800,000,000 Trades / Day
31,000,000,000 Interactions / Day
7 © Copyright 2012 EMC Corporation. All rights reserved.
How Companies Are Using Big Data
12
13
21
28
30
33
37
39
49
19
18
29
40
39
40
41
36
60%
Improvements to R&D processes
Automation of common or straightforward decisions
Pricing
New product strategies
Performance management & transparency in internal operations
Customer service/support
Operations, service delivery, or supply chain management
Budgeting, forecasting, or planning
Customer insights, segmentation, or targeting
Ideally
Currently
Functional Areas Where Companies Do, And Should, Focus On Using Big data And Analytics To Improve Overall Performance
McKinsey Global Survey of 1,469 C-level executive respondents at a range of industries and company sizes, “Minding Your Digital Business,” 2012.
8 © Copyright 2012 EMC Corporation. All rights reserved.
Big Data Transforms Retail Banking
“We leveraged the profitability system to analyze historical data and create a new set of assumptions for our loan officer.”
• Reduce Customer Attrition
– Proactive Customer Contact
• Increase Revenue Per Customer
– Recommend Products Based On Purchasing Trends
• Improved Operational Efficiency
– Staff Branches Based On “Who” Banks “Where”
9 © Copyright 2012 EMC Corporation. All rights reserved.
1
The Journey To Big Data
CLOUD
10 © Copyright 2012 EMC Corporation. All rights reserved.
EMC Isilon.
Record Scalability.
Remarkable Simplicity.
11 © Copyright 2012 EMC Corporation. All rights reserved.
Isilon: Scale-Out Storage For Big Data
Industry-Leading Throughput And IOPS
Unmatched Performance
Manage PBs Just Like You Would TBs
Management Simplicity
Massive Scalability
15 PB In A Single File System
12 © Copyright 2012 EMC Corporation. All rights reserved.
Big Data Transforms Life Sciences
Fast Access To All Data – Scale To 12PB With
Linear Performance
• Collaborate On Groundbreaking Research
– Discover New Treatments – Reduce The Spread Of
Disease
“We’ve been able to grow a single file system to
a PB in less than a year & maintain the throughput necessary to advance our research.”
13 © Copyright 2012 EMC Corporation. All rights reserved.
Atmos Big Data.
Globally Distributed.
14 © Copyright 2012 EMC Corporation. All rights reserved.
A New Approach For Distributed Big Data
• Disparate Systems
• Manual Administration
• One Tenant, Many Systems
• IT Provisioned Storage
• Single System Across Locations
• Automated Policies
• Many Tenants One System
• Self-Service Access
L.A. BOSTON LONDON L.A. BOSTON LONDON
Storage Islands Single Storage Pool
15 © Copyright 2012 EMC Corporation. All rights reserved.
Big Data Transforms Online Auctions
Reach A Global Audience
– Scale To Multiple Geographic Sites
Improve Customer Experience
Reduced TCO
– Policies Enabled Automation Of Content Expiration
– Reduced Manual Management Of Content Churn
“eBay and EMC have worked closely for more than a year to create a reliable,
scalable cloud storage infrastructure that meets the demands of eBay's expanding
business.”
16 © Copyright 2012 EMC Corporation. All rights reserved.
Cloud Infrastructure For Big Data
17 © Copyright 2012 EMC Corporation. All rights reserved.
Big Data Transforms Utilities
Predict Usage And Outages – Faster Detection Of Outages
– Reduce Power Theft
Help Customers Cut Costs – Provide Real-Time View Of
Energy Consumption
Incent Customer Behavior – Pricing Based On Demand At
Peak And Off-Peak Times “Greenplum’s data warehousing and analytics platform helps us efficiently turn metering data into actionable information.”
18 © Copyright 2012 EMC Corporation. All rights reserved.
Pluggable Storage Layer (HDFS API)
MapReduce Layer
Hadoop Tools
Greenplum Chorus
EMC Enterprise Hadoop Solution
Isilon
Greenplum
HDFS Protocol
lsilon OneFS
G re
e n p lu
m
C o m
m a n d C
e n te
r
19 © Copyright 2012 EMC Corporation. All rights reserved.
1
The Journey To Big Data
CLOUD SOCIAL
2
20 © Copyright 2012 EMC Corporation. All rights reserved.
THE NEW TEAM DRIVING BIG DATA
DATA SCIENCE
21 © Copyright 2012 EMC Corporation. All rights reserved.
Legacy Analytics Process
1. Find The Data
2. Get Access To Data
4. Move To Sandbox
5. Analysis Finally!
6. Operationalize The Model
3. Learn About The Data
22 © Copyright 2012 EMC Corporation. All rights reserved.
Chorus: The Social Platform For Big Data
Project Workspaces
Data Analysis
Publish And
Iterate
Explore The Data
Collaboration
23 © Copyright 2012 EMC Corporation. All rights reserved.
Self-Service And Collaborative Analytics
24 © Copyright 2012 EMC Corporation. All rights reserved.
Accelerate The Journey With UAP
1
CLOUD SOCIAL
2
25 © Copyright 2012 EMC Corporation. All rights reserved.
1
The Journey To Big Data
CLOUD AGILE
2 3
SOCIAL
26 © Copyright 2012 EMC Corporation. All rights reserved.
Documentum xCP
Insight To Action.
Better. Faster. Compliant.
27 © Copyright 2012 EMC Corporation. All rights reserved.
xCP: Big Data Enabled Case Management
Better, Faster Decisions
Deliver The Latest Data
Enable Contextual Decisions
Complete Audit Trail
Keep IT Audit Happy!
Reduce Information Risk
Easy To Build
A Tool For Non-Programmers!
Drag & Drop Process Modeling
28 © Copyright 2012 EMC Corporation. All rights reserved.
Traditional Application Options
Innovation Growth & Revenue
Hard, Expensive, Slow
Custom Apps
Automation Efficiency & Cost
Requires Defined Model
Packaged Apps
29 © Copyright 2012 EMC Corporation. All rights reserved.
AGILE DEVELOPMENT CUSTOM APPS WITHOUT THE DOWNSIDE
30 © Copyright 2012 EMC Corporation. All rights reserved.
THE LEADERS IN AGILE JOIN THE GREENPLUM FAMILY
31 © Copyright 2012 EMC Corporation. All rights reserved.
AGILE DEVELOPMENT TOOLS IN USE BY 240,000 DEVELOPERS
32 © Copyright 2012 EMC Corporation. All rights reserved.
HOW TO GET STARTED
33 © Copyright 2012 EMC Corporation. All rights reserved.
How To Leverage Big Data Analytics For Competitive Advantage
EMC Analytics Vision Workshop
Envisioning Exercises With Line Of Business And IT Stakeholders
Focus On An Organization’s Key Business Initiative
Brainstorming To Identify And Group Key Big Data Analytics Opportunities
34 © Copyright 2012 EMC Corporation. All rights reserved.
Greenplum Analytics Labs
Packaged Solutions That Produce Business Value And Actionable Results
Accelerate Analytics Capabilities On Your Data With Your Analysts
Leverage The Expertise Of Greenplum’s Data Scientists
Establish A Strategic Vision For Analytics Development
35 © Copyright 2012 EMC Corporation. All rights reserved.
Data Science And Big Data Analytics Course And EMCDSA Certification
Course Overview
• “Open” Curriculum
• Enables Immediate Participation
On Analytics Projects
• Prepares For EMC Proven
Professional Data Science
Associate Certification (EMCDSA)
Details
36 © Copyright 2012 EMC Corporation. All rights reserved.
The Journey To Big Data
1
CLOUD AGILE
2 3
SOCIAL