Netflix - Information Technology
1
Business Intelligence Systems
Chapter 9
9-2
Study Questions
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
Q1: How do organizations use business intelligence (BI) systems?
Q2: What are the three primary activities in the BI process?
Q3: How do organizations use data warehouses and data marts to acquire data?
Q4: What are three techniques for processing BI Data?
Q5: What are the alternatives for publishing BI?
How does the knowledge in this chapter help you?
2
9-3
Q1: How Do Organizations Use Business Intelligence (BI) Systems?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
Structure of Business Intelligence System
9-4
Sample of Uses of Business Intelligence
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
3
9-5
What Are Typical Uses for BI?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Identifying changes in purchasing patterns – Important life events change what customers buy
• BI for Entertainment – Netflix has data on watching, listening, and rental habits – Classify customers by viewing patterns
• Just-in-Time Medical Reporting – Real-time injection notification services to doctors during
exams
9-6
Q2: What Are the Three Primary Activities in the BI Process?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
4
9-7
Using Business Intelligence to Find Candidate Parts at Falcon Security
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Candidate parts – Provided by vendors who agree to make part design files
available for sale – Purchased by larger customers – Frequently ordered parts – Ordered in small quantities – Simple in design (easier to 3D print)
• Part weight and price surrogates for simplicity
9-8
Acquire Data: Extracted Order Data
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Query Sales (CustomerName, Contact, Title, Bill Year, Number Orders, Units, Revenue, Source, PartNumber) Part (PartNumber, Shipping Weight, Vendor)
5
9-9
Sample Extracted Data: Part Table
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-10
Joining Order Extract and Filtered Parts Tables
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
6
9-11
Sample Orders and Parts View Data
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-12
Creating Customer Summary Query
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
7
9-13
Customer Summary
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-14
Qualifying Parts Query Design
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
8
9-15
Publish Results: Qualifying Parts Query Results
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-16
Publish Results: Sales History for Selected Parts
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9
9-17
Q3: How Do Organizations Use Data Warehouses and Data Marts to Acquire Data?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Data Warehouse Functions – Obtain data from operational, internal and external databases – Cleanse data – Organize and relate data – Catalog data using metadata
9-18
Components of a Data Warehouse
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
10
9-19
Examples of Consumer Data That Can Be Purchased
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-20
Possible Problems with Source Data
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
Curse of dimensionality
11
9-21
Data Warehouses Versus Data Marts
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-22
Q4: What are Three Techniques for Processing BI Data?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
12
9-23
Reporting Analysis
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Process of sorting, grouping, summing, filtering, and formatting structured data
• Structured data – Data in rows and columns like tables
• Exception reports – Produced when something out of predefined bounds occurs
• Printed and dynamic reports
9-24
Data Mining
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Application of statistical techniques to find patterns and relationships among data for classification and prediction
• Combined discipline of statistics, mathematics, artificial intelligence, and machine-learning
13
9-25
Two Broad Categories of Data Mining
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
1. Unsupervised procedures – Does not start with a priori hypothesis or model – Hypothesized model created afterward based on analytical
results to explain patterns found Example: Cluster analysis
9-26
Supervised Data Mining
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Uses a priori model to compute outcome of model
• Prediction, such as multiple linear regression • Ex: CellPhoneWeekendMinutes
= (12 + (17.5*CustomerAge)+(23.7*NumberMonthsOfAccount) = 12 + 17.5*21 + 23.7*6 = 521.7
14
9-27
BigData
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Huge volume – Petabyte and larger
• Rapid velocity – Generated rapidly
• Great variety – Structured data, free-form text, log files, graphics, audio, and
video
9-28
MapReduce Processing Summary
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
Google search log broken into pieces
15
9-29
Google Trends on the Term Web 2.0
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-30
Hadoop
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Open-source program supported by Apache Foundation • Manages thousands of computers • Implements MapReduce
– Written in Java • Amazon.com supports Hadoop as part of EC3 cloud offering • Pig query language platform for large dataset analysis
– Easy to master – Extensible – Automatically optimizes queries on map-reduce level
16
9-31
Q5: What Are the Alternatives for Publishing BI?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
9-32
What Are the Two Functions of a BI Server?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
17
9-33
How Does the Knowledge in This Chapter Help You?
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Business intelligence a critical skill
• Enables imagining innovative uses for data your employer generates and know some of constraints of such use
• Digital marketing #1 priority for technology investment
• At PRIDE, knowledge of this chapter helps understand possible uses for exercise data
9-34
Ethics Guide: Unseen Cyberazzi
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Data broker or Data aggregator – Acquires and purchases consumer and other data from
public records, retailers, Internet cookie vendors, social media trackers, and other sources
– Used to create business intelligence to sell to companies and governments
18
9-35
Ethics Guide: Unseen Cyberazzi (cont'd)
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Cheap cloud processing makes processing consumer data easier, less expensive
• Processing happens in secret
• Data brokers enable you to view data stored about you, but: – Difficult to learn how to request your data – Torturous process to file for it – Limited data usefulness
9-36
Ethics Guide: Unseen Cyberazzi (cont'd)
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
• Do you know what data is gathered about you? What is done with it?
• Have you thought about conclusions data aggregators, or their clients, could make based on your use of frequent buyer cards?
• Concerned about what federal government might do with data it gets from data aggregators?
• Where does all of this end?
• What will life be like for your children or grandchildren?
19
9-37
Guide: Semantic Security
C o p y r i g h t © 2 0 1 7 P e a r s o n E d u c a t i o n , I n c .
1. Unauthorized access to protected data and information • Physical security Passwords and permissions Delivery system must be secure
2. Unintended release of protected information through reports and documents
3. What, if anything, can be done to prevent what Megan did?