Discovering Evidence of dirty data through data visualization
Dr. Awny Alnusair University of the Cumberlands
1
2
2
Putting the Data Analytics Lifecycle into Practice
The Data Analytics Lifecycle consists of the following six phases:
Discovery
Data Preparation
Model Planning
Model building
Communicate Results
Operationalize
To begin analyzing the data, you will need a tool that allows you to look closely at the data – That is “R”
3
3
KDnuggest Poll - 2019
KDnuggets Poll is a survey of data science and machine learning software. It asks programmers what languages they use on a regular basis in their work
4
4
The R Project for Statistical Computing
First of all you need to get R installed on your computer
5
5
Up and Running with R
Once R is installed, you can test the installation by opening the R Console
6
6
RStudio – an IDE for R
7
7
Entering Data into R
8
8
R Packages
https:// cloud.r-project.org/web/packages/index.html
9
9
Things you’r expected to know about R ….
R Data Types and structures
Basic descriptive statistics, dirty data ..
Data Visualization and relationships between multiple variables
Generic Functions
Dealing with sample datasets that are available for you
Statistical Methods for Model Building and Evaluation
Hypothesis Testing - Welche’s t-test, Confidence intervals, Wilcoxon rank-sum test, type I and II errors, and ANOVA
10
10