Discovering Evidence of dirty data through data visualization

profilesahana
ITS836_Week4_Slides.pptx

Dr. Awny Alnusair University of the Cumberlands

1

2

2

Putting the Data Analytics Lifecycle into Practice

The Data Analytics Lifecycle consists of the following six phases:

Discovery

Data Preparation

Model Planning

Model building

Communicate Results

Operationalize

To begin analyzing the data, you will need a tool that allows you to look closely at the data – That is “R”

3

3

KDnuggest Poll - 2019

KDnuggets Poll is a survey of data science and machine learning software. It asks programmers what languages they use on a regular basis in their work

4

4

The R Project for Statistical Computing

First of all you need to get R installed on your computer

https://www.r-project.org/

5

5

Up and Running with R

Once R is installed, you can test the installation by opening the R Console

6

6

RStudio – an IDE for R

https://www.rstudio.com /

https ://rstudio.cloud /

7

7

Entering Data into R

8

8

R Packages

https:// cloud.r-project.org/web/packages/index.html

9

9

Things you’r expected to know about R ….

R Data Types and structures

Basic descriptive statistics, dirty data ..

Data Visualization and relationships between multiple variables

Generic Functions

Dealing with sample datasets that are available for you

Statistical Methods for Model Building and Evaluation

Hypothesis Testing - Welche’s t-test, Confidence intervals, Wilcoxon rank-sum test, type I and II errors, and ANOVA

10

10