Report

profilen123
6.DataCollection-Fall2021.pptx

Data Collection

Week 6

Jocelyn Turgeon

ADM3316 Fall 2021

Welcome back!

Still not too late for CI certificate

Team project – past projects

Individual project - notes

Questions

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

So far we have seen

KITs, KIQs, Indicators

Options

Support to strategic decision-making

Plan your search

The environment

The people with guest speaker

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Military examples of data collection

The German Tank Problem

What does that teach us?

Can this concept of data collection be done today?

My own interest

Data gathering

Information derived

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Examples from Industry

L’Oréal

Types of data

Information gathered

Toyota

Types of data

Information gathered

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Remember that our data collection should feed the pillars of a CI process

Strategic

Unbiased

Measurable

Actionable

Repeatable

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

An effective online data collection

Know your tools

Prepare your search (keywords…)

Small deliberate steps with measurable outcomes

Try both simple and advanced search options

Be specific where possible

Limit the search area if adequate

Use more than one approach or tool

Do not go down rabbit holes… refine and re-start

Use the find tool in your review of findings

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Infobesity and Big Data

Big Data – the Vs

*Volume

*Variety

*Velocity

Veracity

Value

Variability

Infobesity

Difficult if not impossible to analyse

Trends vs analysis

New approaches

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Google and all its pros and cons...

We have seen several search operators

Search for "Google search operators".

There are also

Google " trends "

Google " video "

Google " finance "

Google " patents "

Google is powerful, but it is also subject to biases, preferences... Nothing is free after all.

Try it! The Pandemy is…

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Let’s look into this

Use of the comparison for

Suggestion

Comparison of results

Google VS

Try it. Tim Hortons vs Starbucks

What sort of information do you get?

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Other search engines

Bing - https://www.bing.com/

Yahoo - https://ca.yahoo.com/

Baïdu - https://www.baidu.com/

Ask - https://www.ask.com/

Quora.com – site Q&R – login

Inside.com – newsfeed – login

Zanran.com – data and stats

Yippy.com (deep web) – recherche privée…

And many more…

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

14

Deep Web

DuckDuckgo – Google Chrome app

Mojeek - https://www.mojeek.com/

Gibiru - https://gibiru.com/

Startpage - https://www.startpage.com/

TORCH – web browser app

TOR - https://www.torproject.org/ - web browser app

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Looking for a company?

You really need to consult

https://opencorporates.com /

International database

Details on the companies and senior executives

Some filters are available

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Looking for persons?

PIPL - https://pipl.com/home-california - login required

Glassdoor - https://www.glassdoor.ca – login required

Salaries

Comparisons

MarketVisual - http://www.marketvisual.com/

Whitepages

Spokeo – origin of webmail

Instantcheckmate

Intelius

Peoplesmart

411

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Information?

Wolf Ram - https://www.wolframalpha.com/

AI assisted research

Shodan - https://www.shodan.io/ - login

BASE – https://www.base-search.net/ - academic resources

Web of Science – library uOttawa

Other collections – library uOttawa

Of course Google « scholar »

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Known format?

PDFSearchEngine- http://www.pdfsearchengine.net/ - PDFs

Google

PPTSearchEngine - http://www.pptsearchengine.net/ - Powerpoint

Google

Tineye - https://tineye.com/ - product image

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

In some cases, a way to ensure validity

Fakespot - https://www.fakespot.com/

- It is limited but indicative

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

What is being said about something?

Blog Search Engine - http://www.blogsearchengine.org/

Google « social media » - of course…

And around the World…

https://onemilliontweetmap.com/?center=25.505,-0.09&zoom=2&search=&timeStep=0&timeSelector=0&hashtag1=&hashtag2=sad&sidebar=yes&hashtagBattle=0&timeRange=0&timeRange=25&heatmap=0&sun=0&cluster=1

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Looking for similar websites?

Similarsites - https://www.similarsites.com/

Yes, it is that simple!

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Local and Regional

Search Engine of the World - in Wikipedia

A few examples

Biglobe - Japan

Daum - Korea

Rambler - Russia

Do consult this Wiki. It contains local search engines and the best search engines by theme, it's an outstanding cue card to have.

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Infobesity is obvious - the information is there, you just have to extract it.

Rome wasn't built in a day - neither will the research technique be.

It's easy to get lost if you don't have a specific goal.

Be methodical

Identify the information you are looking for

Question the web

Use multiple sources in parallel

What we have seen is indicative of the constantly evolving possibilities

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Data Collection Dashboard on COVID 19

The John Hopkins University CSSE (Center for Systems Sciences and Engineering) is monitoring the progress of the virus and it looks like this:

https:// coronavirus.jhu.edu/map.html

Data sources: WHO, CDC, ECDC, NHC and DXY. Read more on the blog. Or contact them at Contact US.

Similar Dashboards were used recently during the Federal Elections.

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

WHO – World Health Organisation

CDC - Center for Disease Control

ECDC – European CDC

NHC – (China’s) National Heath Commission

DXY – Chinese website aggregator

25

Purpose of CI

The information must contribute to respond to our KITs

Strategic

By answering one or more of our KIQs

Unbiased (guide)

Measurable (numbers -> trends)

To achieve a competitive advantage in the market place

Actionable

Repeatable

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

In an information age, data security is essential but increasingly difficult to achieve, companies must take specific measures. For example;

The Government of Canada recognizes the value of information as an asset.

A data governance structure has been put in place in all departments (Sept 2019)

Enhanced standards and guidelines for all aspects of data collection, use, and sharing.

Improve services and increase the value of data

See Data Strategy Roadmap in Brightspace.

In other cases, this data protection is a prerequisite for operations - Defence or R&D related industries.

Data Collection

Examples

History

Business

Data Collection

Online

Summary

Considerations

Pertinence

Time Alloted

Protection

Information Security

Questions?

Text or email me

[email protected]

Look for Q&A in Brightspace

Jocelyn Turgeon

ADM3316 Fall 2021