Report
Data Collection
Week 6
Jocelyn Turgeon
ADM3316 Fall 2021
Welcome back!
Still not too late for CI certificate
Team project – past projects
Individual project - notes
Questions
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
So far we have seen
KITs, KIQs, Indicators
Options
Support to strategic decision-making
Plan your search
The environment
The people with guest speaker
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Military examples of data collection
The German Tank Problem
What does that teach us?
Can this concept of data collection be done today?
My own interest
Data gathering
Information derived
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Examples from Industry
L’Oréal
Types of data
Information gathered
Toyota
Types of data
Information gathered
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Remember that our data collection should feed the pillars of a CI process
Strategic
Unbiased
Measurable
Actionable
Repeatable
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
An effective online data collection
Know your tools
Prepare your search (keywords…)
Small deliberate steps with measurable outcomes
Try both simple and advanced search options
Be specific where possible
Limit the search area if adequate
Use more than one approach or tool
Do not go down rabbit holes… refine and re-start
Use the find tool in your review of findings
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Infobesity and Big Data
Big Data – the Vs
*Volume
*Variety
*Velocity
Veracity
Value
Variability
Infobesity
Difficult if not impossible to analyse
Trends vs analysis
New approaches
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Google and all its pros and cons...
We have seen several search operators
Search for "Google search operators".
There are also
Google " trends "
Google " video "
Google " finance "
Google " patents "
…
Google is powerful, but it is also subject to biases, preferences... Nothing is free after all.
Try it! The Pandemy is…
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Let’s look into this
Use of the comparison for
Suggestion
Comparison of results
Google VS
Try it. Tim Hortons vs Starbucks
What sort of information do you get?
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Other search engines
Bing - https://www.bing.com/
Yahoo - https://ca.yahoo.com/
Baïdu - https://www.baidu.com/
Ask - https://www.ask.com/
Quora.com – site Q&R – login
Inside.com – newsfeed – login
Zanran.com – data and stats
Yippy.com (deep web) – recherche privée…
And many more…
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
14
Deep Web
DuckDuckgo – Google Chrome app
Mojeek - https://www.mojeek.com/
Gibiru - https://gibiru.com/
Startpage - https://www.startpage.com/
TORCH – web browser app
TOR - https://www.torproject.org/ - web browser app
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Looking for a company?
You really need to consult
International database
Details on the companies and senior executives
Some filters are available
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Looking for persons?
PIPL - https://pipl.com/home-california - login required
Glassdoor - https://www.glassdoor.ca – login required
Salaries
Comparisons
MarketVisual - http://www.marketvisual.com/
Whitepages
Spokeo – origin of webmail
Instantcheckmate
Intelius
Peoplesmart
411
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Information?
Wolf Ram - https://www.wolframalpha.com/
AI assisted research
Shodan - https://www.shodan.io/ - login
BASE – https://www.base-search.net/ - academic resources
Web of Science – library uOttawa
Other collections – library uOttawa
Of course Google « scholar »
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Known format?
PDFSearchEngine- http://www.pdfsearchengine.net/ - PDFs
PPTSearchEngine - http://www.pptsearchengine.net/ - Powerpoint
Tineye - https://tineye.com/ - product image
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
In some cases, a way to ensure validity
Fakespot - https://www.fakespot.com/
- It is limited but indicative
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
What is being said about something?
Blog Search Engine - http://www.blogsearchengine.org/
Google « social media » - of course…
And around the World…
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Looking for similar websites?
Similarsites - https://www.similarsites.com/
Yes, it is that simple!
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Local and Regional
Search Engine of the World - in Wikipedia
A few examples
Biglobe - Japan
Daum - Korea
Rambler - Russia
…
Do consult this Wiki. It contains local search engines and the best search engines by theme, it's an outstanding cue card to have.
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Infobesity is obvious - the information is there, you just have to extract it.
Rome wasn't built in a day - neither will the research technique be.
It's easy to get lost if you don't have a specific goal.
Be methodical
Identify the information you are looking for
Question the web
Use multiple sources in parallel
What we have seen is indicative of the constantly evolving possibilities
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Data Collection Dashboard on COVID 19
The John Hopkins University CSSE (Center for Systems Sciences and Engineering) is monitoring the progress of the virus and it looks like this:
https:// coronavirus.jhu.edu/map.html
Data sources: WHO, CDC, ECDC, NHC and DXY. Read more on the blog. Or contact them at Contact US.
Similar Dashboards were used recently during the Federal Elections.
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
WHO – World Health Organisation
CDC - Center for Disease Control
ECDC – European CDC
NHC – (China’s) National Heath Commission
DXY – Chinese website aggregator
25
Purpose of CI
The information must contribute to respond to our KITs
Strategic
By answering one or more of our KIQs
Unbiased (guide)
Measurable (numbers -> trends)
To achieve a competitive advantage in the market place
Actionable
Repeatable
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
In an information age, data security is essential but increasingly difficult to achieve, companies must take specific measures. For example;
The Government of Canada recognizes the value of information as an asset.
A data governance structure has been put in place in all departments (Sept 2019)
Enhanced standards and guidelines for all aspects of data collection, use, and sharing.
Improve services and increase the value of data
See Data Strategy Roadmap in Brightspace.
In other cases, this data protection is a prerequisite for operations - Defence or R&D related industries.
Data Collection
Examples
History
Business
Data Collection
Online
Summary
Considerations
Pertinence
Time Alloted
Protection
Information Security
Questions?
Text or email me
jturgeo2@uottawa.ca
Look for Q&A in Brightspace
Jocelyn Turgeon
ADM3316 Fall 2021