HIM discussion (health information management)

profilelynda3495
AB120717_Ch12.pptx

Calculating and Reporting Healthcare Statistics, Fifth Edition, Revised Reprint

Chapter 12: Basic Research Principles

© 2017 American Health Information Management Association

© 2017 American Health Information Management Association

Research

Research

The search toward the solution of problem

Calls attention to theories that may be helpful in predicting future experiences

Performed in many arenas and may be done in a variety of ways

Health research covers the wide gamut of laboratory research, clinical trials and public health issues

© 2017 American Health Information Management Association

Research (continued)

Two types of research

Basic research

The investigator is not concerned with the immediate applicability of his or her results but rather tries to look for understanding of natural processes

Applied research

The investigator has some kind of application in mind and wishes to solve a problem or in some way contribute to society

© 2017 American Health Information Management Association

Research Methodology

The study of different types of research methods

Two overarching approaches to research: quantitative approach and qualitative approach

© 2017 American Health Information Management Association

Research Methodology (continued)

Qualitative Research

Describes events, persons, and so forth without the use of numerical data

Consists of interviews, observations, and written documents

These may be used individually or in combination

© 2017 American Health Information Management Association

Research Methodology (continued)

Quantitative Research

Uses numbers to describe the study including some comparisons of the population and statistical analysis to describe the results

Consists of observations, experiments, and surveys

© 2017 American Health Information Management Association

Research Process

Six major steps

Defining the problem

Reviewing the literature

Designing the research

Collecting the data

Analyzing the data

Drawing conclusions

© 2017 American Health Information Management Association

Problem Definition

Forming a question regarding a topic you would like to study

The most important thing is to be clear about is what you want to study

Often an analysis of historical data, or secondary information, has gone into the problem definition

Looking at the past to see what has been done before

Prevents “reinventing the wheel”

In previous research, the investigator may have made recommendations for future studies

© 2017 American Health Information Management Association

Problem Definition (continued)

Problems may also be broken down into sub-problems or smaller problems

May also define the scope of the study— who or what will be included in the study

© 2017 American Health Information Management Association

Literature Review

An investigation of all the information about a topic

Three reasons for literature review

Has research already been done to answer your question?

Are there any data sources you can use in your study?

May help you make your hypothesis more specific

Sources of previous work

Journals, books, position papers, conference presentations, videos, interviews, and online subscription services

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques

Several types of research design

Exploratory

Historical

Conclusive

Includes descriptive and causal

Correlational

Evaluation

Experimental and quasi-experimental

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Exploratory research

Undertaken because a problem is not very clearly defined

Allows the researcher to study the problem and gather information about the problem

May generate a hypothesis

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Generally informal and relies on literature review and informal discussions with others in order to find out more about a problem

This type of research may not help you answer your problem but rather may provide you with some insights to the problem

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Historical research

Involves investigation and analysis of events of the past

This type of research does not focus solely on the past, but it also allows the researcher to apply a previous researcher’s experiences and conclusions from their study into current professional practice

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Conclusive research

Performed in order to come to some sort of conclusion or help in decision making

May be done using primary research

Data collected specifically for your study; or

Secondary research

Includes a literature review to see if previous studies can be used to answer your question

May also include summaries of past works

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Conclusive research

There are two types of conclusive research:

Descriptive research

Causal research

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques

Conclusive research

Descriptive research (also called statistical research)

Provides data about the population you are studying, including the frequency that something occurs

The two most common collection techniques of descriptive research are observations and surveys

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Conclusive research

Causal research: Tries to answer questions about what causes certain things to occur

This type of research is difficult because there may always be an additional cause to consider

Uses experimentation and simulation as its data collection methods

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Correlational research

Studies that try to discover a relationship between variables

Variable: Anything under study

The strength of the relationship is measured

There may be a positive relationship or a negative relationship between variables

This type of research only determines if there is a relationship between two or more variables

It does not determine the cause of those relationships

Uses questionnaires, observations and secondary data as its data collection methods

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Evaluation research

A process used to determine what has happened during a given activity

The purpose of evaluation is to lead to better understanding of whether a program is effective, whether a policy is working, or if something that was agreed upon is the most cost-effective way of doing something

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Experimental and quasi-experimental research

Entails manipulation of a situation in some way in order to test a hypothesis

Certain variables are kept constant and an independent or experimental variable is manipulated

Researchers select both independent and dependent variables

Independent variables are the factors that researchers manipulate directly

Dependent variables are the measured variables

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Statement of the hypothesis

In formal research, a hypothesis is formed

A statement of the predicted relationship of what the researcher is studying

A proposed solution or explanation at which the researcher has arrived through review of the literature

It is the tentative answer to a question

The statement of the hypothesis is important because it allows the researcher to think about the variables to include in the study and type of research design to use in the study

Quasi-experimental research does not use randomization of participants

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

The research tests the hypothesis proving it to be positive or negative (correct or incorrect)

If the hypothesis is rejected—that is, incorrect—it does not necessarily mean that the research is poor, but only that the results are different from what was expected

The formulation of the hypothesis in advance of the data-gathering process is necessary for an unbiased investigation

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

There are two forms of the hypothesis

The null hypothesis

This hypothesis states that there is no difference between the population means or proportions that are being compared; or that there is no association between the two variables that are being compared

For example, in a clinical trial of a new medication, the null hypothesis is the new medication is no better than the current medication

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

The alternative hypothesis

This hypothesis is a statement of what the study is set up to establish

For example, in our clinical trial of a new medication, the alternative hypothesis is the new medication is better than the current medication

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Data collection techniques

Includes primary research

Data obtained from observations, surveys and interviews

Includes secondary research

Literature review or summaries of original studies

Irrespective of the data collection method the research must be valid and reliable

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Validity

The degree to which scientific observations actually measure or record what they purport to measure

For example, if you are using a written questionnaire to collect data, pretest it

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Reliability

The repeatability, including interperson replicability, of scientific observations

With reliability, the major question is: Can another researcher reproduce the study using a similar instrument and get similar results?

A study may be reliable but not valid

That is, the study may be able to be replicated, but still does not answer the research question

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Depends on the type of research the investigator wishes to conduct

For example, if the researchers want to establish a causal relationship, they should conduct one of the experimental studies

If they are breaking new ground in a poorly understood area of practice, they may want to consider an exploratory study in a qualitative design

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Surveys

Gathers data from a relatively large number of cases at a particular time

Can include interviews and questionnaire surveys

The questions should be well thought out to be sure to answer the question of the research study

The questions can be restricted/closed ended

The investigator only wants certain answers

Provide for unanticipated response by providing an “other” category that permits respondents to indicate other thoughts

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Surveys

Questionnaire surveys

The questions can be unrestricted (open ended)

This allows the participant to express a response in his or her own words

These questionnaires can be difficult to tabulate; however, they are easier to write

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Observation

Instead of asking a participant questions, the investigator observes the participant

Non-participant observation, the examiner is a neutral observer who does not interact with the participants

Participant observation, the researcher may also participate in the actions being observed; however, they try to maintain their objectivity

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Observation

Ethnography or naturalistic inquiry

The researcher observes, listens to, and sometimes converses with the subjects in as free and natural an atmosphere as possible

The assumption is that the most important behavior of individuals in groups is a dynamic process of complex interactions and consists of more than a set of facts, statistics, or even discrete incidents

A position of neutrality is important in this type of research

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Experimental study

This provides a logical, systematic way to answer the question, “If this is done under carefully controlled conditions, what will happen?”

Experimentation is a sophisticated technique for collection of data

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Selecting an instrument

The instrument, also called a tool, is a consistent way to collect data

There are many different types of instruments to use

Should fit the purpose of the research

Researchers should not develop an instrument until they have established that one does not already exist

If you decide to develop your own instrument take your time in developing the questions

It would be too costly and time consuming to have to repeat a survey because you neglected a question or two

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Samples

The selection of subjects for the study

For example, if your study concerns health information departments in the United States, you could study every health information department in the United States (including all of the population is referred to as a census)

That would not be very practical and could be very costly and time consuming

The next best thing is a sample

When chosen correctly samples are considered to be representative of the population

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Types of samples

Two types of sampling techniques

Probability sampling

Nonprobability sampling

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Probability samples

Simple random sample

Consists of individuals from the population chosen in such a way that every individual has an equal chance of being selected

The simplest way to select a sample is to place names in a hat (the population) and draw out a handful (the sample)

Statistics books also include a table of random numbers that can be used for the selection of random samples

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Systematic random sampling

A systematic pattern is used with random sampling

For example, let’s say you are choosing a list of discharged patients from the last month, you choose the first patient randomly, then choose every fifth patient (or whatever number you choose) thereafter

In this sample the choice of the first patient determines the others

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Stratified random sampling (SRS)

First divide the population into groups of similar individuals, called strata

Then choose a separate SRS in each stratum and combine these SRSs to form the full sample

For example, you may want to choose a selection by gender, by patients with private insurance and those without or separating hospitals by bed size

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Cluster sampling

The population is selected from groups or clusters

For example, let’s say your study includes health information practitioners working in large cities

We would choose the cities (the cluster) first

Then we would randomly choose the health information practitioners

This is called two-stage cluster sampling

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Non-probability samples—Almost all qualitative research methods rely on this type of sampling

Judgment sampling

The researcher relies on his or her own judgment to select the subjects

For example, let’s say you are performing a study on transcription departments in acute care hospitals that use an incentive plan to pay employees

There are a number of large hospitals as well as small and medium sized hospitals using an incentive plan

In a judgment sampling, the researcher decides which hospitals to use in the groups

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Quota sampling

The population is first divided as in stratified sampling

Then the researcher uses his or her own judgment to select the number of subjects based on a specified proportion

Using our example of HIM departments using an EHR

If there are 100 hospitals in your state, and 50 are using an EHR and 50 are not, you may choose to perform your study on 20 of the hospitals as that would be 20 percent of the total population of hospitals in your state

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Convenience sampling

The selection is based on availability of the subjects

Using our example above, you might decide to use only the hospitals in your city or within a certain driving distance in order to expedite the study

Not clear if this type of sample is really representative of the population

However, you may be able to get some insights about the question you are trying to answer

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Snowball sampling

Used when characteristics needed to be possessed by participants are difficult to find

Using our earlier example, if you wanted to study only those departments using a particular type of software and could not get that information from the vendor, you might have to rely on HIM professionals to refer you to others they know are using the same software

You would need to find the initial contact and then rely on the participant to direct you to subsequent participants

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Sample size

The ideal sample is large enough to serve as an adequate representation of the population about which the researcher wishes to generalize and small enough to be selected economically

In terms of subject availability, expense in both time and money, and complexity of data analysis

The larger the sample, the smaller the magnitude of sampling error

Survey studies ordinarily have a larger sample size then experimental studies

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

If you mail questionnaires, your response rate could be a low as 20 to 30 percent, so a large initial sample is recommended

If you are planning to have subgroups from your population, start out with a large group to make sure you have enough participants for the subgroups

Subject availability and costs are legitimate considerations in determining a sample size

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Analyzing the data

The investigator tries to determine what the data disclose

There are a variety of statistics used to analyze data

Most investigators use a variety of techniques to describe the data

Two types of statistical applications are relevant to most studies

Descriptive

Inferential

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Descriptive statistics

These are statistics that describe the data

Includes measures of central tendency and measures of variation

Inferential statistics

These statistics allow the researchers to make inferences about the population characteristics (parameters) from the sample’s characteristics

t tests and analysis of variance are examples

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Drawing conclusions

Any conclusions should be related to the hypothesis, or if using the qualitative approach, then the problem identified

Results for each hypothesis should be described

Any limitations that the researcher discovered during data analysis should be reported

E.g., our study of HIM departments studied one city—this may be a limiting factor

New hypotheses may be proposed if the data do not support the original hypotheses

Researchers usually include tables and graphs in this section of the research report to clarify the data

© 2017 American Health Information Management Association

Research Design and Data Collection Techniques (continued)

Research always raises new questions about what to study

These become suggestions for future research

The researcher should always include conclusions about whether or not this problem is better understood or perhaps even resolved from the research

© 2017 American Health Information Management Association

Data Interpretation Issues

Misleading presentation of numbers

The easiest way to fabricate data is to simply make up the numbers

Another way to mislead people is to give misinformation—that is to make a claim that is contradicted by the available statistics information

Check the facts before asserting the information

© 2017 American Health Information Management Association

Data Interpretation Issues (continued)

Ignoring the baseline

Another common error that occurs is to compare raw numbers without adjusting the baseline

Selection bias

Statistical errors can also occur when a sample used in research does not represent the population

Graphical misrepresentation

Graphs can be manipulated to emphasize different points

© 2017 American Health Information Management Association

Data Interpretation Issues (continued)

Sabotage

One researcher may try to sabotage a colleague’s work

Using questionable practices when reporting the data to improve the outcome

© 2017 American Health Information Management Association

Data Interpretation Issues (continued)

Importance of data validation

When a statistical report is received, the HIM professional should examine it carefully to determine if the data are correct

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB)

Responsible for reviewing all research projects for approval

Ensure steps are taken by the researcher to protect the rights and welfare of participants

Review research procedures before the study is started and perform periodic reviews during the study

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Benefits and risks

A benefit may be specific to the individual subject or to others that may result from the research

Risks are concerned with the probability or extent of harm to the research subject

Extent of harm may be a statement that indicates minor problems such as itchiness as a result of the treatment, or it may be a major effect of treatment such as liver failure that may result in death

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

They may approve, revise, or deny research requests

Any research on humans must be taken with care to ensure that subjects are not abused in any way

It may be necessary for you to ask participants to sign a statement that they understand what will be asked of them

The researcher must protect the privacy of any research participants

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Required in healthcare organizations that conduct research on human subjects

A committee whose primary responsibility is to protect the rights and welfare of research subjects

Professionals who serve on IRBs have extensive education and experience in clinical research

Most of these individuals have medical and/or doctoral or other advanced degrees

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Also called

Independent Ethics Committee

Human Subjects Committees

The IRB functions as a kind of ethics committee that focuses on what is right or wrong and what is undesirable in order to protect the rights and welfare of anyone participating in the research study

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Because human subjects are involved, researchers are required to follow certain ethical principles that guide researcher behavior, morality, and character traits

Research ethics provide

A structure for analysis and decision making

Support and reminders for researchers to protect human subjects

Workable definitions of benefits and risks

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Responsible for reviewing the research procedures before the study is started and may require periodic reviews during the study

They may approve, revise, or deny requests for research in their facility

Any research on humans must be done carefully to ensure that subjects are not abused in any way

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

The researcher must obtain permission from the IRB before any research study is started and prepare a plan for the research

The researcher must have thought through the research very carefully

Prepared any questionnaires

Decided how to select a sample and how to collect data

Prepare the documentation necessary for the IRB, including informed consent forms for the subjects

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Subjects must give an informed consent

Informed consent is a person’s voluntary agreement to participate in research or to undergo a diagnostic, therapeutic, or preventive procedure

It is based on adequate knowledge and an understanding of relevant information provided by the investigators

In giving informed consent, subjects do not waive any of their legal rights nor do they release the investigator, sponsor, or institution from liability for negligence

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Required federal regulations

A statement that the study involves research, the purpose of the research, the expected time frame of subject participation, a description of the procedures to be followed, and the identification of procedures that are experimental

A description of reasonably foreseeable risks or discomforts. The description must be accurate and reasonable, and subjects must be informed of previously reported adverse events

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

A description of the benefits to the subject or who may benefit from the research

A disclosure of any appropriate alternative procedures or courses of treatment that might be available

When appropriate, a statement that supportive care with no additional disease-specific treatment is an alternative

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

A statement describing the extent to which confidentiality of records identifying the subject will be maintained

The statement should include full disclosure and description of approved agencies, such as the FDA, that may have access to the records

For research involving more than minimal risk, an explanation as to whether any compensation or medical treatments are available if injury occurs, and, if so, what they consist of or where further information may be obtained

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

An explanation of whom to contact for answers to pertinent questions about the research and whom to contact in the event of a research-related injury

A statement that participation is voluntary, that refusal to participate will involve no penalty or loss of benefits, and that the subject may discontinue participation at any time

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Federal regulations also require that informed consent be in a language that is understandable to the subject

The consent form must be translated into that language

Subjects who are not literate in their language must have an interpreter present to explain the study and to translate questions and answers between subject and investigator

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Privacy considerations

The Privacy Rule (HIPAA) establishes a category of protected health information (PHI), which may be used or disclosed only in certain circumstances or under certain conditions

PHI is a subset of what is called individually identifiable health information

It includes what healthcare professionals typically regard as a patient’s PHI

PHI also includes identifiable health information about subjects of clinical research

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

The Privacy Rule

Defines how human research subjects are informed of how their personal medical information will be used or disclosed

Defines the rights they have to access the information

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

The Privacy Rule protects the privacy of individually identifiable information while ensuring that researchers continue to have access to the medical information they need to conduct their research

Investigators are permitted to use and disclose PHI for research with individual authorization or without individual authorization under limited circumstances

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

A valid Privacy Rule authorization is an individual’s signed permission allowing a covered entity to use or disclose the patient’s PHI for the purpose(s) and to the recipient(s) stated in the authorization

When an authorization is obtained for biomedical research purposes, the Privacy Rule requires that it pertain only to a specific research study, not to future unspecified projects

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

The core elements of the Privacy Rule authorization are

A description of the PHI to be used or disclosed

The names or other specific identification of the person or persons authorized to make the requested use or disclosure

The names or other specific identification of the person or persons to whom the covered entity may make the requested use or disclosure

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

A description of each purpose of the requested use or disclosure

An authorization expiration date or expiration event that relates to the individual or to the purpose of the use or disclosure

The signature of the individual and the date

If the individual’s legally authorized representative signs the authorization, a description of his or her authority to act for the individual also must be provided

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

That the individual has the right to revoke the authorization at any time and must be provided with the procedure for doing so

Whether treatment, payment, enrollment, or eligibility of benefits can be contingent upon authorization, including research-related treatment and consequences of refusing to sign the authorization, if applicable

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Any potential risk that the PHI will be redisclosed by the recipient and no longer protected by the Privacy Rule

The authorization must be written in plain language and a copy provided to the individual

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Some facilities may also have a Research Protocol Monitoring Committee

Reviews any research before and during the study to ensure that there are no adverse effects on the participants

It may even recommend closure of research that is not meeting safety standards, does not have scientific merit, or is not meeting the goals of the research

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Ethical guidelines in statistics

Statistics play an important part in clinical and healthcare administrative decision-making

Statistical data collection, calculation, display and interpretation must be appropriate and accurate

Follow the edicts of the Institutional Review Board at their facilities and follow accepted ethical practice

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

Ethical guidelines in statistics

The American Statistical Association has developed Ethical Guidelines for Statistical Practice

They advocate for integrity in the professional work

Their guidelines include

Present findings and interpretations honestly and objectively

Avoid untrue, deceptive, or undocumented statements

Disclose any financial or other interests that may affect, or appear to affect, their professional statements

© 2017 American Health Information Management Association

Introduction to Institutional Review Boards (IRB) (continued)

How to develop research skills

Take at least one course in statistics and research methodologies

Begin to read research studies in professional journals to see how others have performed their research

Agree to work with a skilled health information researcher on a study to gain experience

Learn how to present data effectively both in written form and verbally

© 2017 American Health Information Management Association