EXPLORING RELIABILITY AND VALIDITY
1
Benchmark Exploring Reliability and Validity
Hanna Kracun
School of Behavioral Sciences, Liberty University
EXPLORING RELIABILITY AND VALIDITY
2
Types of Reliability and Validity
The Values and Motives Questionnaire (VMQ) has two measures to assess reliability.
Reliability does not ensure that the information in the test is valid even though it measures a
variable consistently (What Makes a Good Test, n.d.). On the other hand, validity measures
determine whether the tests are valid or accurate (What Makes a Good Test, n.d.). Validity is
measured using two different methods: criterion and construct validity. Criterion validity
compares scores and shows that the scores are similar for the tests (What Makes a Good Test,
n.d.). Construct validity measures the extent of the consistency of the tests and determines
whether any scores are identical. The Values and Motives Questionnaire defines homogeneity as
internal consistency. When the psychometric soundness of a test, the reliability and validity of a
test are determined (Values and Motives Questionnaire, n.d.).
Reliability: Cronbach Alpha Coefficients
Cronbach’s Alpha reliability for internal consistency was for both males and females. In
the VMI scales, many exceed the 0.7 level, which shows that those measures are acceptable.
Some things were low scores on the scale, which belonged to achievement (.53), infrequency
(.52), moral (.68), and independence scale (.66) (Values and Motives Questionnaire, n.d.). When
looking at all of the scores, anyone with a score higher than .82 or higher on the standard
measurement error means there is a slight chance of error. Also, if the Alpha score is .83, the
measurement is accurate.
Sample Size and Nature of the Population
According to the Values and Motives Questionnaire, 159 psychologists and MBA
students were included in the questionnaire, which is required for the introductory course of this
assessment. Fifty-nine psychology undergraduates completed this questionnaire to receive
EXPLORING RELIABILITY AND VALIDITY
3
feedback on the tests and results. A high correlation between OPP and VMI was found, and the
results were accurate regarding feedback. The remaining 100 MBA test subjects were required to
do the London Business School. The VMI, OPP, MAPP, and OPP are about the education level
and the age. The VMQ is comparable to the MAPP and the OPP, similar to the 16PF version 5,
because they have the same reliability and population for people trying to earn their degrees.
Both males and females participated in this questionnaire. The other population did not note the
genders used in the survey. The Values and Motives Questionnaire stated that the MAPP sample
population volunteered to take the test and provide feedback. These were not dependable and
could significantly impact the validity (Values and Motives Questionnaire, n.d.).
Validity
There are many issues with the validity of the VMQ. The first is that the test was done on
psychology and MBA students, making it unable to generalize to other populations or groups.
These people were also working towards a degree, which was a requirement to take the survey,
which could compromise the test's validity due to the students' biases (Values and Motives
Questionnaire, n.d.). They also used a comparison of the OPP and VQI assessment
measurements. It needs to be clarified whether the VQI assessment was done on graduate or
undergraduate students and whether the amount of education someone has could affect the
validity of the test.
VMQ Norming Population
The VMQ does not give information on the cultures, populations, or races sampled. It
only mentions gender and education. While they mentioned the genders that were tested, they
provided little information on the specific numbers, so if there was not an even or close to even
number of each gender taking the test, it could affect the validity compared to other populations.
EXPLORING RELIABILITY AND VALIDITY
4
They did not have enough diversity within their sample to have traits that would be found within
the average population. More information on the level of education the psychology students have
is important because that can make it general.
Your Opinion of the VMQ
The VMQ was reliable and valid when looking at the whole test. It did not have enough
information on the population that it was sampling. They stated they used both females and
males, which makes the test more reliable. However, using random selection and more specific
demographics must be supplied to make tests more reliable. This test was done on students with
a higher education that does not represent the general population. If they provided more
information on race, culture, gender, education levels, and further demographic information, it
would have been needed to increase the validity and reliability of the test. The validity of the test
also provided a range of 0 to 0.57, which shows that the results of the VMQ are not comparable
(Values and Motives Questionnaire, n.d.).
EXPLORING RELIABILITY AND VALIDITY
5
References
Values and Motives Questionnaire- psytech. (n.d.). Retrieved February 5, 2022, from
https://www.psytech.co.za/images/PsytechSA/VMI/VMIMan.pdf
Unknown. (n.d.) What makes a good test? Liberty University.
https://libertyuniversity.instructure.com/courses/205314/assignments/3310664?
module_item_id=21581949
