11/5/23, 2:25 PM
Benchmark Essay #1 - COUC 521
about:blank
1/6
Running head: EXPLORING RELIABILTY AND VALIDITY 1
BENCHMARK: EXPLORING RELIABILITY AND VALIDITY
Kalland A. Rudolph, Liberty University Graduate Program
Clinical Mental Health Counseling
Author Note
There are no conflicts of interest to report at the present time. -Kalland A. Rudolph
Email: karudolph@liberty.edu
11/5/23, 2:25 PM
Benchmark Essay #1 - COUC 521
about:blank
2/6
EXPLORING RELIABILTY AND VALIDITY 2
Benchmark: Exploring Reliability and Validity
Within the contents of this paper, there will be a discussion and exploration of the
different psychometric traits of the Values and Motives Questionnaire, the technical manual
(VMQ, 2020). The purpose of this paper is to find comparisons between the VMQ and the
reliability and validity of the assessment.
1. Types of Reliability of Validity
The authors of the Values and Motives Questionnaire details two types of reliability and
validity as well as the general principles of norming. In the mention of normative data, the
authors detail how normative data allows a comparison between the subjects score and a
standardized scale amongst a homogenous class of people. They state that standardization can be
interpreted into meaningful context to a relevant set of scores. The types of reliability used were
stability and internal consistency. Test-retest reliability or stable reliability is used to indicate the
ability of a test to be repeated within a passage of time. This represents the stability of the
construct that is being measured by the test. The use of stability coefficients can provide an
indicator of the usefulness of measurement of the respective test. Internal consistency, which is
also known as scale homogeneity, is an assessment of how well the items in a scale measure a
construct or trait. A scale is to be consistent internally if all the item responses are positively
correlated to the score. The use of the Cronbach’s Alpha is the most common measure of internal
consistency and this shows that a high coefficient alpha indicates that the items on the scale are
measuring consistently. Validity is the ability of the scale to reflect what findings it is supposed
to. There are two types of validity that are being used within the VMQ which are Criterion
Validity and Construct Validity. Construct validity is where the characteristic that is being
measured psychologically meaningful and consistent with the definitions provided with the test.
11/5/23, 2:25 PM
Benchmark Essay #1 - COUC 521
about:blank
3/6
EXPLORING RELIABILTY AND VALIDITY 3
Criterion validity is where one takes the scores from a test and translates those scores to be
prospective predictions. This type of validity is where scores on the test are related with meaning
to an external criterion.
2. Reliability: Cronbach Alpha Coefficients.
Construct Cronbach’s Alpha Reliability
Affiliative 0.74 Adequate
Altruistic 0.74 Adequate
Affection 0.79 Adequate
Achievement 0.53 Low
Finance 0.83 Good
Security 0.79 Adequate
Aesthetics 0.83 Good
Moral 0.68 Low
Traditional 0.70 Adequate
Independence 0.66 Low
Ethical 0.70 Adequate
S.D. 0.64 Low
Infrequency 0.52 Low
The results of the Cronbach’s alpha test predict that only 15.4% of the tests are good,
46.1 % are adequate, and lastly 38.5% are low in application. The range of scores shows that
almost 70% of the assessment questions are homogenous while less than 40% of the test have a
limited consistency.
3. Sample Size and Nature of the Population.
a. Validity: The VMQ pulled a sample of 159 psychology and MBA students to
complete the introductory portion of the Personnel Assessment where there was a
range of 0 to 0.57 for the inter-correlations and this can be interpreted to mean that
the various scales that are being measured are independent of one another and it
11/5/23, 2:25 PM
Benchmark Essay #1 - COUC 521
about:blank
4/6
EXPLORING RELIABILTY AND VALIDITY 4
measures distinct aspects of the value system. The VMI and MAPP test 59 under-
graduate psychology students and the VMI and 16PF relationship included 100 MBA
students were chosen for the assessment. One could state the populations of the test
are not comparable due to the constructs being on average independent of each other.
However, this does not raise an issue of validity at the present time due to the higher
range within the inter-correlations but, could possibly affect the validity. One could
predict that the test is adequate in measuring what it is supposed to.
b. VMQ Norming Population: The assessment states that it is used for those in
counseling, coaching, or vocational guidance however, past those demographics there
is not much descriptive information about the populations that were pulled. There is
however mention of there being two different genders; however, the populations of
men and women are not homogenous. There is not equal distribution amongst the
men and women. I believe that they could have broaden and diversified the traits and
demographics of their population within this particular assessment in order to
demonstrate how this assessment can be replicated and applied to most.
4. Your Opinion of the VMQ.
The psychometric properties that were found for the reliability of this assessment were
not significant and not as reliable as the creators would like for it to be. With the range of
scores being mostly adequate or below adequacy which shows that in general this
assessment may not be as applicable as they had envisioned. While the authors have
mentioned adding more test items and constructs; with that in mind it may cause a
concern for the decline in the Cornbach’s alpha which will lower how reliable this
assessment may be. The VMQ then states that the inter-correlational are found to be
11/5/23, 2:25 PM
Benchmark Essay #1 - COUC 521
about:blank
5/6
EXPLORING RELIABILTY AND VALIDITY 5
modest which would mean that in tun the assessment measures what it is supposed to
measure. The only true concern I may have is the authors not using a broader and more
diverse population to assess and that may affect the consistency of the assessment down
the line.
11/5/23, 2:25 PM
Benchmark Essay #1 - COUC 521
about:blank
6/6
EXPLORING RELIABILTY AND VALIDITY 6
References
Rodrigues, J., Ulrich, N., Mussel, P., Carlo, G., & Hewig, J. (2017). Measuring Prosocial
Tendencies in Germany: Sources of Validity and Reliablity of the Revised Prosocial Tendency
Measure. Frontiers in psychology, 8, 2119. https://doi.org/10.3389/fpsyg.2017.02119
Sheperis, C., Drummond, R. J., & Jones, K. D. (2020). Assessment procedures for
counselors and helping professionals (9th ed.). Pearson.
Values and motives questionnaire the technical manual (2020).
https://www. Psytech.co.za/images/PsytechSa/VMI/VMIMan.pdf
