Article Review and Critique

Running head: QUANTITATIVE RESEARCH REVIEW 1

QUANTITATIVE RESEARCH REVIEW 5

Quantitative Research Review

Erika Tallent

Walden College

Introduction

The article by Tian et al. (2015) evaluates the ineffectiveness of business intelligence in organizations. Most studies on business intelligence were studies are evaluated technological aspect without analyzing how it can be implemented to achieve success in an organization. The poor relationship between business intelligence and organization makes it essential to examine business intelligence from the organizational perspective by analyzing the relationship between business intelligence and organizational effectiveness.

Methodology

Data was collected using a quantitative survey on senior managers with business intelligence under implementation in their organizations, and organizations where business intelligence had been implemented for at least five years were selected. 587 managers from 363 organizations were selected and organizations which had more than one department were represented by more than one manager to reduce bias (Tian et al., 2015). The study utilized structural equation modeling for data analysis and hypothesis testing. Such models are important because they integrate both factor and path analysis.

Findings

The measurement was tested to see if each item was a significant indicator for each model. The model integrated six items such as organizational effectiveness, business intelligence systems' effectiveness, corporate strategy, organizational structure, organizational processes, and organizational culture. Cronbach’s alpha was used to test inconsistencies. The results indicated that the items used for the research had a high degree of reliability. The construct's validity was tested by measuring the average variance extracted, which indicated it was more significant than the minimum threshold of 0.5. Any aspect of discriminant validity was evaluated to see if any construct explained its indicator variance compared to other indicators' variance (Tian et al., 2015). The discriminant validity test was approved and supported. Convergent validity was tested using factor and cross-loading of indicators in relation to their construct, which indicated that each item represents their distinct latent construct (Tian et al., 2015).

Limitation and implications of the study

The research presented shows that it was conducted from one aspect of implementing business intelligence that is from those organizations that were using business intelligence but the aspect of utilizing different system software was not considered. Besides, the research could have suffered from potential bias for organizations that were represented by a single manager by omitting an important aspect of the implementing business intelligence. The organizations that have used business intelligence would have matured and it would have been difficult to assess success solely attributed intelligence system. Integration of business intelligence may vary across organizations due to differences in abilities to integrate new technological innovations as they arise. The research can be replicated to establish the relationship between other business intelligence software and different types of vendors.

The methodology utilized in data collection was more skewed since data was collected from organizations operating in the same industry, it would have been better to incorporate organizations from different industries in order to employ a balanced sampling technique. Besides, the research opens door for further study that incorporates organizations from different industries and different software versions in order to have a multi perspective study of the topic. A study that focuses from both organizations’ output would be better to assess the effectiveness of the adopted technology in promoting better performance instead of relying on individual observations that could be biased. The research would end up with two extreme findings based on the same scenario as different individuals have diverging opinions, and close ended questions would be recommended to avoid this divergence.

References

Tian, X., Chiong, R., Martin, B., Stockdale, R., Arefin, M. S., Hoque, M. R., & Bao, Y. (2015). The impact of business intelligence on organization’s effectiveness: an empirical study. Journal of Systems and Information Technology. http://dx.doi.org/10.1108/JSIT-09-2014-0067