Penentuan Besarnya Sampel Uji Coba berdasarkan Presisi Estimasi Alpha Cronbach

Agung Santoso(1*), Alice Whita Savira(2), Robertus Landung Prihatmoko(3),

(1) Fakultas Psikologi, Universitas Sanata Dharma Yogyakarta
(2) Fakultas Psikologi, Universitas Sanata Dharma Yogyakarta
(3) Fakultas Psikologi, Universitas Sanata Dharma Yogyakarta
(*) Corresponding Author

Abstract


The current article shows the importance of involving an adequate size of try-out samples based on two considerations: the power of the analysis and the accuracy of parameter estimates. Two simulation studies were conducted to achieve two purposes. The first was to show the disadvantages of calculating reliability estimates with inadequate sample sizes due to lower power or high inaccuracy. The second objective was to show the performance of two formulas for calculating the required sample size: Feldt and Bonett. Based on their performance, the recommendation on which formula should be used was made. The results of the first simulation show that inadequate sample size resulted in lower power to test estimated reliability from the data and large fluctuation of reliability estimates across samples. Such large fluctuations made higher possibility of having sample values of reliability estimates far from the population value. The second simulation results in better estimation of sample size required to have large power and accuracy using Bonett’s formula.


Keywords


Reliability, sample size, try-out sample, Feldt’s formula, Bonett’s formula, power, accuracy

Full Text:

PDF

References


Bentler, P. M. (2009). Alpha, Dimension-Free, and Model-Based Internal Consistency Reliability. Psychometrika, 74(1), 137–143. https://doi.org/10.1007/s11336-008-9100-1 Bonett, D. G. (2002). Sample Size Requirements for Testing and Estimating Coefficient Alpha. Journal of Educational and Behavioral Statistics, 27(4), 335–340. Bonett, D. G., & Wright, T. A. (2015). Cronbach’s alpha reliability: Interval estimation, hypothesis testing, and sample size planning: CRONBACH’S ALPHA RELIABILITY. Journal of Organizational Behavior, 36(1), 3–15. https://doi.org/10.1002/job.1960 Charter, R. A. (1999). Sample Size Requirements for Precise Estimates of Reliability, Generalizability, and Validity Coefficients. Journal of Clinical and Experimental Neuropsychology, 21(4), 559–566. https://doi.org/10.1076/jcen.21.4.559.889 Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2 edition). Routledge. Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037/0021-9010.78.1.98 Duhachek, A., & Iacobucci, D. (2004). Alpha’s Standard Error (ASE): An Accurate and Precise Confidence Interval Estimate. Journal of Applied Psychology, 89(5), 792–808. https://doi.org/10.1037/0021-9010.89.5.792 Ercan, I., Yazici, B., Sigirli, D., Ediz, B., & Kan, I. (2007). Examining Cronbach Alpha, Theta, Omega Reliability Coefficients According to Sample Size. Journal of Modern Applied Statistical Methods, 6(1), 291–303. https://doi.org/10.22237/jmasm/1177993560 Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987). Statistical Inference for Coefficient Alpha. Applied Psychological Measurement, 11(1), 93–103. https://doi.org/10.1177/014662168701100107 Gable, R. K., & Wolf, M. B. (1993). Instrument development in the affective domain: Measuring attitudes and values in corporate and school settings (2nd ed.). Springer Science+Business Media. Gregory, R. J. (2015). Psychological testing: History, principles, and applications (7th ed.). Pearson Education Limited. Kelley, K., Maxwell, S. E., & Rausch, J. R. (2003). Obtaining Power or Obtaining Precision: Delineating Methods of Sample-Size Planning. Evaluation & the Health Professions, 26(3), 258–287. https://doi.org/10.1177/0163278703255242 Kelley, K., & Pornprasertmanit, S. (2016). Confidence intervals for population reliability coefficients: Evaluation of methods, recommendations, and software for composite measures. Psychological Methods, 21(1), 69–92. https://doi.org/10.1037/a0040086 Liu, Y., & Zumbo, B. D. (2007). The Impact of Outliers on Cronbach’s Coefficient Alpha Estimate of Reliability: Visual Analogue Scales. Educational and Psychological Measurement, 67(4), 620–634. https://doi.org/10.1177/0013164406296976 MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99. https://doi.org/10.1037/1082-989X.4.1.84 Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008). Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation. Annual Review of Psychology, 59(1), 537–563. https://doi.org/10.1146/annurev.psych.59.103006.093735 Nunnally, J., & Bernstein, I. (1994). Psychometric theory (3rd ed.). McGraw-Hill Humanities/Social Sciences/Languages. Raykov, T. (1997). Estimation of Composite Reliability for Congeneric Measures. Applied Psychological Measurement, 21(2), 173–184. https://doi.org/10.1177/01466216970212006 Raykov, T., Anthony, J. C., & Menold, N. (2023). On the Importance of Coefficient Alpha for Measurement Research: Loading Equality Is Not Necessary for Alpha’s Utility as a Scale Reliability Index. Educational and Psychological Measurement, 83(4), 766–781. https://doi.org/10.1177/00131644221104972 Santoso, A. (2017a). Benarkah Ukuran Sampel Minimal = 30? Jurnal Psikologi Indonesia, 12, 63–84. Santoso, A. (2017b). Comparing t Test, rit Significance Test, and rit Criteria for Item Selection Method: A Simulation Study. ANIMA Indonesian Psychological Journal, 32(2), 99–108. https://doi.org/10.24123/aipj.v32i2.588 Sijtsma, K. (2009). On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha. Psychometrika, 74(1), 107–120. https://doi.org/10.1007/s11336-008-9101-0 Wiradhany, W., Adiasto, K., Yulianto, J. E., & Kiling, I. Y. (2019). Pemahaman Peneliti Psikologi mengenai Besaran Sampel: Data dan Simulasi. Jurnal Psikologi, 46(2), 163. https://doi.org/10.22146/jpsi.24260 Wolf, E. J., Harrington, K. M., Clark, S. L., & Miller, M. W. (2013). Sample Size Requirements for Structural Equation Models: An Evaluation of Power, Bias, and Solution Propriety. Educational and Psychological Measurement, 73(6), 913–934. https://doi.org/10.1177/0013164413495237 Yurdugül, H. (2008). Minimum sample size for crobach’s coefficient alpha. Hacettepe Üniversitesi Eğitim Fakültesi Dergisi, 35, 397–405. Zimmerman, D. W. (2004). Inflation of Type I Error Rates by Unequal Variances Associated with Parametric, Nonparametric, and Rank-Transformation Tests. SECCIÓN METODOLÓGICA, 103–133.




DOI: https://doi.org/10.24071/suksma.v6i1.12340

Refbacks

  • There are currently no refbacks.


Web Analytics

View My Stats