What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis
The issue of measurement invariance is ubiquitous in the behavioral sciences nowadays as more and more studies yield multivariate multigroup data. When measurement invariance cannot be established across groups, this is often due to different loadings on only a few items. Within the multigroup CFA f...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2014-06-01
|
Series: | Frontiers in Psychology |
Subjects: | |
Online Access: | http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00604/full |
id |
doaj-6a54e8a686774f65a756ea26cef719ed |
---|---|
record_format |
Article |
spelling |
doaj-6a54e8a686774f65a756ea26cef719ed2020-11-24T21:40:22ZengFrontiers Media S.A.Frontiers in Psychology1664-10782014-06-01510.3389/fpsyg.2014.0060483341What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysisKim eDe Roover0Marieke E. Timmerman1Jozefien eDe Leersnyder2Batja eMesquita3Eva eCeulemans4KU LeuvenUniversity of GroningenKU LeuvenKU LeuvenKU LeuvenThe issue of measurement invariance is ubiquitous in the behavioral sciences nowadays as more and more studies yield multivariate multigroup data. When measurement invariance cannot be established across groups, this is often due to different loadings on only a few items. Within the multigroup CFA framework, methods have been proposed to trace such non-invariant items, but these methods have some disadvantages in that they require researchers to run a multitude of analyses and in that they imply assumptions that are often questionable. In this paper, we propose an alternative strategy which builds on clusterwise simultaneous component analysis (SCA). Clusterwise SCA, being an exploratory technique, assigns the groups under study to a few clusters based on differences and similarities in the covariance matrices, and thus based on the component structure of the items. Non-invariant items can then be traced by comparing the cluster-specific component loadings via congruence coefficients, which is far more parsimonious than comparing the component structure of all separate groups. In this paper we present a heuristic for this procedure. Afterwards, one can return to the multigroup CFA framework and check whether removing the non-invariant items or removing some of the equality restrictions for these items, yields satisfactory invariance test results. An empirical application concerning cross-cultural emotion data is used to demonstrate that this novel approach is useful and can co-exist with the traditional CFA approaches.http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00604/fullmetric invarianceConfigural invarianceWeak invariancemeasurement biaspattern invariance |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Kim eDe Roover Marieke E. Timmerman Jozefien eDe Leersnyder Batja eMesquita Eva eCeulemans |
spellingShingle |
Kim eDe Roover Marieke E. Timmerman Jozefien eDe Leersnyder Batja eMesquita Eva eCeulemans What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis Frontiers in Psychology metric invariance Configural invariance Weak invariance measurement bias pattern invariance |
author_facet |
Kim eDe Roover Marieke E. Timmerman Jozefien eDe Leersnyder Batja eMesquita Eva eCeulemans |
author_sort |
Kim eDe Roover |
title |
What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis |
title_short |
What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis |
title_full |
What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis |
title_fullStr |
What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis |
title_full_unstemmed |
What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis |
title_sort |
what’s hampering measurement invariance: detecting non-invariant items using clusterwise simultaneous component analysis |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Psychology |
issn |
1664-1078 |
publishDate |
2014-06-01 |
description |
The issue of measurement invariance is ubiquitous in the behavioral sciences nowadays as more and more studies yield multivariate multigroup data. When measurement invariance cannot be established across groups, this is often due to different loadings on only a few items. Within the multigroup CFA framework, methods have been proposed to trace such non-invariant items, but these methods have some disadvantages in that they require researchers to run a multitude of analyses and in that they imply assumptions that are often questionable. In this paper, we propose an alternative strategy which builds on clusterwise simultaneous component analysis (SCA). Clusterwise SCA, being an exploratory technique, assigns the groups under study to a few clusters based on differences and similarities in the covariance matrices, and thus based on the component structure of the items. Non-invariant items can then be traced by comparing the cluster-specific component loadings via congruence coefficients, which is far more parsimonious than comparing the component structure of all separate groups. In this paper we present a heuristic for this procedure. Afterwards, one can return to the multigroup CFA framework and check whether removing the non-invariant items or removing some of the equality restrictions for these items, yields satisfactory invariance test results. An empirical application concerning cross-cultural emotion data is used to demonstrate that this novel approach is useful and can co-exist with the traditional CFA approaches. |
topic |
metric invariance Configural invariance Weak invariance measurement bias pattern invariance |
url |
http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00604/full |
work_keys_str_mv |
AT kimederoover whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis AT mariekeetimmerman whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis AT jozefienedeleersnyder whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis AT batjaemesquita whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis AT evaeceulemans whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis |
_version_ |
1725926348294193152 |