What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis

The issue of measurement invariance is ubiquitous in the behavioral sciences nowadays as more and more studies yield multivariate multigroup data. When measurement invariance cannot be established across groups, this is often due to different loadings on only a few items. Within the multigroup CFA f...

Full description

Bibliographic Details
Main Authors: Kim eDe Roover, Marieke E. Timmerman, Jozefien eDe Leersnyder, Batja eMesquita, Eva eCeulemans
Format: Article
Language:English
Published: Frontiers Media S.A. 2014-06-01
Series:Frontiers in Psychology
Subjects:
Online Access:http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00604/full
id doaj-6a54e8a686774f65a756ea26cef719ed
record_format Article
spelling doaj-6a54e8a686774f65a756ea26cef719ed2020-11-24T21:40:22ZengFrontiers Media S.A.Frontiers in Psychology1664-10782014-06-01510.3389/fpsyg.2014.0060483341What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysisKim eDe Roover0Marieke E. Timmerman1Jozefien eDe Leersnyder2Batja eMesquita3Eva eCeulemans4KU LeuvenUniversity of GroningenKU LeuvenKU LeuvenKU LeuvenThe issue of measurement invariance is ubiquitous in the behavioral sciences nowadays as more and more studies yield multivariate multigroup data. When measurement invariance cannot be established across groups, this is often due to different loadings on only a few items. Within the multigroup CFA framework, methods have been proposed to trace such non-invariant items, but these methods have some disadvantages in that they require researchers to run a multitude of analyses and in that they imply assumptions that are often questionable. In this paper, we propose an alternative strategy which builds on clusterwise simultaneous component analysis (SCA). Clusterwise SCA, being an exploratory technique, assigns the groups under study to a few clusters based on differences and similarities in the covariance matrices, and thus based on the component structure of the items. Non-invariant items can then be traced by comparing the cluster-specific component loadings via congruence coefficients, which is far more parsimonious than comparing the component structure of all separate groups. In this paper we present a heuristic for this procedure. Afterwards, one can return to the multigroup CFA framework and check whether removing the non-invariant items or removing some of the equality restrictions for these items, yields satisfactory invariance test results. An empirical application concerning cross-cultural emotion data is used to demonstrate that this novel approach is useful and can co-exist with the traditional CFA approaches.http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00604/fullmetric invarianceConfigural invarianceWeak invariancemeasurement biaspattern invariance
collection DOAJ
language English
format Article
sources DOAJ
author Kim eDe Roover
Marieke E. Timmerman
Jozefien eDe Leersnyder
Batja eMesquita
Eva eCeulemans
spellingShingle Kim eDe Roover
Marieke E. Timmerman
Jozefien eDe Leersnyder
Batja eMesquita
Eva eCeulemans
What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis
Frontiers in Psychology
metric invariance
Configural invariance
Weak invariance
measurement bias
pattern invariance
author_facet Kim eDe Roover
Marieke E. Timmerman
Jozefien eDe Leersnyder
Batja eMesquita
Eva eCeulemans
author_sort Kim eDe Roover
title What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis
title_short What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis
title_full What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis
title_fullStr What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis
title_full_unstemmed What’s hampering measurement invariance: Detecting non-invariant items using clusterwise simultaneous component analysis
title_sort what’s hampering measurement invariance: detecting non-invariant items using clusterwise simultaneous component analysis
publisher Frontiers Media S.A.
series Frontiers in Psychology
issn 1664-1078
publishDate 2014-06-01
description The issue of measurement invariance is ubiquitous in the behavioral sciences nowadays as more and more studies yield multivariate multigroup data. When measurement invariance cannot be established across groups, this is often due to different loadings on only a few items. Within the multigroup CFA framework, methods have been proposed to trace such non-invariant items, but these methods have some disadvantages in that they require researchers to run a multitude of analyses and in that they imply assumptions that are often questionable. In this paper, we propose an alternative strategy which builds on clusterwise simultaneous component analysis (SCA). Clusterwise SCA, being an exploratory technique, assigns the groups under study to a few clusters based on differences and similarities in the covariance matrices, and thus based on the component structure of the items. Non-invariant items can then be traced by comparing the cluster-specific component loadings via congruence coefficients, which is far more parsimonious than comparing the component structure of all separate groups. In this paper we present a heuristic for this procedure. Afterwards, one can return to the multigroup CFA framework and check whether removing the non-invariant items or removing some of the equality restrictions for these items, yields satisfactory invariance test results. An empirical application concerning cross-cultural emotion data is used to demonstrate that this novel approach is useful and can co-exist with the traditional CFA approaches.
topic metric invariance
Configural invariance
Weak invariance
measurement bias
pattern invariance
url http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00604/full
work_keys_str_mv AT kimederoover whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis
AT mariekeetimmerman whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis
AT jozefienedeleersnyder whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis
AT batjaemesquita whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis
AT evaeceulemans whatshamperingmeasurementinvariancedetectingnoninvariantitemsusingclusterwisesimultaneouscomponentanalysis
_version_ 1725926348294193152