Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural Differences

Likert scale surveys are frequently used in cross-cultural studies on leadership. Recent publications using digital text algorithms raise doubt about the source of variation in statistics from such studies to the extent that they are semantically driven. The Semantic Theory of Survey Response (STSR)...

Full description

Bibliographic Details
Main Authors: Jan Ketil Arnulf, Kai R. Larsen
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-02-01
Series:Frontiers in Psychology
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fpsyg.2020.00176/full
id doaj-3c7adff31d364b6399c50217880ccdc1
record_format Article
spelling doaj-3c7adff31d364b6399c50217880ccdc12020-11-25T02:38:43ZengFrontiers Media S.A.Frontiers in Psychology1664-10782020-02-011110.3389/fpsyg.2020.00176487924Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural DifferencesJan Ketil Arnulf0Kai R. Larsen1Department of Leadership and Organizational Behavior, BI Norwegian Business School, Oslo, NorwayOrganizational Leadership and Information Analytics, Leeds School of Business, University of Colorado Boulder, Boulder, CO, United StatesLikert scale surveys are frequently used in cross-cultural studies on leadership. Recent publications using digital text algorithms raise doubt about the source of variation in statistics from such studies to the extent that they are semantically driven. The Semantic Theory of Survey Response (STSR) predicts that in the case of semantically determined answers, the response patterns may also be predictable across languages. The Multifactor Leadership Questionnaire (MLQ) was applied to 11 different ethnic samples in English, Norwegian, German, Urdu and Chinese. Semantic algorithms predicted responses significantly across all conditions, although to varying degree. Comparisons of Norwegian, German, Urdu and Chinese samples in native versus English language versions suggest that observed differences are not culturally dependent but caused by different translations and understanding. The maximum variance attributable to culture was a 5% unique overlap of variation in the two Chinese samples. These findings question the capability of traditional surveys to detect cultural differences. It also indicates that cross-cultural leadership research may risk lack of practical relevance.https://www.frontiersin.org/article/10.3389/fpsyg.2020.00176/fulllatent semantic analysisLikert scalescross-cultural studiesorganizational behaviorsemantic versus empirical problems
collection DOAJ
language English
format Article
sources DOAJ
author Jan Ketil Arnulf
Kai R. Larsen
spellingShingle Jan Ketil Arnulf
Kai R. Larsen
Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural Differences
Frontiers in Psychology
latent semantic analysis
Likert scales
cross-cultural studies
organizational behavior
semantic versus empirical problems
author_facet Jan Ketil Arnulf
Kai R. Larsen
author_sort Jan Ketil Arnulf
title Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural Differences
title_short Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural Differences
title_full Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural Differences
title_fullStr Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural Differences
title_full_unstemmed Culture Blind Leadership Research: How Semantically Determined Survey Data May Fail to Detect Cultural Differences
title_sort culture blind leadership research: how semantically determined survey data may fail to detect cultural differences
publisher Frontiers Media S.A.
series Frontiers in Psychology
issn 1664-1078
publishDate 2020-02-01
description Likert scale surveys are frequently used in cross-cultural studies on leadership. Recent publications using digital text algorithms raise doubt about the source of variation in statistics from such studies to the extent that they are semantically driven. The Semantic Theory of Survey Response (STSR) predicts that in the case of semantically determined answers, the response patterns may also be predictable across languages. The Multifactor Leadership Questionnaire (MLQ) was applied to 11 different ethnic samples in English, Norwegian, German, Urdu and Chinese. Semantic algorithms predicted responses significantly across all conditions, although to varying degree. Comparisons of Norwegian, German, Urdu and Chinese samples in native versus English language versions suggest that observed differences are not culturally dependent but caused by different translations and understanding. The maximum variance attributable to culture was a 5% unique overlap of variation in the two Chinese samples. These findings question the capability of traditional surveys to detect cultural differences. It also indicates that cross-cultural leadership research may risk lack of practical relevance.
topic latent semantic analysis
Likert scales
cross-cultural studies
organizational behavior
semantic versus empirical problems
url https://www.frontiersin.org/article/10.3389/fpsyg.2020.00176/full
work_keys_str_mv AT janketilarnulf cultureblindleadershipresearchhowsemanticallydeterminedsurveydatamayfailtodetectculturaldifferences
AT kairlarsen cultureblindleadershipresearchhowsemanticallydeterminedsurveydatamayfailtodetectculturaldifferences
_version_ 1724790087968882688