4.5 Article

Is less more? A commentary on the practice of 'metric hacking' in animal social network analysis

Journal

ANIMAL BEHAVIOUR
Volume 168, Issue -, Pages 109-120

Publisher

ACADEMIC PRESS LTD- ELSEVIER SCIENCE LTD
DOI: 10.1016/j.anbehav.2020.08.011

Keywords

collinearity; HARKing; metric hacking; multiple comparison; social network metric

Funding

  1. Vanier Canada Graduate Scholarship
  2. Natural Sciences and Engineering Research Council of Canada

Ask authors/readers for more resources

The use of social network analysis to quantify animal social relationships has increased exponentially over the last two decades. A popular aspect of social network analysis is the use of individually based network metrics. Despite the diversity of social network metrics that exist and the large number of studies that generate network metrics, little guidance exists on the number and type of metrics that should be analysed in a single study. Here, we comment on the 'hypothesize after results are known' (HARKing) phenomenon in the context of social network analysis, a practice that we term 'metric hacking' and define as the use of statistical criteria to select which metrics to use rather than a priori choice based on a research hypothesis. We identify three situations where metric hacking can occur in studies quantifying social network metrics: (1) covariance among network metrics as explanatory variables in the same model; (2) covariance among network metrics as response variables in multiple models; and (3) covariance between response and explanatory variables in the same model. We outline several quantitative and qualitative issues associated with metric hacking, provide alternative options and guidance on the appropriate use of multiple network metrics to avoid metric hacking. By increasing awareness of the use of multiple social network metrics, we hope to encourage better practice for the selection and use of social network metrics in animal social network analysis. 2020 The Association for the Study of Animal Behaviour. (C) Published by Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

No Data Available
No Data Available