NARA Discovery
Article Details
← Back to Search Results
Journal Article

Common permutation methods in animal social network analysis do not control for non-independence

Jordan D. A. Hart; Michael N. Weiss; Lauren J. N. Brent; Daniel W. Franks
Behavioral Ecology and Sociobiology · Vol. 76, Issue 11 · 2022

Abstract

The non-independence of social network data is a cause for concern among behavioural ecologists conducting social network analysis. This has led to the adoption of several permutation-based methods for testing common hypotheses. One of the most common types of analysis is nodal regression, where the relationships between node-level network metrics and nodal covariates are analysed using a permutation technique known as node-label permutations. We show that, contrary to accepted wisdom, node-label permutations do not automatically account for the non-independences assumed to exist in network data, because regression-based permutation tests still assume exchangeability of residuals. The same assumption also applies to the quadratic assignment procedure (QAP), a permutation-based method often used for conducting dyadic regression. We highlight that node-label permutations produce the same p -values as equivalent parametric regression models, but that in the presence of non-independence, parametric regression models can also produce accurate effect size estimates. We also note that QAP only controls for a specific type of non-independence between edges that are connected to the same nodes, and that appropriate parametric regression models are also able to account for this type of non-independence. Based on this, we suggest that standard parametric models could be used in the place of permutation-based methods. Moving away from permutation-based methods could have several benefits, including reducing over-reliance on p- values, generating more reliable effect size estimates, and facilitating the adoption of causal inference methods and alternative types of statistical analysis.

Bibliographic Information

JournalBehavioral Ecology and Sociobiology
PublisherSpringer
Publication Date2022-11-01
Publication Year2022
Volume76
Issue11
Document TypeJournal Article
Print ISSN0340-5443
eISSN1432-0762
DOI10.1007/s00265-022-03254-x

Access Information

NARA Access Coverage1976-01-01~Current
Journal Homepagehttps://www.springer.com/journal/265
Publisher PageOpen Publisher Page
Full-text access depends on NARA's subscribed coverage and institutional access.