Skip to content

Research at St Andrews

Towards reproducibility in online social network research

Research output: Contribution to journalArticlepeer-review

Standard

Towards reproducibility in online social network research. / Hutton, Luke; Henderson, Tristan.

In: IEEE Transactions on Emerging Topics in Computing, Vol. 6, No. 1, 03.2018, p. 156-167.

Research output: Contribution to journalArticlepeer-review

Harvard

Hutton, L & Henderson, T 2018, 'Towards reproducibility in online social network research', IEEE Transactions on Emerging Topics in Computing, vol. 6, no. 1, pp. 156-167. https://doi.org/10.1109/TETC.2015.2458574

APA

Hutton, L., & Henderson, T. (2018). Towards reproducibility in online social network research. IEEE Transactions on Emerging Topics in Computing, 6(1), 156-167. https://doi.org/10.1109/TETC.2015.2458574

Vancouver

Hutton L, Henderson T. Towards reproducibility in online social network research. IEEE Transactions on Emerging Topics in Computing. 2018 Mar;6(1):156-167. https://doi.org/10.1109/TETC.2015.2458574

Author

Hutton, Luke ; Henderson, Tristan. / Towards reproducibility in online social network research. In: IEEE Transactions on Emerging Topics in Computing. 2018 ; Vol. 6, No. 1. pp. 156-167.

Bibtex - Download

@article{04b189bdc8964d1b931af296eebb808e,
title = "Towards reproducibility in online social network research",
abstract = "The challenge of conducting reproducible computational research is acknowledged across myriad disciplines from biology to computer science. In the latter, research leveraging online social networks (OSNs) must deal with a set of complex issues, such as ensuring data can be collected in an appropriate and reproducible manner. Making research reproducible is difficult, and researchers may need suitable incentives, and tools and systems, to do so. In this paper, we explore the state-of-the-art in OSN research reproducibility, and present an architecture to aid reproducibility. We characterize the reproducible OSN research using three main themes: 1) reporting of methods; 2) availability of code; and 3) sharing of research data. We survey 505 papers and assess the extent to which they achieve these reproducibility objectives. While systems-oriented papers are more likely to explain data-handling aspects of their methodology, social science papers are better at describing their participant-handling procedures. We then examine incentives to make research reproducible, by conducting a citation analysis of these papers. We find that sharing data are associated with increased citation count, while sharing method and code does not appear to be. Finally, we introduce our architecture which supports the conduct of reproducible OSN research, which we evaluate by replicating an existing research study.",
keywords = "Data sharing, Online social networks, Reproducibility, Survey",
author = "Luke Hutton and Tristan Henderson",
note = "This work was supported by the Engineering and Physical Sciences Research Council [grant number EP/J500549/1]. ",
year = "2018",
month = mar,
doi = "10.1109/TETC.2015.2458574",
language = "English",
volume = "6",
pages = "156--167",
journal = "IEEE Transactions on Emerging Topics in Computing",
issn = "2168-6750",
publisher = "IEEE Computer Society",
number = "1",

}

RIS (suitable for import to EndNote) - Download

TY - JOUR

T1 - Towards reproducibility in online social network research

AU - Hutton, Luke

AU - Henderson, Tristan

N1 - This work was supported by the Engineering and Physical Sciences Research Council [grant number EP/J500549/1].

PY - 2018/3

Y1 - 2018/3

N2 - The challenge of conducting reproducible computational research is acknowledged across myriad disciplines from biology to computer science. In the latter, research leveraging online social networks (OSNs) must deal with a set of complex issues, such as ensuring data can be collected in an appropriate and reproducible manner. Making research reproducible is difficult, and researchers may need suitable incentives, and tools and systems, to do so. In this paper, we explore the state-of-the-art in OSN research reproducibility, and present an architecture to aid reproducibility. We characterize the reproducible OSN research using three main themes: 1) reporting of methods; 2) availability of code; and 3) sharing of research data. We survey 505 papers and assess the extent to which they achieve these reproducibility objectives. While systems-oriented papers are more likely to explain data-handling aspects of their methodology, social science papers are better at describing their participant-handling procedures. We then examine incentives to make research reproducible, by conducting a citation analysis of these papers. We find that sharing data are associated with increased citation count, while sharing method and code does not appear to be. Finally, we introduce our architecture which supports the conduct of reproducible OSN research, which we evaluate by replicating an existing research study.

AB - The challenge of conducting reproducible computational research is acknowledged across myriad disciplines from biology to computer science. In the latter, research leveraging online social networks (OSNs) must deal with a set of complex issues, such as ensuring data can be collected in an appropriate and reproducible manner. Making research reproducible is difficult, and researchers may need suitable incentives, and tools and systems, to do so. In this paper, we explore the state-of-the-art in OSN research reproducibility, and present an architecture to aid reproducibility. We characterize the reproducible OSN research using three main themes: 1) reporting of methods; 2) availability of code; and 3) sharing of research data. We survey 505 papers and assess the extent to which they achieve these reproducibility objectives. While systems-oriented papers are more likely to explain data-handling aspects of their methodology, social science papers are better at describing their participant-handling procedures. We then examine incentives to make research reproducible, by conducting a citation analysis of these papers. We find that sharing data are associated with increased citation count, while sharing method and code does not appear to be. Finally, we introduce our architecture which supports the conduct of reproducible OSN research, which we evaluate by replicating an existing research study.

KW - Data sharing

KW - Online social networks

KW - Reproducibility

KW - Survey

U2 - 10.1109/TETC.2015.2458574

DO - 10.1109/TETC.2015.2458574

M3 - Article

VL - 6

SP - 156

EP - 167

JO - IEEE Transactions on Emerging Topics in Computing

JF - IEEE Transactions on Emerging Topics in Computing

SN - 2168-6750

IS - 1

ER -

Related by author

  1. Integrating the Data Protection Impact Assessment into the Software Development Lifecycle

    Irvine, C., Balasubramaniam, D. & Henderson, T., 17 Sep 2020, Proceedings of the 15th DPM International Workshop on Data Privacy Management.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  2. Data Protection for the Common Good: Developing a framework for a data protection-focused data commons

    Wong, J., Henderson, T. & Ball, K., 15 Sep 2020, Data for Policy Conference 2020.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

  3. Automating dynamic consent decisions for the processing of social media data in health research

    Norval, C. & Henderson, T., Jul 2020, In: Journal of Empirical Research on Human Research Ethics. 15, 3, p. 187-201

    Research output: Contribution to journalArticlepeer-review

  4. Data Protection, certification and the fourth industrial revolution

    Henderson, T. & Schafer, B., Sep 2019, Regulating Industrial Internet through IPR, Data Protection and Competition Law. Ballardini, R. M., Pitkänen, O. & Kuommamäki, P. (eds.). Alphen aan den Rijn, The Netherlands: Kluwer Law International

    Research output: Chapter in Book/Report/Conference proceedingChapter

ID: 163403775

Top