TY - GEN
T1 - Hyphe, a curation-oriented approach to web crawling for the social sciences
AU - Jacomy, Mathieu
AU - Girard, Paul
AU - Ooghe-Tabanou, Benjamin
AU - Venturini, Tommaso
PY - 2016/1/1
Y1 - 2016/1/1
N2 - The web is a field of investigation for social sciences, and platform-based studies have long proven their relevance. However the generic web is rarely studied in itself though it contains crucial aspects of the embodiment of social actors: personal blogs, institutional websites, hobby-specific media? We realized that some sociologists see existing web crawlers as "black boxes" unsuitable for research though they are willing to study the broad web. In this paper we present Hyphe, a crawler developed with and for social scientists, with an innovative "curation-oriented" approach. We expose the problems of using web-mining techniques in social science research and how to overcome those by specific features such as step-by-step corpus building and a memory structure allowing researchers to redefine dynamically the granularity of their "web entities".
AB - The web is a field of investigation for social sciences, and platform-based studies have long proven their relevance. However the generic web is rarely studied in itself though it contains crucial aspects of the embodiment of social actors: personal blogs, institutional websites, hobby-specific media? We realized that some sociologists see existing web crawlers as "black boxes" unsuitable for research though they are willing to study the broad web. In this paper we present Hyphe, a crawler developed with and for social scientists, with an innovative "curation-oriented" approach. We expose the problems of using web-mining techniques in social science research and how to overcome those by specific features such as step-by-step corpus building and a memory structure allowing researchers to redefine dynamically the granularity of their "web entities".
UR - http://www.scopus.com/inward/record.url?scp=84979520735&partnerID=8YFLogxK
M3 - Article in proceeding
AN - SCOPUS:84979520735
T3 - Proceedings of the 10th International Conference on Web and Social Media, ICWSM 2016
SP - 595
EP - 598
BT - Proceedings of the 10th International Conference on Web and Social Media, ICWSM 2016
PB - AAAI Press
T2 - 10th International Conference on Web and Social Media, ICWSM 2016
Y2 - 17 May 2016 through 20 May 2016
ER -