Developing and evaluating annotation procedures for twitter data during hazard events

  • Kevin Stowe
  • , Martha Palmer
  • , Jennings Anderson
  • , Leysia Palen
  • , Kenneth M. Anderson
  • , Marina Kogan
  • , Rebecca Morss
  • , Julie Demuth
  • , Heather Lazrus

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

23 Scopus citations

Abstract

When a hazard such as a hurricane threatens, people are forced to make a wide variety of decisions, and the information they receive and produce can influence their own and others’ actions. As social media grows more popular, an increasing number of people are using social media platforms to obtain and share information about approaching threats and discuss their interpretations of the threat and their protective decisions. This work aims to improve understanding of natural disasters through social media and provide an annotation scheme to identify themes in user’s social media behavior and facilitate efforts in supervised machine learning. To that end, this work has three contributions: (1) the creation of an annotation scheme to consistently identify hazard-related themes in Twitter, (2) an overview of agreement rates and difficulties in identifying annotation categories, and (3) a public release of both the dataset and guidelines developed from this scheme.

Original languageEnglish
Title of host publicationLAW-MWE-CxG 2018 - Joint Workshop on Linguistic Annotation, Multiword Expressions and Constructions, Proceedings of the Workshop
PublisherAssociation for Computational Linguistics (ACL)
Pages133-143
Number of pages11
ISBN (Electronic)9781948087513
StatePublished - 2018
EventJoint Workshop on Linguistic Annotation, Multiword Expressions and Constructions, LAW-MWECxG 2018, in conjunction with the 27th International Conference on Computational Linguistics, COLING 2018 - Santa Fe, United States
Duration: Aug 25 2018Aug 26 2018

Publication series

NameLAW-MWE-CxG 2018 - Joint Workshop on Linguistic Annotation, Multiword Expressions and Constructions, Proceedings of the Workshop

Conference

ConferenceJoint Workshop on Linguistic Annotation, Multiword Expressions and Constructions, LAW-MWECxG 2018, in conjunction with the 27th International Conference on Computational Linguistics, COLING 2018
Country/TerritoryUnited States
CitySanta Fe
Period08/25/1808/26/18

Fingerprint

Dive into the research topics of 'Developing and evaluating annotation procedures for twitter data during hazard events'. Together they form a unique fingerprint.

Cite this