The role of automated categorization in e-government information retrieval

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

Abstract

High-precision search results are essential for helping e-government employees complete work-based tasks. Prior studies have shown that existing features of e-government systems need improvement in terms of search facilities, navigation, and metadata adoption. This paper investigates how automated categorization can enhance information organization and retrieval and presents the results of a controlled evaluation that compared automated categorization and free text indexing of the government intranet used by Danish tax authorities. Thirty-two individuals participated in the evaluation, conducting simulated searches and genuine search tasks. Searching behaviour and search outcome was documented by search logs, relevance assessments, and post search interviews.
The evaluation demonstrates a high potential for automated categorization in a government context. Overall, the categorized organization generated more reformulations and less query success. Session success was found to be fairly even between the two systems. Qualitative data revealed that categorized overviews of the search results were useful if the participating employee did not possess extensive knowledge of the task at hand. When task knowledge was present, categorization was used to support the assumptions of a correct search. On the other hand, however, test participants avoided using automated categorization if high-precision documents were among the top results or if few documents were retrieved. The findings emphasize the importance of simultaneously providing different search options for e-government IR systems and reveal that automated categorization is a valuable candidate for improving search facilities within this domain
Original languageEnglish
Title of host publicationProceedings of the ISKO UK 3rd Biennial Conference
Number of pages17
PublisherISKO UK
Publication date2013
Publication statusPublished - 2013
EventISKO UK Conference - London, United Kingdom
Duration: 8 Jul 20139 Jul 2013
http://www.iskouk.org/conf2013/

Conference

ConferenceISKO UK Conference
CountryUnited Kingdom
CityLondon
Period08/07/201309/07/2013
Internet address

Cite this

Jonasen, T. S., & Lykke, M. (2013). The role of automated categorization in e-government information retrieval. In Proceedings of the ISKO UK 3rd Biennial Conference ISKO UK.
@inproceedings{25e340ac966a42189715df445d678d2a,
title = "The role of automated categorization in e-government information retrieval",
abstract = "High-precision search results are essential for helping e-government employees complete work-based tasks. Prior studies have shown that existing features of e-government systems need improvement in terms of search facilities, navigation, and metadata adoption. This paper investigates how automated categorization can enhance information organization and retrieval and presents the results of a controlled evaluation that compared automated categorization and free text indexing of the government intranet used by Danish tax authorities. Thirty-two individuals participated in the evaluation, conducting simulated searches and genuine search tasks. Searching behaviour and search outcome was documented by search logs, relevance assessments, and post search interviews. The evaluation demonstrates a high potential for automated categorization in a government context. Overall, the categorized organization generated more reformulations and less query success. Session success was found to be fairly even between the two systems. Qualitative data revealed that categorized overviews of the search results were useful if the participating employee did not possess extensive knowledge of the task at hand. When task knowledge was present, categorization was used to support the assumptions of a correct search. On the other hand, however, test participants avoided using automated categorization if high-precision documents were among the top results or if few documents were retrieved. The findings emphasize the importance of simultaneously providing different search options for e-government IR systems and reveal that automated categorization is a valuable candidate for improving search facilities within this domain",
author = "Jonasen, {Tanja Svarre} and Marianne Lykke",
year = "2013",
language = "English",
booktitle = "Proceedings of the ISKO UK 3rd Biennial Conference",
publisher = "ISKO UK",

}

Jonasen, TS & Lykke, M 2013, The role of automated categorization in e-government information retrieval. in Proceedings of the ISKO UK 3rd Biennial Conference. ISKO UK, ISKO UK Conference, London, United Kingdom, 08/07/2013.

The role of automated categorization in e-government information retrieval. / Jonasen, Tanja Svarre; Lykke, Marianne.

Proceedings of the ISKO UK 3rd Biennial Conference. ISKO UK, 2013.

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - The role of automated categorization in e-government information retrieval

AU - Jonasen, Tanja Svarre

AU - Lykke, Marianne

PY - 2013

Y1 - 2013

N2 - High-precision search results are essential for helping e-government employees complete work-based tasks. Prior studies have shown that existing features of e-government systems need improvement in terms of search facilities, navigation, and metadata adoption. This paper investigates how automated categorization can enhance information organization and retrieval and presents the results of a controlled evaluation that compared automated categorization and free text indexing of the government intranet used by Danish tax authorities. Thirty-two individuals participated in the evaluation, conducting simulated searches and genuine search tasks. Searching behaviour and search outcome was documented by search logs, relevance assessments, and post search interviews. The evaluation demonstrates a high potential for automated categorization in a government context. Overall, the categorized organization generated more reformulations and less query success. Session success was found to be fairly even between the two systems. Qualitative data revealed that categorized overviews of the search results were useful if the participating employee did not possess extensive knowledge of the task at hand. When task knowledge was present, categorization was used to support the assumptions of a correct search. On the other hand, however, test participants avoided using automated categorization if high-precision documents were among the top results or if few documents were retrieved. The findings emphasize the importance of simultaneously providing different search options for e-government IR systems and reveal that automated categorization is a valuable candidate for improving search facilities within this domain

AB - High-precision search results are essential for helping e-government employees complete work-based tasks. Prior studies have shown that existing features of e-government systems need improvement in terms of search facilities, navigation, and metadata adoption. This paper investigates how automated categorization can enhance information organization and retrieval and presents the results of a controlled evaluation that compared automated categorization and free text indexing of the government intranet used by Danish tax authorities. Thirty-two individuals participated in the evaluation, conducting simulated searches and genuine search tasks. Searching behaviour and search outcome was documented by search logs, relevance assessments, and post search interviews. The evaluation demonstrates a high potential for automated categorization in a government context. Overall, the categorized organization generated more reformulations and less query success. Session success was found to be fairly even between the two systems. Qualitative data revealed that categorized overviews of the search results were useful if the participating employee did not possess extensive knowledge of the task at hand. When task knowledge was present, categorization was used to support the assumptions of a correct search. On the other hand, however, test participants avoided using automated categorization if high-precision documents were among the top results or if few documents were retrieved. The findings emphasize the importance of simultaneously providing different search options for e-government IR systems and reveal that automated categorization is a valuable candidate for improving search facilities within this domain

M3 - Article in proceeding

BT - Proceedings of the ISKO UK 3rd Biennial Conference

PB - ISKO UK

ER -

Jonasen TS, Lykke M. The role of automated categorization in e-government information retrieval. In Proceedings of the ISKO UK 3rd Biennial Conference. ISKO UK. 2013