ArcForm - A multimodal notation

Research output: Contribution to conference without publisher/journalConference abstract for conferenceResearchpeer-review

Abstract

ArcForm (AF) is a visual notation based on a new graph-like network structure.
It supports a unique approach to labeling arcs and nodes to allow diverse and grammatically normal English (or other natural language) sentences to be embedded in the network (Allsopp, 2013). In doing this AF combines the familiarity and expressiveness of written natural language with the visuospatial intuition of navigating geographical maps. Thus AF simultaneously exploits visual, textual, linguistic and spatial modalities.

In static representations AF seems to have various benefits. We believe that AF’s multiple modalities support better overview, aid memory and facilitate forming new insights. At the same time, AF’s closeness to natural language allows it to remain cross-domain and multipurpose. However AF is not limited to static representations and is designed to be supported digitally. Here we expect additional benefits. Multiple digital AF maps can be dynamically merged into larger maps without duplication. This process can be repeated to massively integrate diverse information into a single network. Drawn in 2D or 3D space this becomes a seamless multimodal landscape. Applying filters, layout algorithms and styling of individual nodes and arcs will allow us to create new perspectives on the underlying information.

This presentation will use multiple visual examples to show how AF achieves its many affordances. We will discuss how it has been used in education research (Misfeldt 2016) and how it could be used as a notational foundation for e-learning platforms (Allsopp 2015). We will explore a prototype supporting basic interaction with the landscape and consider how it can benefit from virtual reality, online social curating and the block chain.
Original languageEnglish
Publication date7 Dec 2016
Number of pages1
Publication statusPublished - 7 Dec 2016
Event8th International Conference on Multimodality - University of Cape Town (moved to Newlands), Cape Town, South Africa
Duration: 7 Dec 20169 Dec 2016
http://www.8icom.co.za/

Conference

Conference8th International Conference on Multimodality
LocationUniversity of Cape Town (moved to Newlands)
CountrySouth Africa
CityCape Town
Period07/12/201609/12/2016
Internet address

Fingerprint

Linguistics
Labeling
Virtual reality
Education
Data storage equipment

Keywords

  • Multimodal
  • Notation
  • Non-linear

Cite this

Allsopp, B. B. (2016). ArcForm - A multimodal notation. Abstract from 8th International Conference on Multimodality, Cape Town, South Africa.
Allsopp, Benjamin Brink. / ArcForm - A multimodal notation. Abstract from 8th International Conference on Multimodality, Cape Town, South Africa.1 p.
@conference{024bd0c1e7384bfabe7c9ff9d61b34ab,
title = "ArcForm - A multimodal notation",
abstract = "ArcForm (AF) is a visual notation based on a new graph-like network structure.It supports a unique approach to labeling arcs and nodes to allow diverse and grammatically normal English (or other natural language) sentences to be embedded in the network (Allsopp, 2013). In doing this AF combines the familiarity and expressiveness of written natural language with the visuospatial intuition of navigating geographical maps. Thus AF simultaneously exploits visual, textual, linguistic and spatial modalities. In static representations AF seems to have various benefits. We believe that AF’s multiple modalities support better overview, aid memory and facilitate forming new insights. At the same time, AF’s closeness to natural language allows it to remain cross-domain and multipurpose. However AF is not limited to static representations and is designed to be supported digitally. Here we expect additional benefits. Multiple digital AF maps can be dynamically merged into larger maps without duplication. This process can be repeated to massively integrate diverse information into a single network. Drawn in 2D or 3D space this becomes a seamless multimodal landscape. Applying filters, layout algorithms and styling of individual nodes and arcs will allow us to create new perspectives on the underlying information. This presentation will use multiple visual examples to show how AF achieves its many affordances. We will discuss how it has been used in education research (Misfeldt 2016) and how it could be used as a notational foundation for e-learning platforms (Allsopp 2015). We will explore a prototype supporting basic interaction with the landscape and consider how it can benefit from virtual reality, online social curating and the block chain.",
keywords = "Multimodal, Notation, Non-linear",
author = "Allsopp, {Benjamin Brink}",
year = "2016",
month = "12",
day = "7",
language = "English",
note = "8th International Conference on Multimodality ; Conference date: 07-12-2016 Through 09-12-2016",
url = "http://www.8icom.co.za/",

}

Allsopp, BB 2016, 'ArcForm - A multimodal notation' 8th International Conference on Multimodality, Cape Town, South Africa, 07/12/2016 - 09/12/2016, .

ArcForm - A multimodal notation. / Allsopp, Benjamin Brink.

2016. Abstract from 8th International Conference on Multimodality, Cape Town, South Africa.

Research output: Contribution to conference without publisher/journalConference abstract for conferenceResearchpeer-review

TY - ABST

T1 - ArcForm - A multimodal notation

AU - Allsopp, Benjamin Brink

PY - 2016/12/7

Y1 - 2016/12/7

N2 - ArcForm (AF) is a visual notation based on a new graph-like network structure.It supports a unique approach to labeling arcs and nodes to allow diverse and grammatically normal English (or other natural language) sentences to be embedded in the network (Allsopp, 2013). In doing this AF combines the familiarity and expressiveness of written natural language with the visuospatial intuition of navigating geographical maps. Thus AF simultaneously exploits visual, textual, linguistic and spatial modalities. In static representations AF seems to have various benefits. We believe that AF’s multiple modalities support better overview, aid memory and facilitate forming new insights. At the same time, AF’s closeness to natural language allows it to remain cross-domain and multipurpose. However AF is not limited to static representations and is designed to be supported digitally. Here we expect additional benefits. Multiple digital AF maps can be dynamically merged into larger maps without duplication. This process can be repeated to massively integrate diverse information into a single network. Drawn in 2D or 3D space this becomes a seamless multimodal landscape. Applying filters, layout algorithms and styling of individual nodes and arcs will allow us to create new perspectives on the underlying information. This presentation will use multiple visual examples to show how AF achieves its many affordances. We will discuss how it has been used in education research (Misfeldt 2016) and how it could be used as a notational foundation for e-learning platforms (Allsopp 2015). We will explore a prototype supporting basic interaction with the landscape and consider how it can benefit from virtual reality, online social curating and the block chain.

AB - ArcForm (AF) is a visual notation based on a new graph-like network structure.It supports a unique approach to labeling arcs and nodes to allow diverse and grammatically normal English (or other natural language) sentences to be embedded in the network (Allsopp, 2013). In doing this AF combines the familiarity and expressiveness of written natural language with the visuospatial intuition of navigating geographical maps. Thus AF simultaneously exploits visual, textual, linguistic and spatial modalities. In static representations AF seems to have various benefits. We believe that AF’s multiple modalities support better overview, aid memory and facilitate forming new insights. At the same time, AF’s closeness to natural language allows it to remain cross-domain and multipurpose. However AF is not limited to static representations and is designed to be supported digitally. Here we expect additional benefits. Multiple digital AF maps can be dynamically merged into larger maps without duplication. This process can be repeated to massively integrate diverse information into a single network. Drawn in 2D or 3D space this becomes a seamless multimodal landscape. Applying filters, layout algorithms and styling of individual nodes and arcs will allow us to create new perspectives on the underlying information. This presentation will use multiple visual examples to show how AF achieves its many affordances. We will discuss how it has been used in education research (Misfeldt 2016) and how it could be used as a notational foundation for e-learning platforms (Allsopp 2015). We will explore a prototype supporting basic interaction with the landscape and consider how it can benefit from virtual reality, online social curating and the block chain.

KW - Multimodal

KW - Notation

KW - Non-linear

UR - http://www.8icom.co.za/images/8ICOM_Fri_Prog.pdf

M3 - Conference abstract for conference

ER -

Allsopp BB. ArcForm - A multimodal notation. 2016. Abstract from 8th International Conference on Multimodality, Cape Town, South Africa.