research-article

Knowledge-supported graphical illustration of texts

Authors:

K. Hartmann,

S. Schlechtweg,

R. Helbing,

Th. StrothotteAuthors Info & Claims

AVI '02: Proceedings of the Working Conference on Advanced Visual Interfaces

Pages 300 - 307

https://doi.org/10.1145/1556262.1556310

Published: 22 May 2002 Publication History

Get Access

Abstract

We introduce a new method to automatically and dynamically illustrate arbitrary texts from a predefined application domain. We demonstrate this method with two experimental systems (Text Illustrator and Agi³le) which are designed to illustrate anatomy textbooks.

Both systems exploit a symbolic representation of the content of structured geometric models. In addition, the approach taken by the Agi³le-system is based on an ontology providing a formal representation of important concepts within the application domain as well as a thesaurus containing alternative linguistic and visual realizations for entities within the formal domain representation.

The presented method is text-driven, i.e., an automated analysis of the morphologic, syntactic and semantic structures of noun phrases reveals the key concepts of a text portion to be illustrated. The specific relevance of entities within the formal representation is determined by a spreading activation approach. This allows to derive important parameters for a non-photorealistic rendering process: the selection of suitable geometric models, camera positions and presentation variables for individual geometric objects. Part-whole relations are considered to assign visual representations to elements of the formal domain representation. Presentation variables for objects in the 3D rendering are chosen to reflect the estimated relevance of their denotation.

As a result, expressive non-photorealistic illustrations which are focussed on the key concepts of individually selected text passages are generated automatically. Finally, we present methods to integrate user interaction within both media, the text and the computer-generated illustration, in order to adjust the presentation to individual information seeking goals.

References

[1]

S.-P. Ballstaedt. Wissensvermittlung. Die Gestaltung von Lernmaterial. Psychologie Verlags Union, Weinheim, 1997.

Google Scholar

[2]

M. Biezunski, M. Bryan, and S. Newcomb, editors. ISO/IEC 13250:2000 Topic Maps: Information Technology - Document Description and Markup Language. International Organization for Standarization (ISO) and International Electrotechnical Commission (IEC), Dec. 1999.

Google Scholar

[3]

A. Collins and E. Loftus. A Spreading-Activation Theory of Semantic Processing. Psychological Review, 82(6):407--428, 1975.

Crossref

Google Scholar

[4]

W. Finkler and G. Neumann. MORPHIX: A Fast Realization of a Classification-Based Approach to Morphology. In H. Trost, editor, Proc. der 4. Österreichischen Artificial-Intelligence Tagung, Wiener Workshop Wissensbasierte Sprachverarbeitung, pages 11--19. Springer Verlag, Berlin, Aug. 1988.

Google Scholar

[5]

R. MacGregor. A Description Classifier for the Predicate Calculus. In B. Hayes-Roth and R. Korf, editors, Proc. of the Twelfth Annual National Conference on Artificial Intelligence (AAAI-94), pages 213--220, Seattle, Washington, Aug., 1--4 1994. AAAI Press, Menlo Park.

Digital Library

Google Scholar

[6]

J. Peeck. The Role of Illustration in Processing and Remembering Illustrated Text. In H. Houghton and D. Willows, editors, The Psychology of Illustration, volume 1: Basic Research, chapter 4, pages 115--151. Springer Verlag, New York, 1987.

Google Scholar

[7]

S. Pepper and G. Moore, editors. XML Topic Maps (XTM) 1.0. TopicMaps.Org, 2001. http://www.topicmaps.org/xtm/.

Google Scholar

[8]

A. Rogers. Textbook of Anatomy. Churchill Livingstone, Edinburgh, 1992.

Google Scholar

[9]

S. Schlechtweg and T. Strothotte. Illustrative Browsing: A New Method of Browsing in Long On-line Texts. In M. Sasse and C. Johnson, editors, Computer Human Interaction. Proc. of INTERACT-99, pages 466--473, Edinburgh, Sept. 1999. IOS Press. Amsterdam.

Google Scholar

[10]

S. Schlechtweg and T. Strothotte. Generating Scientific Illustrations in Electronic Books. In Smart Graphics. Papers from the 2000 AAAI Spring Symposium (Stanford, March, 2000), pages 8--15, Menlo Park, 2000. AAAI Press.

Google Scholar

[11]

H. Schmid. Probabilistic Part-of-Speech Tagging Using Decision Trees. In D. Jones and H. Somers, editors, New Methods in Language Processing. ACL Press, London, 1997.

Google Scholar

[12]

M. Scholz. Technologische Bilder - Aspekte visueller Argumentation. PhD thesis, FB Design, Kunst und Medienpädagogik, Druck der Bergischen Universität-Gesamthochschule (BUGH) Wuppertal, Weimar, 2000.

Google Scholar

Cited By

View all

Liu SWang XCollins CDou WOuyang FEl-Assady MJiang LKeim D(2019)Bridging Text Visualization and Mining: A Task-Driven SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.283434125:7(2482-2504)Online publication date: 1-Jul-2019
https://doi.org/10.1109/TVCG.2018.2834341
Polys NBowman DNorth C(2011)The role of Depth and Gestalt cues in information-rich virtual environmentsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2010.05.00769:1-2(30-51)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1016/j.ijhcs.2010.05.007
Kuß AProhaska SMeyer BRybak JHege H(2008)Ontology-based visualization of hierarchical neuroanatomical structuresProceedings of the First Eurographics conference on Visual Computing for Biomedicine10.5555/2384008.2384036(177-184)Online publication date: 6-Oct-2008
https://dl.acm.org/doi/10.5555/2384008.2384036
Show More Cited By

Index Terms

Knowledge-supported graphical illustration of texts

Recommendations

Real-time pen-and-ink illustration of landscapes
NPAR '06: Proceedings of the 4th international symposium on Non-photorealistic animation and rendering

Non-photorealistic rendering has been proven to be particularly efficient in conveying and transmitting selected visual information. Our paper presents a NPR rendering pipeline that supports pen-and-ink illustration for, but not limited to, complex ...
Hardware-accelerated parallel non-photorealistic volume rendering
NPAR '02: Proceedings of the 2nd international symposium on Non-photorealistic animation and rendering

Non-photorealistic rendering can be used to illustrate subtle spatial relationships that might not be visible with more realistic rendering techniques. We present a parallel hardware-accelerated rendering technique, making extensive use of multi-...
Orientable textures for image-based pen-and-ink illustration
SIGGRAPH '97: Proceedings of the 24th annual conference on Computer graphics and interactive techniques

Comments

Information & Contributors

Information

Published In

AVI '02: Proceedings of the Working Conference on Advanced Visual Interfaces

May 2002

382 pages

ISBN:1581135378

DOI:10.1145/1556262

Editors:
Maria De Marsico
Universita di Roma "La Sapienza", Roma, Italy
,
Stefano Levialdi
Universita di Roma "La Sapienza", Roma, Italy
,
Emanuele Panizzi
Universita di Roma "La Sapienza", Roma, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 May 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AVI'02

Sponsor:

SIGCHI Italy
SIGMM
SIGCHI

AVI'02: Advanced Visual Interfaces

May 22 - 24, 2002

Trento, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
114
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liu SWang XCollins CDou WOuyang FEl-Assady MJiang LKeim D(2019)Bridging Text Visualization and Mining: A Task-Driven SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.283434125:7(2482-2504)Online publication date: 1-Jul-2019
https://doi.org/10.1109/TVCG.2018.2834341
Polys NBowman DNorth C(2011)The role of Depth and Gestalt cues in information-rich virtual environmentsInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2010.05.00769:1-2(30-51)Online publication date: 1-Jan-2011
https://dl.acm.org/doi/10.1016/j.ijhcs.2010.05.007
Kuß AProhaska SMeyer BRybak JHege H(2008)Ontology-based visualization of hierarchical neuroanatomical structuresProceedings of the First Eurographics conference on Visual Computing for Biomedicine10.5555/2384008.2384036(177-184)Online publication date: 6-Oct-2008
https://dl.acm.org/doi/10.5555/2384008.2384036
Mahler TFiedler SWeber M(2004)A Method for Smart Graphics in the WebSmart Graphics10.1007/978-3-540-24678-7_16(146-153)Online publication date: 2004
https://doi.org/10.1007/978-3-540-24678-7_16
Ritter FSonnet HHartmann KStrothotte TLeake DJohnson LAndre E(2003)Illustrative shadowsProceedings of the 8th international conference on Intelligent user interfaces10.1145/604045.604072(166-173)Online publication date: 12-Jan-2003
https://dl.acm.org/doi/10.1145/604045.604072
Hartmann KStrothotte TButz AKrueger AOlivier PSchlechtweg SZhou M(2002)A spreading activation approach to text illustrationProceedings of the 2nd international symposium on Smart graphics10.1145/569005.569012(39-46)Online publication date: 11-Jun-2002
https://dl.acm.org/doi/10.1145/569005.569012

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Real-time pen-and-ink illustration of landscapes

Hardware-accelerated parallel non-photorealistic volume rendering

Orientable textures for image-based pen-and-ink illustration

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations