Abstract: COMET (COordinated Multimedia Explanation Testbed) is a research system that we are dev... more Abstract: COMET (COordinated Multimedia Explanation Testbed) is a research system that we are developing to explore the coordinated generation of multimedia explanations of equipment maintenance and repair procedures. The form and content of all material presented is generated interactively, with an emphasis on coordinating multiple media to allow cross-references between media and to make possible display layout that reflects the fine-grain relationships among the material presented.
Abstract We present our preliminary work in developing augmented reality systems to improve metho... more Abstract We present our preliminary work in developing augmented reality systems to improve methods for the construction, inspection, and renovation of architectural structures. Augmented reality systems add virtual computer-generated material to the surrounding physical world. Our augmented reality systems use see-through head-worn displays to overlay graphics and sounds on a person's naturally occurring vision and hearing.
Abstract Many graphic tasks, such as the manipulation of graphical objects and the construction o... more Abstract Many graphic tasks, such as the manipulation of graphical objects and the construction of user-interface widgets, can be facilitated by geometric constraints. However, the difficulty of specifying constraints by traditional methods forms a barrier to their widespread use. In order to make constraints easier to declare, we have developed a method of specifying constraints implicitly, through multiple examples.
Abstract: The goal of this chapter is to provide a high-level overview of fifteen years of augmen... more Abstract: The goal of this chapter is to provide a high-level overview of fifteen years of augmented reality research that was sponsored by the US Office of Naval Research (ONR). The research was conducted at Columbia University and the US Naval Research Laboratory (NRL) between 1991 and 2005 and supported in the later years by a number of university and industrial research laboratories.
Abstract An explanation system developed to overcome the disadvantages of conventional authoring ... more Abstract An explanation system developed to overcome the disadvantages of conventional authoring in multimedia applications is presented. This experimental test bed for the automated generation of multimedia explanations is called COMET (coordinated multimedia explanation testbed), and has as its goal the coordinated, interactive generation of explanations that combine text and three-dimensional graphics, all of which is generated on the fly.
Abstract The awareness that hospital patients have of the people and events surrounding their car... more Abstract The awareness that hospital patients have of the people and events surrounding their care has a dramatic impact on satisfaction and clinical outcomes. However, patients are often under-informed about even basic aspects of their care. In this work, we hypothesize that mobile devices-which are increasingly available to patients-can be used as real-time information conduits to improve patient awareness and consequently improve patient care.
Tracking accuracy in a location-aware mobile system can change dynamically as a function of the u... more Tracking accuracy in a location-aware mobile system can change dynamically as a function of the user's location and other variables specific to the tracking technologies used. This is especially problematic for mobile augmented reality systems, which ideally require extremely precise position tracking for the user's head, but which may not always be able to achieve that level of accuracy.
This article summarizes the main results of a joint endeavor towards a standard reference model (... more This article summarizes the main results of a joint endeavor towards a standard reference model (SRM) for intelligent multimedia presentation systems (IMMPSs). After a brief motivation, we give basic definitions for media terms and presentation systems. The core of this contribution is a generic reference architecture that reflects an implementation-independent view of the processes required for the generation of multimedia presentations.
Abstract The fields of health services, medical informatics, and human���computer interaction hav... more Abstract The fields of health services, medical informatics, and human���computer interaction have begun to investigate electronic approaches to providing detailed health information to patients. Building on a custom Personal Health Record portal infrastructure that we have developed to provide access to real-time medication information for hospitalized patients, we are currently engaging clinicians and patients in user-centered design sessions to explore patient-friendly views of the information.
ABSTRACT LeafView is a Tablet-PC���based user interface for automated identification of botanical... more ABSTRACT LeafView is a Tablet-PC���based user interface for automated identification of botanical species in the field, developed for the Columbia, University of Maryland and Smithsonian Electronic Field Guide Project. Leaf images are captured with a digital camera and wirelessly transferred to the tablet. A computer vision component developed by our colleagues finds the best set of matching species, and we present the results in a zoomable user interface.
ABSTRACT We present our thoughts on the development and evaluation of novel interaction technique... more ABSTRACT We present our thoughts on the development and evaluation of novel interaction techniques for mixed reality (MR) systems, particularly those consisting of a heterogeneous mix of displays, devices, and users. Interaction work in MR has predominantly focused on two areas: glove or wand-based virtual reality (VR) interactions and tangible user interfaces.
Abstract Hybrid user interfaces are a promising paradigm for human-computer interaction, employin... more Abstract Hybrid user interfaces are a promising paradigm for human-computer interaction, employing a range of displays and devices. However, most experimental hybrid user interfaces use a relatively rigid configuation. Our demo explores the possibilities of end users configuring the setup of a hybrid user interface, using novel interaction techniques and visualizations, based on a shared augmented reality.
Abstract Information in hybrid user interfaces can be spread over a variety of different, but com... more Abstract Information in hybrid user interfaces can be spread over a variety of different, but complementary, displays, with which users interact through a potentially equally varied range of interaction devices. Since the exact configuration of these displays and devices may not be known in advance, it is desirable for users to be able to reconfigure at runtime the dataflow between interaction devices and objects on the displays.
Abstract We introduce an input system that is based on bidirectional strokes that are segmented b... more Abstract We introduce an input system that is based on bidirectional strokes that are segmented by tactile landmarks. By giving the user tactile feedback about the length of a stroke during input, we decrease the dependence of the GUI on the visual display. By concatenating separate strokes into multistrokes, complex commands may be entered, which may encode commands, data content, or both simultaneously. To demonstrate their power, we show how multistrokes can be used to traverse a menu hierarchy quickly.
Abstract Time-series graphs are often used to visualize phenomena that change over time. Common t... more Abstract Time-series graphs are often used to visualize phenomena that change over time. Common tasks include comparing values at different points in time and searching for specified patterns, either exact or approximate. However, tools that support time-series graphs typically separate query specification from the actual search process, allowing users to adapt the level of similarity only after specifying the pattern.
Abstract Layout refers to the process of determining the size and position of the visual objects ... more Abstract Layout refers to the process of determining the size and position of the visual objects in an information presentation. We introduce the WeightMap, a bitmap representation of the visual weight of a presentation. In addition, we present algorithms that use WeightMaps to allow an automated layout system to evaluate the effectiveness of its layouts. Our approach is based on the concepts of visual weight and visual balance, which are fundamental to the visual arts.
Abstract We present< i> content-aware free-space transparency</i>, an approach to viewing and man... more Abstract We present< i> content-aware free-space transparency</i>, an approach to viewing and manipulating the otherwise hidden content of obscured windows through unimportant regions of overlapping windows. Traditional approaches to interacting with otherwise obscured content in a window system render an entire window uniformly transparent.
We present a technique for dynamically directing a viewer's attention to a focus object by analyz... more We present a technique for dynamically directing a viewer's attention to a focus object by analyzing and modulating bottom-up salient features of a video feed. Rather than applying a static modulation strategy, we inspect the original image's saliency map, and modify the image automatically to favor the focus object. Image fragments are adaptively darkened, lightened and manipulated in hue according to local contrast information rather than global parameters.
Abstract: COMET (COordinated Multimedia Explanation Testbed) is a research system that we are dev... more Abstract: COMET (COordinated Multimedia Explanation Testbed) is a research system that we are developing to explore the coordinated generation of multimedia explanations of equipment maintenance and repair procedures. The form and content of all material presented is generated interactively, with an emphasis on coordinating multiple media to allow cross-references between media and to make possible display layout that reflects the fine-grain relationships among the material presented.
Abstract We present our preliminary work in developing augmented reality systems to improve metho... more Abstract We present our preliminary work in developing augmented reality systems to improve methods for the construction, inspection, and renovation of architectural structures. Augmented reality systems add virtual computer-generated material to the surrounding physical world. Our augmented reality systems use see-through head-worn displays to overlay graphics and sounds on a person's naturally occurring vision and hearing.
Abstract Many graphic tasks, such as the manipulation of graphical objects and the construction o... more Abstract Many graphic tasks, such as the manipulation of graphical objects and the construction of user-interface widgets, can be facilitated by geometric constraints. However, the difficulty of specifying constraints by traditional methods forms a barrier to their widespread use. In order to make constraints easier to declare, we have developed a method of specifying constraints implicitly, through multiple examples.
Abstract: The goal of this chapter is to provide a high-level overview of fifteen years of augmen... more Abstract: The goal of this chapter is to provide a high-level overview of fifteen years of augmented reality research that was sponsored by the US Office of Naval Research (ONR). The research was conducted at Columbia University and the US Naval Research Laboratory (NRL) between 1991 and 2005 and supported in the later years by a number of university and industrial research laboratories.
Abstract An explanation system developed to overcome the disadvantages of conventional authoring ... more Abstract An explanation system developed to overcome the disadvantages of conventional authoring in multimedia applications is presented. This experimental test bed for the automated generation of multimedia explanations is called COMET (coordinated multimedia explanation testbed), and has as its goal the coordinated, interactive generation of explanations that combine text and three-dimensional graphics, all of which is generated on the fly.
Abstract The awareness that hospital patients have of the people and events surrounding their car... more Abstract The awareness that hospital patients have of the people and events surrounding their care has a dramatic impact on satisfaction and clinical outcomes. However, patients are often under-informed about even basic aspects of their care. In this work, we hypothesize that mobile devices-which are increasingly available to patients-can be used as real-time information conduits to improve patient awareness and consequently improve patient care.
Tracking accuracy in a location-aware mobile system can change dynamically as a function of the u... more Tracking accuracy in a location-aware mobile system can change dynamically as a function of the user's location and other variables specific to the tracking technologies used. This is especially problematic for mobile augmented reality systems, which ideally require extremely precise position tracking for the user's head, but which may not always be able to achieve that level of accuracy.
This article summarizes the main results of a joint endeavor towards a standard reference model (... more This article summarizes the main results of a joint endeavor towards a standard reference model (SRM) for intelligent multimedia presentation systems (IMMPSs). After a brief motivation, we give basic definitions for media terms and presentation systems. The core of this contribution is a generic reference architecture that reflects an implementation-independent view of the processes required for the generation of multimedia presentations.
Abstract The fields of health services, medical informatics, and human���computer interaction hav... more Abstract The fields of health services, medical informatics, and human���computer interaction have begun to investigate electronic approaches to providing detailed health information to patients. Building on a custom Personal Health Record portal infrastructure that we have developed to provide access to real-time medication information for hospitalized patients, we are currently engaging clinicians and patients in user-centered design sessions to explore patient-friendly views of the information.
ABSTRACT LeafView is a Tablet-PC���based user interface for automated identification of botanical... more ABSTRACT LeafView is a Tablet-PC���based user interface for automated identification of botanical species in the field, developed for the Columbia, University of Maryland and Smithsonian Electronic Field Guide Project. Leaf images are captured with a digital camera and wirelessly transferred to the tablet. A computer vision component developed by our colleagues finds the best set of matching species, and we present the results in a zoomable user interface.
ABSTRACT We present our thoughts on the development and evaluation of novel interaction technique... more ABSTRACT We present our thoughts on the development and evaluation of novel interaction techniques for mixed reality (MR) systems, particularly those consisting of a heterogeneous mix of displays, devices, and users. Interaction work in MR has predominantly focused on two areas: glove or wand-based virtual reality (VR) interactions and tangible user interfaces.
Abstract Hybrid user interfaces are a promising paradigm for human-computer interaction, employin... more Abstract Hybrid user interfaces are a promising paradigm for human-computer interaction, employing a range of displays and devices. However, most experimental hybrid user interfaces use a relatively rigid configuation. Our demo explores the possibilities of end users configuring the setup of a hybrid user interface, using novel interaction techniques and visualizations, based on a shared augmented reality.
Abstract Information in hybrid user interfaces can be spread over a variety of different, but com... more Abstract Information in hybrid user interfaces can be spread over a variety of different, but complementary, displays, with which users interact through a potentially equally varied range of interaction devices. Since the exact configuration of these displays and devices may not be known in advance, it is desirable for users to be able to reconfigure at runtime the dataflow between interaction devices and objects on the displays.
Abstract We introduce an input system that is based on bidirectional strokes that are segmented b... more Abstract We introduce an input system that is based on bidirectional strokes that are segmented by tactile landmarks. By giving the user tactile feedback about the length of a stroke during input, we decrease the dependence of the GUI on the visual display. By concatenating separate strokes into multistrokes, complex commands may be entered, which may encode commands, data content, or both simultaneously. To demonstrate their power, we show how multistrokes can be used to traverse a menu hierarchy quickly.
Abstract Time-series graphs are often used to visualize phenomena that change over time. Common t... more Abstract Time-series graphs are often used to visualize phenomena that change over time. Common tasks include comparing values at different points in time and searching for specified patterns, either exact or approximate. However, tools that support time-series graphs typically separate query specification from the actual search process, allowing users to adapt the level of similarity only after specifying the pattern.
Abstract Layout refers to the process of determining the size and position of the visual objects ... more Abstract Layout refers to the process of determining the size and position of the visual objects in an information presentation. We introduce the WeightMap, a bitmap representation of the visual weight of a presentation. In addition, we present algorithms that use WeightMaps to allow an automated layout system to evaluate the effectiveness of its layouts. Our approach is based on the concepts of visual weight and visual balance, which are fundamental to the visual arts.
Abstract We present< i> content-aware free-space transparency</i>, an approach to viewing and man... more Abstract We present< i> content-aware free-space transparency</i>, an approach to viewing and manipulating the otherwise hidden content of obscured windows through unimportant regions of overlapping windows. Traditional approaches to interacting with otherwise obscured content in a window system render an entire window uniformly transparent.
We present a technique for dynamically directing a viewer's attention to a focus object by analyz... more We present a technique for dynamically directing a viewer's attention to a focus object by analyzing and modulating bottom-up salient features of a video feed. Rather than applying a static modulation strategy, we inspect the original image's saliency map, and modify the image automatically to favor the focus object. Image fragments are adaptively darkened, lightened and manipulated in hue according to local contrast information rather than global parameters.
Uploads
Papers by Steven Feiner