-
MetaCLUE: Towards Comprehensive Visual Metaphors Research
Authors:
Arjun R. Akula,
Brendan Driscoll,
Pradyumna Narayana,
Soravit Changpinyo,
Zhiwei Jia,
Suyash Damle,
Garima Pruthi,
Sugato Basu,
Leonidas Guibas,
William T. Freeman,
Yuanzhen Li,
Varun Jampani
Abstract:
Creativity is an indispensable part of human cognition and also an inherent part of how we make sense of the world. Metaphorical abstraction is fundamental in communicating creative ideas through nuanced relationships between abstract concepts such as feelings. While computer vision benchmarks and approaches predominantly focus on understanding and generating literal interpretations of images, met…
▽ More
Creativity is an indispensable part of human cognition and also an inherent part of how we make sense of the world. Metaphorical abstraction is fundamental in communicating creative ideas through nuanced relationships between abstract concepts such as feelings. While computer vision benchmarks and approaches predominantly focus on understanding and generating literal interpretations of images, metaphorical comprehension of images remains relatively unexplored. Towards this goal, we introduce MetaCLUE, a set of vision tasks on visual metaphor. We also collect high-quality and rich metaphor annotations (abstract objects, concepts, relationships along with their corresponding object boxes) as there do not exist any datasets that facilitate the evaluation of these tasks. We perform a comprehensive analysis of state-of-the-art models in vision and language based on our annotations, highlighting strengths and weaknesses of current approaches in visual metaphor Classification, Localization, Understanding (retrieval, question answering, captioning) and gEneration (text-to-image synthesis) tasks. We hope this work provides a concrete step towards developing AI systems with human-like creative capabilities.
△ Less
Submitted 2 June, 2023; v1 submitted 19 December, 2022;
originally announced December 2022.
-
Extrinsic Photodiodes for Integrated Mid-Infrared Silicon Photonics
Authors:
Richard R. Grote,
Brian Souhan,
Noam Ophir,
Jeffrey B. Driscoll,
Keren Bergman,
Hassaram Bakhru,
William M. J. Green,
Richard M. Osgood Jr
Abstract:
Silicon photonics has recently been proposed for a diverse set of applications at mid-infrared wavelengths, the implementation of which require on-chip photodetectors. In planar geometries, dopant-based extrinsic photoconductors have long been used for mid-infrared detection with Si and Ge acting as host materials. Leveraging the dopant-induced sub-bandgap trap-states used in bulk photoconductors…
▽ More
Silicon photonics has recently been proposed for a diverse set of applications at mid-infrared wavelengths, the implementation of which require on-chip photodetectors. In planar geometries, dopant-based extrinsic photoconductors have long been used for mid-infrared detection with Si and Ge acting as host materials. Leveraging the dopant-induced sub-bandgap trap-states used in bulk photoconductors for waveguide integrated mid-infrared detectors offers simple processing, integration, and operation throughout the mid-infrared by appropriate choice of dopant. In particular, Si doped with Zn forms two trap levels ~ 0.3 eV and ~ 0.58 eV above the valence band, and has been utilized extensively for cryogenically cooled bulk extrinsic photoconductors. In this letter, we present room temperature operation of Zn+ implanted Si waveguide photodiodes from 2200 nm to 2400 nm, with measured responsivities of up to 87 mA/W and low dark currents of < 10 microamps.
△ Less
Submitted 24 June, 2014;
originally announced June 2014.
-
Wavelength conversion and parametric amplification of optical pulses via quasi-phase-matched FWM in long-period Bragg silicon waveguides
Authors:
Spyros Lavdas,
Shuang Zhao,
Jeffrey B. Driscoll,
Richard R. Grote,
Richard M. Osgood,
Nicolae C. Panoiu
Abstract:
We present a theoretical analysis supported by comprehensive numerical simulations of quasi phase-matched four-wave mixing (FWM) of ultrashort optical pulses that propagate in weakly width-modulated silicon photonic nanowire gratings. Our study reveals that, by properly designing the optical waveguide such that the interacting pulses co-propagate with the same group-velocity, a conversion efficien…
▽ More
We present a theoretical analysis supported by comprehensive numerical simulations of quasi phase-matched four-wave mixing (FWM) of ultrashort optical pulses that propagate in weakly width-modulated silicon photonic nanowire gratings. Our study reveals that, by properly designing the optical waveguide such that the interacting pulses co-propagate with the same group-velocity, a conversion efficiency enhancement of more than 15 dB, as compared to a uniform waveguide, can readily be achieved. We also analyze the dependence of the conversion efficiency and FWM gain on the pulse width, time delay, walk-off parameter, and grating modulation depth.
△ Less
Submitted 28 May, 2014;
originally announced May 2014.
-
Generation of parabolic similaritons in tapered silicon photonic wires: comparison of pulse dynamics at telecom and mid-IR wavelengths
Authors:
Spyros Lavdas,
Jeffrey B. Driscoll,
Hongyi Jiang,
Richard R. Grote,
Richard M. Osgood, Jr.,
Nicolae C. Panoiu
Abstract:
We study the generation of parabolic self-similar optical pulses in tapered Si photonic nanowires (Si-PhNWs) both at telecom (λ=1.55 μm) and mid-IR (λ=2.2 μm) wavelengths. Our computational study is based on a rigorous theoretical model, which fully describes the influence of linear and nonlinear optical effects on pulse propagation in Si-PhNWs with arbitrarily varying width. Numerical simulations…
▽ More
We study the generation of parabolic self-similar optical pulses in tapered Si photonic nanowires (Si-PhNWs) both at telecom (λ=1.55 μm) and mid-IR (λ=2.2 μm) wavelengths. Our computational study is based on a rigorous theoretical model, which fully describes the influence of linear and nonlinear optical effects on pulse propagation in Si-PhNWs with arbitrarily varying width. Numerical simulations demonstrate that, in the normal dispersion regime, optical pulses evolve naturally into parabolic pulses upon propagating in millimeter-long tapered Si-PhNWs, with the efficiency of this pulse reshaping process being strongly dependent on the spectral and pulse parameter regime in which the device operates, as well as the particular shape of the Si-PhNW.
△ Less
Submitted 4 July, 2013;
originally announced July 2013.
