Abstract
This paper describes a multichannel acoustic data collection recorded under the European DICIT project, during Wizard of Oz (WOZ) experiments carried out at FAU and FBK-irst laboratories. The application of interest in DICIT is a distant-talking interface for control of interactive TV working in a typical living room, with many interfering devices. The objective of the experiments was to collect a database supporting efficient development and tuning of acoustic processing algorithms for signal enhancement. In DICIT, techniques for sound source localization, multichannel acoustic echo cancellation, blind source separation, speech activity detection, speaker identification and verification as well as beamforming are combined to achieve a maximum possible reduction of the user speech impairments typical of distant-talking interfaces. The collected database permitted to simulate at preliminary stage a realistic scenario and to tailor the involved algorithms to the observed user behaviors. In order to match the project requirements, the WOZ experiments were recorded in three languages: English, German and Italian. Besides the user inputs, the database also contains non-speech related acoustic events, room impulse response measurements and video data, the latter used to compute three-dimensional positions of each subject. Sessions were manually transcribed and segmented at word level, introducing also specific labels for acoustic events.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
For further details see: http://dicit.fbk.eu.
For further details see http://chil.server.de.
See http://eca.cx/ecasound/index.php for details.
See http://winlirc.sourceforge.net/ for details.
See http://trans.sourceforge.net/en/presentation.php for details.
References
Brayda, L., Bertotti, C., Cristoforetti, L., Omologo, M., & Svaizer, P. (2005). Modifications on NIST MarkIII array to improve coherence properties among input signals. In Proceedings of AES, 118th audio engineering society convention, Barcelona, Spain.
Cristoforetti, L., Omologo, M., Matassoni, M., Svaizer, P., & Zovato E. (2000). Annotation of a multichannel noisy speech corpus. In Proceedings of LREC 2000, Athens, Greece.
Furui, S. (1997). Recent advances in speaker recognition. Pattern Recognition Letters, 18, 859–872.
Goronzy, S., & Beringer, N. (2005). Integrated development and on-the-fly simulation of multimodal dialogs. In Proceedings of interspeech 2005, Lisbon, Portugal (pp. 2477–2480).
Huang, Y., & Benesty, J. (2004). Audio signal processing for next-generation multimedia communication systems. Boston: Kluwer.
Kellermann, W. (1991). A self-steering digital microphone array. In Proceedings of ICASSP 1991, Toronto, Canada.
Lanz, O. (2006). Approximate bayesian multibody tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28, 1436–1449.
Temko, A., Malkin, R., Nadieu, C., Zieger, C., Macho, D., & Omologo, M. (2006). CLEAR evaluation of acoustic event detection and classification systems. CLEAR’06 evaluation campaign and workshop. Southampton, UK: Springer.
Acknowledgments
This work was partially funded by the Commission of the European Community, Information Society Technologies (IST), FP6 IST-034624, under DICIT.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Brutti, A., Cristoforetti, L., Kellermann, W. et al. WOZ acoustic data collection for interactive TV. Lang Resources & Evaluation 44, 205–219 (2010). https://doi.org/10.1007/s10579-010-9116-x
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10579-010-9116-x