short-paper

FoodBoard: surface contact imaging for food recognition

Authors:

Daniel Jackson,

Johannes Schoening,

Tom Bartindale,

Patrick OlivierAuthors Info & Claims

UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing

Pages 749 - 752

https://doi.org/10.1145/2493432.2493522

Published: 08 September 2013 Publication History

Abstract

We describe FoodBoard, an instrumented chopping board that uses optical fibers and embedded camera imaging to identify unpackaged ingredients during food preparation on its surface. By embedding the sensing directly, and robustly, in the surface of a chopping board we also demonstrate how surface contact optical sensing can be used to realize the portability and privacy required of technology used in a setting such as a domestic kitchen. FoodBoard was subjected to a close to real-world evaluation in which 12 users prepared actual meals. FoodBoard compared favourably with existing unpackaged food recognition systems, classifying a larger number of distinct food ingredients (12 incl. meat, fruit, vegetables) with an average accuracy of 82.8%.

References

[1]

O. Amft, M. Staeger, P. Lukowicz, and G. Troester. (2005). Analysis of chewing sounds for dietary monitoring. In Proc. UbiComp.

Digital Library

[2]

H. Bay, A. Ess, T. Tuytelaars, and L. van Gool. (2008). Speeded-Up Robust Features (SURF). Comp. Vis. Image Underst. 110(3), 346--59.

Digital Library

[3]

C. Chang and J. C. Lin. (2011). LIBSVM : a library for support vector machines. ACM Trans. Intell. Systems and Technology, 2(27) 1--2.

Digital Library

[4]

J. Chen, A. H. Kam, J. Zhang, N. Liu, and L. Shue. (2005). Bathroom activity monitoring based on sound. In Proc. Pervasive.

Digital Library

[5]

R. Chincha and Y. Tian. (2011). Finding objects for blind people on SURF features. In Proc. BIBMW.

Digital Library

[6]

J. Hoey, T. Ploetz, D. Jackson, A. Monk, C. Pham, and P. Olivier,. (2011). Rapid specification and automated generation of prompting systems to assist people with dementia Pervasive and Mobile Computing (PMC), 7(3), 299--318.

Digital Library

[7]

C. Hooper, A. Preston, M. Balaam, P. Seedhouse, D. Jackson, C. Pham, C. Ladha, K. Ladha, T. Ploetz, and P. Olivier. (2012). The French Kitchen: Task-Based Learning in an Instrumented Kitchen. In Proc. UbiComp.

Digital Library

[8]

D. Jackson, T. Bartindale, and Patrick Olivier. (2009). FiberBoard: compact multi-touch display using channeled light. In Proc. ACM ITS.

Digital Library

[9]

T. Kanungo, D. M. Mount, N. S. Netanyahu, C. D. Piatko, R. Silver-man, and A. Y. Wu. (2002). An Efficient k-Means Clustering Algorithm: Analysis and Implementation. IEEE TPAMI, 24(7), 881--892.

Digital Library

[10]

K. Kitamura, T. Yamasaki, and K. Aizawa. (2009). FoodLog: capture, analysis and retrieval of personal food images via web. In Proc. ACM Multimedia Workshop Multimedia for Cooking and Eating Activities.

Digital Library

[11]

L. Kok-Meng., L. Q. Qiang, and D. Wayne. (2007). Effects of Classification Methods on Color-Based Feature Detection With Food Processing Applications. IEEE T-ASE, 4(1), 40--5

[12]

M. Kranz, A. Schmidt, B.Rusu, A. Maldonado, M. Beetz, B. Hornler, and G. Rigoll, (2007). Sensing Technologies and the Player-Middle-ware for Context-Awareness in Kitchen Environments. In Proc. INSS.

[13]

G. Shroff, A. Smailagic, and D. P. Siewiorek. (2008). Wearable con-text-aware food recognition for calorie monitoring. In Proc. ISWC.

Digital Library

[14]

D. N. Ta, W. C. Chen, N. Gelfand, and K. Pulli. (2009). SURFTrac: Efficient Tracking and Continuous Object recognition using Local Feature Descriptors. In Proc. CVPR.

[15]

P. Olivier, G. Xu, A. Monk, J. Hoey. (2009). Ambient kitchen: design-ing situated services using a high fidelity prototyping environment. In Proc. PETRA.

Digital Library

[16]

J. Wagner, A. van Halteren, J. Hoonhout, T. Ploetz, C. Pham, P. Moynihan, D. Jackson, C. Ladha, K. Ladha, and P. Olivier. (2011). Towards a Pervasive Kitchen Infrastructure for Measuring Cooking Competence. In Proc. PervasiveHealth.

[17]

S. Yang, M. Chen, D. Pomerleau, and R. Sukthankar. (2010). Food recognition using statistics of pairwise local features. In Proc. CVPR

Cited By

Gao HXu KCao MXiao JXu QYin Y(2022)The Deep Features and Attention Mechanism-Based Method to Dish Healthcare Under Social IoT Systems: An Empirical Study With a Hand-Deep Local–Global NetIEEE Transactions on Computational Social Systems10.1109/TCSS.2021.31025919:1(336-347)Online publication date: Feb-2022
https://doi.org/10.1109/TCSS.2021.3102591
Kumar Tripathi MMaktedar D(2019)A role of computer vision in fruits and vegetables among various horticulture products of agriculture fields: A SurveyInformation Processing in Agriculture10.1016/j.inpa.2019.07.003Online publication date: Jul-2019
https://doi.org/10.1016/j.inpa.2019.07.003
Rapp AMarcengo ABuriano LRuffo GLai MCena F(2018)Designing a personal informatics system for users without experience in self-tracking: a case studyBehaviour & Information Technology10.1080/0144929X.2018.143659237:4(335-366)Online publication date: 15-Feb-2018
https://doi.org/10.1080/0144929X.2018.1436592
Show More Cited By

Index Terms

FoodBoard: surface contact imaging for food recognition
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Digital Food Sensing and Ingredient Analysis Techniques to Facilitate Human-Food Interface Designs
Interactive technologies that shape the traditional human-food experiences are being explored under the emerging field of Human-Food Interaction (HFI). A key challenge in developing HFI technologies is the digital sensing of food, beverages, and their ...
PIC2DISH: A Customized Cooking Assistant System
MM '17: Proceedings of the 25th ACM international conference on Multimedia

The art of cooking is always fascinating. Nevertheless, reproducing a delicious dish that one has never encountered before is not easy. Even if the name of dish is known and the corresponding recipe could be retrieved, the right ingredients for cooking ...
Food Item Recognition and Intake Measurement Techniques
ICMLC '19: Proceedings of the 2019 11th International Conference on Machine Learning and Computing

High-calorie intake can be harmful and result in numerous diseases. Standard intake of a number of calories is fundamental for keeping the right balance of calories in the human body. Currently, some techniques allow users to estimate the calorie count ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing

September 2013

846 pages

ISBN:9781450317702

DOI:10.1145/2493432

General Chairs:
Friedemann Mattern
ETH Zurich, CH
,
Silvia Santini
TU Darmstadt, DE
,
Program Chairs:
John F. Canny
UC Berkeley, US
,
Marc Langheinrich
Università della Svizzera italiana, CH
,
Jun Rekimoto
University of Tokyo, JP

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
University of Florida: University of Florida
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

In-Cooperation

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

UbiComp '13

Sponsor:

SIGMOBILE
University of Florida
SIGCHI

UbiComp '13: The 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 8 - 12, 2013

Zurich, Switzerland

Acceptance Rates

UbiComp '13 Paper Acceptance Rate 92 of 394 submissions, 23%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
467
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gao HXu KCao MXiao JXu QYin Y(2022)The Deep Features and Attention Mechanism-Based Method to Dish Healthcare Under Social IoT Systems: An Empirical Study With a Hand-Deep Local–Global NetIEEE Transactions on Computational Social Systems10.1109/TCSS.2021.31025919:1(336-347)Online publication date: Feb-2022
https://doi.org/10.1109/TCSS.2021.3102591
Kumar Tripathi MMaktedar D(2019)A role of computer vision in fruits and vegetables among various horticulture products of agriculture fields: A SurveyInformation Processing in Agriculture10.1016/j.inpa.2019.07.003Online publication date: Jul-2019
https://doi.org/10.1016/j.inpa.2019.07.003
Rapp AMarcengo ABuriano LRuffo GLai MCena F(2018)Designing a personal informatics system for users without experience in self-tracking: a case studyBehaviour & Information Technology10.1080/0144929X.2018.143659237:4(335-366)Online publication date: 15-Feb-2018
https://doi.org/10.1080/0144929X.2018.1436592
Korpela JMaekawa T(2018)Privacy preserving recognition of object-based activities using near-infrared reflective markersPersonal and Ubiquitous Computing10.1007/s00779-017-1070-922:2(365-377)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1007/s00779-017-1070-9
Vu NPham C(2018)Traffic Incident Recognition Using Empirical Deep Convolutional Neural Networks ModelContext-Aware Systems and Applications, and Nature of Computation and Communication10.1007/978-3-319-77818-1_9(90-99)Online publication date: 16-Mar-2018
https://doi.org/10.1007/978-3-319-77818-1_9
Montague KJackson DBrühwiler TBartindale TWilkinson GOlivier PHilliges OPloetz TMival OSmyth MDalsgaard P(2017)Prototyping Ubiquitous Imaging SurfacesProceedings of the 2017 Conference on Designing Interactive Systems10.1145/3064663.3064688(203-207)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1145/3064663.3064688
Pham CDiep NPhuong T(2017)e-Shoes: Smart shoes for unobtrusive human activity recognition2017 9th International Conference on Knowledge and Systems Engineering (KSE)10.1109/KSE.2017.8119470(269-274)Online publication date: Oct-2017
https://doi.org/10.1109/KSE.2017.8119470
Pham CThuy N(2016)Real-Time Traffic Activity Detection Using Mobile DevicesProceedings of the 10th International Conference on Ubiquitous Information Management and Communication10.1145/2857546.2857611(1-7)Online publication date: 4-Jan-2016
https://dl.acm.org/doi/10.1145/2857546.2857611
Farinella GAllegra DMoltisanti MStanco FBattiato S(2016)Retrieval and classification of food imagesComputers in Biology and Medicine10.1016/j.compbiomed.2016.07.00677:C(23-39)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1016/j.compbiomed.2016.07.006
Rapp ACena FHilviu DTirassa MMase KLangheinrich MGatica-Perez DGellersen HChoudhury TYatani K(2015)Human body and smart objectsAdjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers10.1145/2800835.2806204(939-943)Online publication date: 7-Sep-2015
https://dl.acm.org/doi/10.1145/2800835.2806204
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents