demonstration

RecipeLog: Recipe Authoring App for Accurate Food Recording

Authors:

Akihisa Ishino,

Hiroaki Karasawa,

Kiyoharu AizawaAuthors Info & Claims

MM '21: Proceedings of the 29th ACM International Conference on Multimedia

Pages 2798 - 2800

https://doi.org/10.1145/3474085.3478563

Published: 17 October 2021 Publication History

Abstract

Diet management is usually conducted by recording the name of foods eaten, but in fact, the nutritional value of food in the same name varies greatly from recipe to recipe. To know accurate nutritional values of the foods, recording personal recipes is effective but time-consuming. Therefore, we are developing a mobile application "RecipeLog", that assists users to write their own recipes by modifying prepared ones. In our experiments, we show that with RecipeLog users create personal recipes with 45% less edit distance compared to writing from scratch.

Supplementary Material

MP4 File (de3241.mp4)

Supplemental video

Download
54.60 MB

MP4 File (MM21-de3241.mp4)

Introduction video for RecipeLog: Recipe Authoring App for Accurate Food Recording

Download
21.57 MB

References

[1]

Kiyoharu Aizawa. 2019. FoodLog: Multimedia Food Recording Platform and its Application. In Proceedings of the 5th International Workshop on Multimedia Assisted Dietary Management (MADiMa '19).

Digital Library

[2]

Salvador Amaia, Hynes Nicholas, Aytar Yusuf, Marin Javier, Ofli Ferda, Weber Ingmar, and Torralba Antonio. 2017. Learning Cross-Modal Embeddings for Cooking Recipes and Food Images. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR '17). 3068--3076. https://doi.org/10.1109/CVPR.2017.327

[3]

Renata Bracale and Concetta M. Vaccaro. 2020. Changes in food choice following restrictive measures due to Covid-19. Nutrition, Metabolism and Cardiovascular Diseases, Vol. 30, 9 (2020), 1423--1426. https://doi.org/10.1016/j.numecd.2020.05.027

[4]

Micael Carvalho, Rémi Cadène, David Picard, Laure Soulier, Nicolas Thome, and Matthieu Cord. 2018. Cross-Modal Retrieval in the Cooking Context: Learning Semantic Text-Image Embeddings (SIGIR '18). 35--44. https://doi.org/10.1145/3209978.3210036

Digital Library

[5]

Han Fu, Rui Wu, Chenghao Liu, and Jianling Sun. 2020. MCEN: Bridging Cross-Modal Gap between Cooking Recipes and Dish Images with Latent Variable Model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR '20).

[6]

Akihisa Ishino, Hiroaki Karasawa, Yoko Yamakata, and Kiyoharu Aizawa. 2021. Development of RecipeLog, a recipe creation support application that uses existing recipes as templates (in Japanese). In The 13th Forum on Data Engineering and Information Management (DEIM2021). C13-1.

[7]

Asker E. Jeukendrup. 2017. Periodized Nutrition for Athletes. Sports medicine (Auckland, N.Z.), Vol. 47, Suppl 1 (2017), 51--63. https://doi.org/10.1007/s40279-017-0694-2

[8]

Chloé Kiddon, Luke Zettlemoyer, and Yejin Choi. 2016. Globally Coherent Text Generation with Neural Checklist Models. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 329--339.

[9]

Bodhisattwa Prasad Majumder, Shuyang Li, Jianmo Ni, and Julian McAuley. 2019. Generating Personalized Recipes from Historical User Preferences. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP '19). 5976--5982. https://doi.org/10.18653/v1/D19--1613

[10]

Javier Marin, Aritro Biswas, Ferda Ofli, Nicholas Hynes, Amaia Salvador, Yusuf Aytar, Ingmar Weber, and Antonio Torralba. 2021. Recipe1M

[11]

: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 1 (2021), 187--203. https://doi.org/10.1109/TPAMI.2019.2927476

[12]

Lucile Marty, Blandine de Lauzon-Guillain, Maë Labesse, and Sophie Nicklaus. 2021. Food choice motives and the nutritional quality of diet during the COVID-19 lockdown in France. Appetite, Vol. 157 (2021), 105005. https://doi.org/10.1016/j.appet.2020.105005

[13]

Susanna Mills, Martin White, Heather Brown, Wendy Wrieden, Dominika Kwasnicka, Joel Halligan, Shannon Robalino, and Jean Adams. 2017. Health and social determinants and outcomes of home cooking: A systematic review of observational studies. Appetite, Vol. 111 (2017), 116--134. https://doi.org/10.1016/j.appet.2016.12.022

[14]

Weiqing Min, Linhu Liu, Zhiling Wang, Zhengdong Luo, Xiaoming Wei, Xiaolin Wei, and Shuqiang Jiang. 2020. ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Network. In Proceedings of the 28th ACM International Conference on Multimedia (MM '20). 393--401. https://doi.org/10.1145/3394171.3414031

Digital Library

[15]

Weiqing Min, Zhiling Wang, Yuxin Liu, Mengjiang Luo, Liping Kang, Xiaoming Wei, Xiaolin Wei, and Shuqiang Jiang. 2021. Large Scale Visual Food Recognition. CoRR, Vol. abs/2103.16107 (2021). arxiv: 2103.16107 https://arxiv.org/abs/2103.16107

[16]

Hai X. Pham, Ricardo Guerrero, Vladimir Pavlovic, and Jiatong Li. 2021. CHEF: Cross-modal Hierarchical Embeddings for Food Domain Retrieval. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35, 3 (May 2021), 2423--2430.

[17]

Doyen Sahoo, Wang Hao, Shu Ke, Wu Xiongwei, Hung Le, Palakorn Achananuparp, Ee-Peng Lim, and Steven C. H. Hoi. 2019. FoodAI: Food Image Recognition via Deep Learning for Smart Food Logging. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '19). 2260--2268. https://doi.org/10.1145/3292500.3330734

Digital Library

[18]

Amaia Salvador, Michal Drozdzal, Xavier Giro-I-Nieto, and Adriana Romero. 2019. Inverse cooking: Recipe generation from food images. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2019-June. IEEE Computer Society, 10445--10454. https://doi.org/10.1109/CVPR.2019.01070

[19]

Akiko Sunto, Nanoha Kudo, and Yoko Yamakata. 2021. Examination of the difference in nutritional value between different recipes of the same cooking name in each household (in Japanese). In 68th Annual Meeting of Japanese Society of Nutrition and Dietetics. (to appear).

[20]

Quin Thames, Arjun Karpur, Wade Norris, Fangting Xia, Liviu Panait, Tobias Weyand, and Jack Sim. 2021. Nutrition5k: Towards Automatic Nutritional Understanding of Generic Food. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR '21). 8903--8911.

[21]

Hao Wang, Doyen Sahoo, Chenghao Liu, Ke Shu, Palakorn Achananuparp, Ee-Peng Lim, and Steven C. H. Hoi. 2020. Cross-Modal Food Retrieval: Learning a Joint Embedding of Food Images and Recipes with Semantic Consistency and Attention Mechanism. CoRR, Vol. abs/2003.03955 (2020). arxiv: 2003.03955 https://arxiv.org/abs/2003.03955

[22]

Julia A Wolfson and Sara N Bleich. 2015. Is cooking at home associated with better diet quality or weight-loss intention? Public Health Nutrition, Vol. 18, 8 (2015), 1397--1406. https://doi.org/10.1017/S1368980014001943

[23]

Zichen Zan, Lin Li, Jianquan Liu, and Dong Zhou. 2020. Sentence-Based and Noise-Robust Cross-Modal Retrieval on Cooking Recipes and Food Images. In Proceedings of the 2020 International Conference on Multimedia Retrieval (ICMR '20). 117--125. https://doi.org/10.1145/3372278.3390681

Digital Library

Cited By

Sheng GMin WZhu XXu LSun QYang YWang LJiang S(2024)A Lightweight Hybrid Model with Location-Preserving ViT for Efficient Food RecognitionNutrients10.3390/nu1602020016:2(200)Online publication date: 8-Jan-2024
https://doi.org/10.3390/nu16020200
Yang YMin WSong JSheng GWang LJiang S(2024)Lightweight Food Recognition via Aggregation Block and Feature EncodingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/368028520:10(1-25)Online publication date: 22-Jul-2024
https://dl.acm.org/doi/10.1145/3680285
Sheng GMin WYao TSong JYang YWang LJiang S(2024)Lightweight Food Image Recognition With Global Shuffle ConvolutionIEEE Transactions on AgriFood Electronics10.1109/TAFE.2024.33867132:2(392-402)Online publication date: Sep-2024
https://doi.org/10.1109/TAFE.2024.3386713

Index Terms

RecipeLog: Recipe Authoring App for Accurate Food Recording
1. Applied computing
  1. Document management and text processing
    1. Document management
      1. Version control
  2. Life and medical sciences
    1. Health care information systems

Recommendations

Prediction of Mental State from Food Images
CEA++ '22: Proceedings of the 1st International Workshop on Multimedia for Cooking, Eating, and related APPlications

Diet is a very important factor in people's health management. Applications that record photos of meals and help people manage their diets are used by many users every day. In many cases, such applications use images just to estimate meals and calories. ...
Snap, Eat, RepEat: A Food Recognition Engine for Dietary Logging
MADiMa '16: Proceedings of the 2nd International Workshop on Multimedia Assisted Dietary Management

We present a system to assist users in dietary logging habits, which performs food recognition from pictures snapped on their phone in two different scenarios. In the first scenario, called "Food in context", we exploit the GPS information of a user to ...
DietCam

This paper presents an automatic multi-view food classification of a food intake assessment system on a smart phone. Food intake assessment plays important roles in obesity management, which has shown significant impacts on public healthcare. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '21: Proceedings of the 29th ACM International Conference on Multimedia

October 2021

5796 pages

ISBN:9781450386517

DOI:10.1145/3474085

General Chairs:
Heng Tao Shen
University of Electronic Science&Technology of China, China
,
Yueting Zhuang
Zhejiang University, China
,
John R. Smith
IBM, USA
,
Program Chairs:
Yang Yang
University of Electronic Science and Technology of China, China
,
Pablo Cesar
CWI&TU Delft, The Netherlands
,
Florian Metze
FACEBOOK, Inc., USA
,
Balakrishnan Prabhakaran
University of Texas at Dallas, USA

Copyright © 2021 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2021

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

MM '21

Sponsor:

SIGMM

MM '21: ACM Multimedia Conference

October 20 - 24, 2021

Virtual Event, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
117
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)4

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sheng GMin WZhu XXu LSun QYang YWang LJiang S(2024)A Lightweight Hybrid Model with Location-Preserving ViT for Efficient Food RecognitionNutrients10.3390/nu1602020016:2(200)Online publication date: 8-Jan-2024
https://doi.org/10.3390/nu16020200
Yang YMin WSong JSheng GWang LJiang S(2024)Lightweight Food Recognition via Aggregation Block and Feature EncodingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/368028520:10(1-25)Online publication date: 22-Jul-2024
https://dl.acm.org/doi/10.1145/3680285
Sheng GMin WYao TSong JYang YWang LJiang S(2024)Lightweight Food Image Recognition With Global Shuffle ConvolutionIEEE Transactions on AgriFood Electronics10.1109/TAFE.2024.33867132:2(392-402)Online publication date: Sep-2024
https://doi.org/10.1109/TAFE.2024.3386713

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents