short-paper

Food category transfer with conditional cycleGAN and a large-scale food image dataset

Authors:

Daichi Horita,

Ryosuke Tanno,

Wataru Shimoda,

Keiji YanaiAuthors Info & Claims

CEA/MADiMa '18: Proceedings of the Joint Workshop on Multimedia for Cooking and Eating Activities and Multimedia Assisted Dietary Management

Pages 67 - 70

https://doi.org/10.1145/3230519.3230597

Published: 15 July 2018 Publication History

Get Access

Abstract

This paper describes "food image transformation" based on a conditional cycleGAN[A3] (cCycleGAN) with a large-scale food image data collected from the Twitter stream. A cCycleGAN is an extension of CycleGAN, which enables "food category transfer" among 10 types of foods and retain the shape of a given food. We experimentally show that 200 and 30,000 food images with the cCycleGAN enable a very natural food category transfer among 10 types of typical Japanese foods: ramen noodle, curry rice, fried rice, beef rice bowl, chilled noodle, spaghetti with meat source, white rice, eel bowl, and fried noodle.

References

[1]

Y. Choi, M. Choi, M. Kim, J. Ha, S. Kim, and J. Choo. 2017. StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation. arXiv:1711.09020.

Google Scholar

[2]

P. Isola, J. Zhu, T Zhou, and A. A. Efros. 2017. Image-to-Image Translation with Conditional Adversarial Networks. In Proc. of IEEE Computer Vision and Pattern Recognition.

Google Scholar

[3]

S. Jiang and Y. Fu. 2017. Fashion Style Generator. In Proc. of the Twenty-Sixth International Joint Conference on Artificial Intelligence.

Digital Library

Google Scholar

[4]

J. Johnson, A. Alahi, and L.F. Fei. 2016. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In Proc. of European Conference on Computer Vision.

Google Scholar

[5]

Y. Matsuda, H. Hoashi, and K. Yanai. 2012. Recognition of Multiple-Food Images by Detecting Candidate Regions. In Proc. of IEEE International Conference on Multimedia and Expo.

Digital Library

Google Scholar

[6]

A. Odena, C. Olah, and J. Shlens. 2017. Conditional Image Synthesis With Auxiliary Classifier GANs. In Proc. of the 34th International Conference on Machine Learning.

Google Scholar

[7]

D. Pathak, P. Krähenbühl, J. Donahue, T. Darrell, and A. Efros. 2016. Context Encoders: Feature Learning by Inpainting. In Proc. of IEEE Conference on Computer Vision and Pattern Recognition.

Google Scholar

[8]

K. Yanai and Y. Kawano. 2014. Twitter Food Image Mining and Analysis for One Hundred Kinds of Foods. In Proc. of Pacifit-Rim Conference on Multimedia (PCM).

Digital Library

Google Scholar

[9]

J. Y. Zhu, T. Park, P. Isola, and A. A. Efros. 2017. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks. In Proc. of IEEE International Conference on Computer Vision.

Google Scholar

Cited By

View all

Xiong XSun YLiu XLam CTong TChen HGao QKe WTan T(2024)A Parameterized Generative Adversarial Network Using Cyclic Projection for Explainable Medical Image ClassificationsICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10448260(7310-7314)Online publication date: 14-Apr-2024
https://doi.org/10.1109/ICASSP48485.2024.10448260
Kita SPark CKajikawa Y(2024)Sound source localization for source inside a structure using Ac-CycleGANJournal of Sound and Vibration10.1016/j.jsv.2024.118616591(118616)Online publication date: Nov-2024
https://doi.org/10.1016/j.jsv.2024.118616
Jia WLi BZheng YMao ZSun MMougiakakou SYanai KAllegra D(2023)Estimating Amount of Food in a Circular Dining Bowl from a Single ImageProceedings of the 8th International Workshop on Multimedia Assisted Dietary Management10.1145/3607828.3617789(1-9)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3607828.3617789
Show More Cited By

Recommendations

Magical Rice Bowl: A Real-time Food Category Changer
MM '18: Proceedings of the 26th ACM international conference on Multimedia

In this demo, we demonstrate "Real-time Food Category Change'' based on a Conditional Cycle GAN (cCycle GAN) with a large-scale food image data collected from the Twitter Stream. Conditional Cycle GAN is an extension of CycleGAN, which enables "Food ...
Food image generation using a large amount of food images with conditional GAN: ramenGAN and recipeGAN
CEA/MADiMa '18: Proceedings of the Joint Workshop on Multimedia for Cooking and Eating Activities and Multimedia Assisted Dietary Management

Recently, image generation by Deep Convolutional Neural Network has been studied widely by many researchers. In this paper, we describe CNN-based image generation on food images. Especially, we focus on image generation using conditional Generative ...
Unseen Food Creation by Mixing Existing Food Images with Conditional StyleGAN
MADiMa '19: Proceedings of the 5th International Workshop on Multimedia Assisted Dietary Management

In recent years, thanks to the development of generative adversarial networks (GAN), it has become possible to generate food images. However, the quality is still low and it is difficult to generate appetizing and delicious-looking images. In the latest ...

Comments

Information & Contributors

Information

Published In

CEA/MADiMa '18: Proceedings of the Joint Workshop on Multimedia for Cooking and Eating Activities and Multimedia Assisted Dietary Management

July 2018

88 pages

ISBN:9781450365376

DOI:10.1145/3230519

General Chair:
Ichiro Ide
Nagoya University, Japan
,
Program Chair:
Yoko Yamakata
The University of Tokyo, Japan

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 July 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

CEA/MADiMa2018

CEA/MADiMa2018: Joint Workshop on Multimedia for Cooking and Eating Activities and Multimedia Assisted Dietary Management in conjunction with the 27th International Joint Conference on Artificial Intelligence IJCAI

July 15, 2018

Stockholm, Sweden

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
325
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Xiong XSun YLiu XLam CTong TChen HGao QKe WTan T(2024)A Parameterized Generative Adversarial Network Using Cyclic Projection for Explainable Medical Image ClassificationsICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10448260(7310-7314)Online publication date: 14-Apr-2024
https://doi.org/10.1109/ICASSP48485.2024.10448260
Kita SPark CKajikawa Y(2024)Sound source localization for source inside a structure using Ac-CycleGANJournal of Sound and Vibration10.1016/j.jsv.2024.118616591(118616)Online publication date: Nov-2024
https://doi.org/10.1016/j.jsv.2024.118616
Jia WLi BZheng YMao ZSun MMougiakakou SYanai KAllegra D(2023)Estimating Amount of Food in a Circular Dining Bowl from a Single ImageProceedings of the 8th International Workshop on Multimedia Assisted Dietary Management10.1145/3607828.3617789(1-9)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3607828.3617789
Benitez-Garcia GYanai KHu MIde ITobitani K(2021)Ketchup GAN: A New Dataset for Realistic Synthesis of Letters on FoodProceedings of the 2021 International Joint Workshop on Multimedia Artworks Analysis and Attractiveness Computing in Multimedia 202110.1145/3463946.3469241(8-12)Online publication date: 21-Aug-2021
https://dl.acm.org/doi/10.1145/3463946.3469241
Aguilar ENagarajan BKhantun RBolanos MRadeva P(2021)Uncertainty-Aware Data Augmentation for Food Recognition2020 25th International Conference on Pattern Recognition (ICPR)10.1109/ICPR48806.2021.9412706(4017-4024)Online publication date: 10-Jan-2021
https://doi.org/10.1109/ICPR48806.2021.9412706
Komatsu RGonsalves T(2021)Translation of Real-World Photographs into Artistic Images via Conditional CycleGAN and StarGANSN Computer Science10.1007/s42979-021-00884-22:6Online publication date: 20-Oct-2021
https://doi.org/10.1007/s42979-021-00884-2
Han FGuerrero RPavlovic V(2020)CookGAN: Meal Image Synthesis from Ingredients2020 IEEE Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV45572.2020.9093463(1439-1447)Online publication date: Mar-2020
https://doi.org/10.1109/WACV45572.2020.9093463
Nakano KKiyokawa KHorita DYanai KSakata NNarumi T(2019)Enchanting Your Noodles: GAN-based Real-time Food-to-Food Translation and Its Impact on Vision-induced Gustatory Manipulation2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)10.1109/VR.2019.8798336(1096-1097)Online publication date: Mar-2019
https://doi.org/10.1109/VR.2019.8798336

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Magical Rice Bowl: A Real-time Food Category Changer

Food image generation using a large amount of food images with conditional GAN: ramenGAN and recipeGAN

Unseen Food Creation by Mixing Existing Food Images with Conditional StyleGAN

Comments

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Recommendations

Magical Rice Bowl: A Real-time Food Category Changer

Food image generation using a large amount of food images with conditional GAN: ramenGAN and recipeGAN

Unseen Food Creation by Mixing Existing Food Images with Conditional StyleGAN

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations