Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3519941.3535071acmconferencesArticle/Chapter ViewAbstractPublication PagescpsweekConference Proceedingsconference-collections
research-article

An old friend is better than two new ones: dual-screen Android

Published: 14 June 2022 Publication History

Abstract

Dual-screen foldable Android smartphones such as Microsoft Surface Duo are emerging. However, due to its internal design, the Android framework cannot support combined mode, by which two screens can be integrated into one, without modifications, thus requiring new display management. Android introduces a new dual-screen display method, called presentation class, to handle this problem; however, existing apps need to be redesigned based on the new class. In this paper, we propose Dual-Screen Android (DSA), a semantics-aware display scheme for dual-screen foldable Android smartphones. DSA is transparent to apps, thus requiring no changes for existing apps, and incurs minimum modification to the Android framework. Specifically, inside Android, DSA duplicates and maps single-screen views provided by apps to dual screens and maps input events backward correspondingly, thus being transparent to apps. DSA also opens the door to store other hardware states (e.g., screen brightness, screen-touch events, etc.), which can be utilized to bridge other software/hardware semantic gaps for further system optimization. To demonstrate this, we design an effective Q-learning energy optimization scheme within DSA to control screen brightness based on predicted users' behaviors. We have implemented DSA based on Android 10 with real hardware and conducted a series of experiments. Experimental results show that based on DSA, without any modifications, existing apps can directly run and fully exploit dual screens with negligible time and memory overheads, and our energy optimization scheme can effectively reduce energy. We have released the open-source code of DSA for public access.

References

[1]
2022. An Old Friend Is Better Than Two New Ones: Dual- Screen Android. Zenodo. https://doi.org/10.5281/zenodo.6607837
[2]
N. AlDuaij, A. Van’t Hof, and J. Nieh. 2019. Heterogeneous multi-mobile computing. In MobiSys. 494–507. https://doi.org/10.1145/3307334.3326096
[3]
B. Anand, K. Thirugnanam, J. Sebastian, P. G. Kannan, A. L. Ananda, M. C. Chan, and R. K. Balan. 2011. Adaptive display power management for mobile games. In MobiSys. 57–70. https://doi.org/10.1145/1999995.2000002
[4]
AOSP. 2021. JetPack Window Manager. https://developer.android.com/jetpack/androidx/releases/window
[5]
AOSP. 2021. Multi-window support. https://developer.android.com/guide/topics/ui/multi-window (2021)
[6]
AOSP. 2021. Presentation. https://developer.android.com/reference/android/app/Presentation
[7]
ATT. 2021. ATT Visual Voicemail. https://www.att.com/support/article/wireless/KM1009152/
[8]
Nakhoon Baek. 2018. A fixed-function rendering pipeline with direct rendering manager support. In IT Convergence and Security 2017. Springer, 106–109.
[9]
Ricardo A Baratto, Shaya Potter, Gong Su, and Jason Nieh. 2004. Mobidesk: mobile virtual desktop computing. In Proceedings of the 10th annual international conference on Mobile computing and networking. 1–15. https://doi.org/10.1145/1023720.1023722
[10]
Aaron Carroll and Gernot Heiser. 2010. An analysis of power consumption in a smartphone. In USENIX annual technical conference. 14, 21–21.
[11]
Martin D Carroll, Ilija Hadžić, and William A Katsak. 2012. 3D rendering in the cloud. Bell Labs Technical Journal, 17, 2 (2012), 55–66. https://doi.org/10.1002/bltj.21544
[12]
Xiang Chen, Kent W Nixon, Hucheng Zhou, Yunxin Liu, and Yiran Chen. 2014. Fingershadow: An $OLED$ power optimization based on smartphone touch interactions. In 6th Workshop on Power-Aware Computing and Systems (HotPower 14).
[13]
Xiang Chen, Jian Zheng, Yiran Chen, Mengying Zhao, and Chun Jason Xue. 2012. Quality-retaining OLED dynamic voltage scaling for video streaming applications on mobile devices. In DAC Design Automation Conference 2012. 1000–1005. https://doi.org/10.1145/2228360.2228540
[14]
Wei-Chung Cheng and Massoud Pedram. 2004. Power minimization in a backlit TFT-LCD display by concurrent brightness and contrast scaling. IEEE Transactions on Consumer Electronics, 50, 1 (2004), 25–32. https://doi.org/10.1109/TCE.2004.1277837
[15]
Byung-Gon Chun, Sunghwan Ihm, Petros Maniatis, Mayur Naik, and Ashwin Patti. 2011. Clonecloud: elastic execution between mobile device and cloud. In Proceedings of the sixth conference on Computer systems. 301–314. https://doi.org/10.1145/1966445.1966473
[16]
Jürgen Cito, Julia Rubin, Phillip Stanley-Marbell, and Martin Rinard. 2016. Battery-aware transformations in mobile applications. In 2016 31st IEEE/ACM International Conference on Automated Software Engineering (ASE). 702–707. https://doi.org/10.1145/2970276.2970324
[17]
Comcast. 2021. Business Internet, your way. https://business.comcast.com/
[18]
I Constandanche, M Sayler, S Gaonkar, R Roy Choudhury, and L Cox. 2008. Energy-aware localization using mobile phones. Poster, ACM MobiSys.
[19]
Angela B Dalton and Carla Schlatter Ellis. 2003. Sensing User Intention and Context for Energy Management. In HotOS. 151–156.
[20]
Alan Demers, Karin Petersen, Mike Spreitzer, Doug Terry, Marvin Theimer, and Brent Welch. 1994. The Bayou architecture: Support for data sharing among mobile users. In 1994 First Workshop on Mobile Computing Systems and Applications. 2–7. https://doi.org/10.1109/WMCSA.1994.37
[21]
M. Dong and L. Zhong. 2011. Chameleon: A color-adaptive web browser for mobile OLED displays. In MobiSys. 85–98. https://doi.org/10.1109/TMC.2012.40
[22]
Ioana Giurgiu, Oriana Riva, Dejan Juric, Ivan Krivulev, and Gustavo Alonso. 2009. Calling the cloud: Enabling mobile phones as interfaces to cloud applications. In ACM/IFIP/USENIX International Conference on Distributed Systems Platforms and Open Distributed Processing. 83–102. https://doi.org/10.1007/978-3-642-10445-9_5
[23]
Google. 2021. Android 10. https://www.android.com/android-10/
[24]
Google. 2021. UI/Application Exerciser Monkey. https://developer.android.com/studio/test/monkey
[25]
Peizhen Guo, Bo Hu, Rui Li, and Wenjun Hu. 2018. FoggyCache: Cross-device approximate computation reuse. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 19–34. https://doi.org/10.1145/3241539.3241557
[26]
S. He, Y. Liu, and H. Zhou. 2015. Optimizing smartphone power consumption through dynamic resolution scaling. In MobiCom. 27–39. https://doi.org/10.1145/2789168.2790117
[27]
Wenjun Hu, Hao Gu, and Qifan Pu. 2013. Lightsync: Unsynchronized visual communication over screen-camera links. In Proceedings of the 19th annual international conference on Mobile computing & networking. 15–26. https://doi.org/10.1145/2500423.2500437
[28]
Huawei. 2021. HUAWEI Mate Xs. https://consumer.huawei.com/en/phones/mate-x-s/
[29]
A. Iranli and M. Pedram. 2005. DTM: dynamic tone mapping for backlight scaling. In DAC. 612–617. https://doi.org/10.1145/1065579.1065741
[30]
Aman Kansal, Scott Saponas, AJ Bernheim Brush, Kathryn S McKinley, Todd Mytkowicz, and Ryder Ziola. 2013. The latency, accuracy, and battery (lab) abstraction: programmer productivity and energy efficiency for continuous mobile context sensing. ACM SIGPLAN Notices, 48, 10 (2013), 661–676. https://doi.org/10.1145/2544173.2509541
[31]
Hyoseung Kim, Hojung Cha, and Rhan Ha. 2007. Dynamic refresh-rate scaling via frame buffer monitoring for power-aware LCD management. Software: Practice and Experience, 37, 2 (2007), 193–206. https://doi.org/10.1002/spe.753
[32]
Joeng Kim, Ricardo A Baratto, and Jason Nieh. 2006. An application streaming service for mobile handheld devices. In 2006 IEEE International Conference on Services Computing (SCC’06). 323–326. https://doi.org/10.1109/SCC.2006.18
[33]
Kyoungwoo Lee, Nikil Dutt, and Nalini Venkatasubramanian. 2005. An experimental study on energy consumption of video encryption for mobile handheld devices. In 2005 IEEE International Conference on Multimedia and Expo. 1424–1427. https://doi.org/10.1109/ICME.2005.1521698
[34]
Sangpil Lee, Keunsoo Kim, Gunjae Koo, Hyeran Jeon, Won Woo Ro, and Murali Annavaram. 2015. Warped-compression: Enabling power efficient gpus through register compression. ACM SIGARCH Computer Architecture News, 43, 3S (2015), 502–514. https://doi.org/10.1145/2749469.2750417
[35]
LG. 2021. LG G8X THINQ. https://www.lg.com/us/mobile-phones/g8x-thinq-dual-screen
[36]
Daniyal Liaqat, Silviu Jingoi, Eyal de Lara, Ashvin Goel, Wilson To, Kevin Lee, Italo De Moraes Garcia, and Manuel Saldana. 2016. Sidewinder: An energy efficient and developer friendly heterogeneous architecture for continuous mobile sensing. ACM SIGPLAN Notices, 51, 4 (2016), 205–215. https://doi.org/10.1145/2872362.2872398
[37]
Limitium. 2021. BatON. https://play.google.com/store/apps/details?id=com.limi.baton&hl=zh&gl=US
[38]
Microsoft. 2021. Surface Duo. https://www.microsoft.com/en-us/surface/devices/surface-duo
[39]
Microsoft. 2021. Surface Duo SDK. https://github.com/microsoft/surface-duo-sdk
[40]
OfficeRnD LTD. 2021. Business.Hub. https://play.google.com/store/apps/details?id=com.officernd.business_hub&hl=en_US&gl=US
[41]
Sangeun Oh, Ahyeon Kim, Sunjae Lee, Kilho Lee, Dae R Jeong, Steven Y Ko, and Insik Shin. 2019. FLUID: Flexible user interface distribution for ubiquitous multi-device interaction. In The 25th Annual International Conference on Mobile Computing and Networking. 1–16. https://doi.org/10.1145/3400713.3400719
[42]
Perfetto. 2021. ATrace: Android system and app trace events. https://perfetto.dev/docs/data-sources/atrace
[43]
Shaya Potter and Jason Nieh. 2006. Highly reliable mobile desktop computing in your pocket. In 30th Annual International Computer Software and Applications Conference (COMPSAC’06). 1, 247–254. https://doi.org/10.1109/COMPSAC.2006.52
[44]
Nuno Preguiça, Marc Shapiro, and Caroline Matheson. 2003. Semantics-based reconciliation for collaborative and mobile environments. In OTM Confederated International Conferences" On the Move to Meaningful Internet Systems". 38–55. https://doi.org/10.1007/978-3-540-39964-3_5
[45]
Arjun Roy, Stephen M Rumble, Ryan Stutsman, Philip Levis, David Mazieres, and Nickolai Zeldovich. 2011. Energy management in mobile devices with the cinder operating system. In Proceedings of the sixth conference on Computer systems. 139–152. https://doi.org/10.1145/1966445.1966459
[46]
Samsung. 2021. Galaxy Z Fold2. https://www.samsung.com/hk_en/smartphones/galaxy-z-fold2/
[47]
Liuba Shrira and Hong Tian. 2003. Mx: Mobile object exchange for collaborative applications. In European Conference on Object-Oriented Programming. 126–150. https://doi.org/10.1007/978-3-540-45070-2_7
[48]
Patrick Stuedi, Iqbal Mohomed, and Doug Terry. 2010. Wherestore: Location-based data storage for mobile devices interacting with the cloud. In Proceedings of the 1st ACM Workshop on Mobile Cloud Computing & Services: Social Networks and Beyond. 1–8. https://doi.org/10.1145/1810931.1810932
[49]
T-Chip. 2021. ROC-RK3399-PC-PLUS. https://wiki.t-firefly.com/en/ROC-RK3399-PC-PLUS/
[50]
Kheng-Joo Tan, Jia-Wei Gong, Bing-Tsung Wu, Dou-Cheng Chang, Hsin-Yi Li, Yi-Mao Hsiao, Yung-Chung Chen, Shi-Wu Lo, Yuan-Sun Chu, and Jiun-In Guo. 2010. A remote thin client system for real time multimedia streaming over VNC. In 2010 IEEE International Conference on Multimedia and Expo. 992–997. https://doi.org/10.1109/ICME.2010.5582993
[51]
Stephen P Tarzia, Peter A Dinda, Robert P Dick, and Gokhan Memik. 2010. Display power management policies in practice. In Proceedings of the 7th international conference on Autonomic computing. 51–60. https://doi.org/10.1145/1809049.1809057
[52]
Tencent. 2021. Wechat. https://weixin.qq.com/
[53]
The kernel development community. 2021. DRM Internals. https://www.kernel.org/doc/html/latest/gpu/drm-internals.html
[54]
Eric Wright, Eyal De Lara, and Ashvin Goel. 2011. Vision: The case for context-aware selective resume. In Proceedings of the second international workshop on Mobile cloud computing and services. 1–6. https://doi.org/10.1145/1999732.1999734
[55]
Fan Yang, Zhengping Qian, Xiuwei Chen, Ivan Beschastnikh, Li Zhuang, Lidong Zhou, and Jacky Shen. 2012. Sonora: A platform for continuous mobile-cloud computing. Microsoft Research Asia.

Cited By

View all

Index Terms

  1. An old friend is better than two new ones: dual-screen Android

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    LCTES 2022: Proceedings of the 23rd ACM SIGPLAN/SIGBED International Conference on Languages, Compilers, and Tools for Embedded Systems
    June 2022
    161 pages
    ISBN:9781450392662
    DOI:10.1145/3519941
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 June 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Badges

    Author Tags

    1. Embedded system
    2. display energy optimization
    3. mobile system

    Qualifiers

    • Research-article

    Conference

    LCTES '22

    Acceptance Rates

    Overall Acceptance Rate 116 of 438 submissions, 26%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 130
      Total Downloads
    • Downloads (Last 12 months)40
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 15 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media