research-article

A Cognitive Control Method for Cost-Efficient CBTC Systems With Smart Grids

Authors:

Fei Richard Yu,

Siqing YouAuthors Info & Claims

IEEE Transactions on Intelligent Transportation Systems, Volume 18, Issue 3

Pages 568 - 582

https://doi.org/10.1109/TITS.2016.2586938

Published: 01 March 2017 Publication History

Abstract

Communication-based train control (CBTC) systems use wireless local area networks for information transmission between trains and wayside equipment. Since inevitable packet delay and drop are introduced in train–wayside communications, information uncertainties in trains' states will lead to unplanned traction/braking demands, as well as waste in electrical energy. Moreover, with the introduction of regenerative braking technology, power grids in CBTC systems are evolving to smart grids, and cost-aware power management should be employed to reduce the total financial cost of consumed electrical energy. In this paper, a cognitive control method for CBTC systems with smart grids is presented to enhance both train operation performance and cost efficiency. We formulate a cognitive control system model for CBTC systems. The information gap in cognitive control is calculated to analyze how the train–wayside communications affect the operation of trains. The Q-learning algorithm is used in the proposed cognitive control method, and a joint objective function composed of the information gap and the total financial cost is applied to generate optimal policy. The medium-access control layer retry-limit adaption and traction strategy selection are adopted as cognitive actions. Extensive simulation results show that the cost efficiency and train operation performance of CBTC systems are substantially improved using our proposed cognitive control method.

References

[1]

R. Pascoe and T. Eichorn, “What is communication-based train control?” IEEE Veh. Technol. Mag., vol. Volume 4, no. Issue 4, pp. 16–21, 2009.

[2]

IEEE Standard for Communications-Based Train Control (CBTC) Performance and Functional Requirements, pp. 1–45, 2004.

[3]

M. Aguado, E. Jacob, P. Saiz, J. Unzilla, M. Higuero, and J. Matias, “Railway signaling systems and new trends in wireless data communication,” in Proc. IEEE VTC—Fall, Dallas, TX, USA, 2005, vol. Volume 2, pp. 1333–1336.

[4]

K. Rahn, C. Bode, and T. Albrecht, “Energy-efficient driving in the context of a Communications-Based Train Control system (CBTC),” in Proc. IEEE ICIRT, 2013, pp. 19–24.

[5]

S. Morar, “Evolution of communication based train control worldwide,” in Proc. IEEE IET Prof. Develop. Course RSCS, 2010, pp. 218–226.

[6]

R. Murray, K. Astrom, S. Boyd, R. Brockett, and G. Stein, “Future directions in control in an information-rich world,” IEEE Control Syst., vol. Volume 23, no. Issue 2, pp. 20–33, 2003.

[7]

M. Dominguez, A. Fernandez-Cardador, A. Cucala, and R. Pecharroman, “Energy savings in metropolitan railway substations through regenerative energy recovery and optimal design of ATO speed profiles,” IEEE Trans. Autom. Sci. Eng., vol. Volume 9, no. Issue 3, pp. 496–504, 2012.

[8]

S. Lu, P. Weston, S. Hillmansen, H. Gooi, and C. Roberts, “Increasing the regenerative braking energy for railway vehicles,” IEEE Trans. Intell. Transp. Syst., vol. Volume 15, no. Issue 6, pp. 2506–2515, 2014.

[9]

S. Bu, F. Yu, Y. Cai, and X. Liu, “When the smart grid meets energy-efficient communications: Green wireless cellular networks powered by the smart grid,” IEEE Trans. Wireless Commun., vol. Volume 11, no. Issue 8, pp. 3014–3024, 2012.

[10]

S. Bu and F. R. Yu, “A game-theoretical scheme in the smart grid with demand-side management: Towards a smart cyber-physical power infrastructure,” IEEE Trans. Emerging Topics Comput., vol. Volume 1, no. Issue 1, pp. 22–32, 2013.

[11]

S. Bu, F. R. Yu, and P. Liu, “Dynamic pricing for demand-side management in the smart grid,” in Proc. IEEE Online Conf. GreenCom, 2011, pp. 47–51.

[12]

P. Howlett, “Optimal strategies for the control of a train,” Automatica, vol. Volume 32, no. Issue 4, pp. 519–532, 1996.

Digital Library

[13]

S. Su, X. Li, T. Tang, and Z. Gao, “A subway train timetable optimization approach based on energy-efficient operation strategy,” IEEE Trans. Intell. Transp. Syst., vol. Volume 14, no. Issue 2, pp. 883–893, 2013.

Digital Library

[14]

X. Yang, X. Li, Z. Gao, H. Wang, and T. Tang, “A cooperative scheduling model for timetable optimization in subway systems,” IEEE Trans. Intell. Transp. Syst., vol. Volume 14, no. Issue 1, pp. 438–447, 2013.

Digital Library

[15]

L. Zhu, F. Yu, B. Ning, and T. Tang, “Cross-layer handoff design in MIMO-enabled WLANS for Communication-Based Train Control (CBTC) systems,” IEEE J. Sel. Areas Commun., vol. Volume 30, no. Issue 4, pp. 719–728, 2012.

[16]

L. Zhu, F. Yu, B. Ning, and T. Tang, “Handoff performance improvements in MIMO-enabled communication-based train control systems,” IEEE Trans. Intell. Transp. Syst., vol. Volume 13, no. Issue 2, pp. 582–593, 2012.

Digital Library

[17]

H. Wang, F. R. Yu, L. Zhu, T. Tang, and B. Ning, “A cognitive control approach to communication-based train control systems,” IEEE Trans. Intell. Transp. Syst., vol. Volume 16, no. Issue 4, pp. 1676–1689, 2015.

[18]

C. Yang, L. Lu, C. Di, and X. Fang, “An on-vehicle dual-antenna handover scheme for high-speed railway distributed antenna system,” in Proc. IEEE 6th Int. Conf. WiCOM, 2010, pp. 1–5.

[19]

H. Jijing, M. Jun, and Z. Zhangdui, “Research on handover of GSM-R network under high-speed scenarios,” Railway Commun Signals, vol. Volume 42, pp. 51–53, 2006.

[20]

B. Bu, F. Yu, and T. Tang, “Performance improved methods for communication-based train control systems with random packet drops,” IEEE Trans. Intell. Transp. Syst., vol. Volume 15, no. Issue 3, pp. 1179–1192, 2014.

[21]

B. Bu, F. R. Yu, T. Tang, and C. Gao, “Performance improvements of Communication-Based Train Control (CBTC) systems with unreliable wireless networks,” Wireless Netw., vol. Volume 20, no. Issue 1, pp. 53–71, 2014.

Digital Library

[22]

W. Sun, F. R. Yu, T. Tang, and B. Bu, “Energy-efficient communication-based train control systems with packet delay and loss,” IEEE Trans. Intell. Transp. Syst., vol. Volume 17, no. Issue 2, pp. 452–468, 2016.

[23]

Z. Li and N. Bin, “The design of the CBTC train-ground communication system based on ieee 802.11g standard,” China Railway Sci., vol. Volume 31, no. Issue 5, pp. 119–24, 2010.

[24]

H. Wang, F. R. Yu, L. Zhu, T. Tang, and B. Ning, “Finite-state Markov modeling for wireless channels in tunnel communication-based train control systems,” IEEE Trans. Intell. Transp. Syst., vol. Volume 15, no. Issue 3, pp. 1083–1090, 2014.

[25]

Y. Fei, V. Wong, and V. Leung, “Efficient QoS provisioning for adaptive multimedia in mobile communication networks by reinforcement learning,” Mobile Netw. Appl., vol. Volume 11, no. Issue 1, pp. 101–110, 2006.

Digital Library

[26]

C. Luo, F. R. Yu, H. Ji, and V. C. M. Leung, “Cross-layer design for TCP performance improvement in cognitive radio networks,” IEEE Trans. Veh. Tech., vol. Volume 59, no. Issue 5, pp. 2485–2495, 2010.

[27]

H. Wu and H. Ma, “An optimal buffer management strategy for video transmission in opportunistic networks,” Ad Hoc Sens. Wireless Netw., vol. Volume 29, no. Issue 1–4, pp. 177–193, 2015.

[28]

R. Xie, F. R. Yu, and H. Ji, “Dynamic resource allocation for heterogeneous services in cognitive radio networks with imperfect channel sensing,” IEEE Trans. Veh. Technol., vol. Volume 61, no. Issue 2, pp. 770–780, 2012.

[29]

C. Chen, C. Dong, F. Wu, S. Tang, Y. Qu, and H. Wang, “The power of flexible sliding window: Adaptive network coding in wireless mesh networks,” Ad Hoc Sens. Wireless Netw., vol. Volume 29, no. Issue 1–4, pp. 235–251, 2015.

[30]

H.-W. Kim and A. Kachroo, “Low power routing and channel allocation of wireless video sensor networks using wireless link utilization,” Ad Hoc Sens. Wireless Netw., vol. Volume 30, no. Issue 1/2, pp. 83–112, 2016.

[31]

S. Haykin, Cognitive Dynamic Systems: Perception-Action Cycle, Radar and Radio . Cambridge, U.K.: Cambridge Univ. Press, 2012.

Digital Library

[32]

S. Haykin, M. Fatemi, P. Setoodeh, and Y. Xue, “Cognitive control,” Proc. IEEE, vol. Volume 100, no. Issue 12, pp. 3156–3169, 2012.

[33]

L. Dengpan, C. Wei, and X. Ji, “Analysis of train-wayside communication system for ring line,” Railway Signalling Commun., vol. Volume 8, p. pp.024, 2011.

[34]

W. Huang, L. Jia, and B. Zhong, “Shadow fading correlation in high-speed railway environments,” Railway Computer Appl., vol. Volume 14, no. Issue 12, pp. 43–45, 2005.

[35]

R. He, “A standardized path loss model for the GSM-railway based high-speed railway communication systems,” in Proc. IEEE—VTC, 2014, pp. 1–5.

[36]

R. He, Z. Zhong, B. Ai, and C. Oestges, “Shadow fading correlation in high-speed railway environments,” IEEE Trans. Veh. Technol., vol. Volume 64, no. Issue 7, pp. 2762–2772, 2015.

[37]

M. Aguado, O. Onandi, P. S. Agustin, M. Higuero, and E. J. Taquet, “Wimax on rails,” IEEE Veh. Technol. Mag., vol. Volume 3, no. Issue 3, pp. 47–56, 2008.

[38]

J. Moreno, J. M. Riera, L. d. Haro, and C. Rodriguez, “A survey on future railway radio communications services: Challenges and opportunities,” IEEE Commun. Mag., vol. Volume 53, no. Issue 10, pp. 62–68, 2015.

[39]

Y. Jiang, J. Liu, W. Tian, M. Shahidehpour, and M. Krishnamurthy, “Energy harvesting for the electrification of railway stations: Getting a charge from the regenerative braking of trains. A,” IEEE Electrific. Mag., vol. Volume 2, no. Issue 3, pp. 39–48, 2014.

[40]

R. Hellmund, “Regenerative braking of electric vehicles,” Proc. Amer. Inst. Elect. Eng., vol. Volume 36, no. Issue 1, pp. 1–56, 1917.

[41]

M. Parvania and M. Fotuhi-Firuzabad, “Demand response scheduling by stochastic SCUC,” IEEE Trans. Smart Grid, vol. Volume 1, no. Issue 1, pp. 89–98, 2010.

[42]

L. Rao, X. Liu, L. Xie, and W. Liu, “Minimizing electricity cost: Optimization of distributed Internet data centers in a multi-electricity-market environment,” in Proc. INFOCOM, 2010, pp. 1–9.

Digital Library

[43]

X. Zheng and Y. Cai, “Energy-aware load dispatching in geographically located Internet data centers,” Sustain. Comput., Informat. Syst., vol. Volume 1, no. Issue 4, pp. 275–285, 2011.

[44]

R. W. Gardner, P. S. Holzman, G. S. Klein, H. P. Linton, and D. P. Spence, “Cognitive control: A study of individual consistencies in cognitive behavior,” Psychol. Issues, vol. Volume 1, no. Issue 4, p. pp.186, 1959.

[45]

R. S. Michalski, J. G. Carbonell, and T. M. Mitchell, Machine learning: An artificial intelligence approach . Berlin, Germany: Springer, 2013.

Digital Library

[46]

C. J. Watkins and P. Dayan, “Q-learning,” Mach. learn., vol. Volume 8, no. Issue 3/4, pp. 279–292, 1992.

Digital Library

[47]

Q. Li and M. van der Schaar, “Providing adaptive QoS to layered video over wireless local area networks through real-time retry limit adaptation,” IEEE Trans. Multimedia, vol. Volume 6, no. Issue 2, pp. 278–290, 2004.

Digital Library

[48]

W. Sun, F. R. Yu, T. Tang, and B. Bu, “Energy-efficient Communication-Based Train Control (CBTC) systems with random delay and packet drop,” in Proc. IEEE GLOBECOM, Austin, TX, USA, 2014, pp. 1353–1357.

[49]

L. Zheng and D. N. C. Tse, “Diversity and multiplexing: A fundamental tradeoff in multiple-antenna channels,” IEEE Trans. Inf. Theory, vol. Volume 49, no. Issue 5, pp. 1073–1096, 2003.

Digital Library

[50]

D. Gesbert, M. Shafi, D.-S. Shiu, P. J. Smith, and A. Naguib, “From theory to practice: An overview of MIMO space-time coded wireless systems,” IEEE J. Sel. Areas Commun., vol. Volume 21, no. Issue 3, pp. 281–302, 2003.

Digital Library

[51]

IEEE Standard for Information Technology—Telecommunications and Information Exchange Between Systems—Local and Metropolitan Area Networks-Specific Requirements Part II: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications, pp. 1–67, 2003.

Cited By

Zhang WCheng Z(2022)Enterprise target cost control algorithm based on hypercycle modelJournal of Computational Methods in Sciences and Engineering10.3233/JCM-21556722:1(11-24)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.3233/JCM-215567
Fang XHan YWang JZhao Q(2019)A cognitive control approach for microgrid performance optimization in unstable wireless communicationNeurocomputing10.1016/j.neucom.2019.04.048355:C(168-182)Online publication date: 25-Aug-2019
https://dl.acm.org/doi/10.1016/j.neucom.2019.04.048

Recommendations

Cognitive Control Method for Cost-Efficient Communication-Based Train Control Systems in Smart Grids
ITSC '15: Proceedings of the 2015 IEEE 18th International Conference on Intelligent Transportation Systems

In Communication-based Train Control (CBTC) systems, the information uncertainties due to unreliable wireless networks leads to imperfect braking demands, which increases the energy consumption. Moreover, with the development of power grid technology, ...
Performance improvements of communication-based train control (CBTC) systems with unreliable wireless networks

Communication-based train control (CBTC) uses wireless networks, such as wireless local area networks (WLANs), to transmit trains status and control commands. CBTC systems have stringent requirements for train-ground communications, as the train control ...
A Game-Theoretic Control Approach to Communication-Based Train Control (CBTC) Systems with Packet Drops
ITSC '15: Proceedings of the 2015 IEEE 18th International Conference on Intelligent Transportation Systems

Communication-based train control (CBTC) systems use high capacity, bi-directional, wireless communications to transmit the status and commands of trains. Since more data can be exchanged between trains and the ground, the closed-loop, precise control ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Intelligent Transportation Systems

IEEE Transactions on Intelligent Transportation Systems Volume 18, Issue 3

March 2017

252 pages

Issue’s Table of Contents

Copyright © 2017.

Publisher

IEEE Press

Publication History

Published: 01 March 2017

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang WCheng Z(2022)Enterprise target cost control algorithm based on hypercycle modelJournal of Computational Methods in Sciences and Engineering10.3233/JCM-21556722:1(11-24)Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.3233/JCM-215567
Fang XHan YWang JZhao Q(2019)A cognitive control approach for microgrid performance optimization in unstable wireless communicationNeurocomputing10.1016/j.neucom.2019.04.048355:C(168-182)Online publication date: 25-Aug-2019
https://dl.acm.org/doi/10.1016/j.neucom.2019.04.048

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents