research-article

Research on Neighbor Discovery Algorithms Based on Reinforcement Learning with Directional Antennas for Ad Hoc Networks

Authors:

Hao XuAuthors Info & Claims

ICCBN '21: Proceedings of the 2021 9th International Conference on Communications and Broadband Networking

Pages 285 - 290

https://doi.org/10.1145/3456415.3456462

Published: 06 June 2021 Publication History

Get Access

Abstract

The use of directional antennas in Ad Hoc networks can improve the performance of networks, but it will make neighbor discovery challenging. The neighbor discovery algorithms based on reinforcement learning improve the efficiency of neighbor discovery by learning the experience of the process according to the reward obtained by the nodes without the prior location information of neighbors. Four reinforcement learning algorithms, including Q-Learning, SARSA, Q(λ), and SARSA(λ), are used to simulate the time to discover all neighbors and the neighbor discovery ratio in different conditions. According to the simulation results, compared with the completely random algorithm, the neighbor discovery algorithm based on Q-Learning has the largest increase in efficiency with the 1-way handshake, especially in the network with high node density and low speed movement of nodes.

References

[1]

Zhang, Z., & Li, B. (2008). Neighbor discovery in mobile ad hoc self-configuring networks with directional antennas: algorithms and comparisons. IEEE Transactions on Wireless Communications, 7 (5), 1540-1549.

Digital Library

Google Scholar

[2]

Cai, H., & Wolf, T. (2015, April). On 2-way neighbor discovery in wireless networks with directional antennas. In 2015 IEEE Conference on Computer Communications (INFOCOM) (pp. 702-710). IEEE.

Crossref

Google Scholar

[3]

Luo, J., & Guo, D. (2008, September). Neighbor discovery in wireless ad hoc networks based on group testing. In 2008 46th Annual Allerton Conference on Communication, Control, and Computing (pp. 791-797). IEEE.

Google Scholar

[4]

Tehrani, A. S., Dimakis, A. G., & Caire, G. (2013, July). Optimal measurement matrices for neighbor discovery. In 2013 IEEE International Symposium on Information Theory (pp. 2134-2138). IEEE.

Crossref

Google Scholar

[5]

Ölçer, G. M., Genç, Z., & Onur, E. (2010, September). Smart neighbor scanning with directional antennas in 60 GHz indoor networks. In 21st annual IEEE international symposium on personal, indoor and mobile radio communications (pp. 2393-2398). IEEE.

Google Scholar

[6]

Ramanathan, R., Redi, J., Santivanez, C., Wiggins, D., & Polit, S. (2005). Ad hoc networking with directional antennas: a complete system solution. IEEE Journal on selected areas in communications, 23 (3), 496-506.

Digital Library

Google Scholar

[7]

Takai, M., Martin, J., Bagrodia, R., & Ren, A. (2002, June). Directional virtual carrier sensing for directional antennas in mobile ad hoc networks. In Proceedings of the 3rd ACM international symposium on Mobile ad hoc networking & computing (pp. 183-193).

Digital Library

Google Scholar

[8]

Tehrani, A. S., Molisch, A. F., & Caire, G. (2015, December). Directional ZigZag: Neighbor discovery with directional antennas. In 2015 IEEE Global Communications Conference (GLOBECOM) (pp. 1-6). IEEE.

Crossref

Google Scholar

[9]

Wang, Y., Mao, S., & Rappaport, T. S. (2017, June). On directional neighbor discovery in mmwave networks. In 2017 IEEE 37th international conference on distributed computing systems (ICDCS) (pp. 1704-1713). IEEE.

Google Scholar

[10]

Vasudevan, S., Kurose, J., & Towsley, D. (2005, March). On neighbor discovery in wireless networks with directional antennas. In Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies. (Vol. 4, pp. 2502-2512). IEEE.

Google Scholar

[11]

El Khamlichi, B., El Abbadi, J., Rowe, N. W., & Kumar, S. (2020, February). Adaptive Directional Neighbor Discovery Schemes in Wireless Networks. In 2020 International Conference on Computing, Networking and Communications (ICNC) (pp. 332-337). IEEE.

Google Scholar

[12]

Huang, S., Li, M., & Zhao, L. (2013, December). An intelligent neighbor discovery algorithm for Ad Hoc networks with directional antennas. In Proceedings 2013 International Conference on Mechatronic Sciences, Electric Engineering and Computer (MEC) (pp. 302-305). IEEE.

Google Scholar

[13]

Papoudakis, G., Christianos, F., Rahman, A., & Albrecht, S. V. (2019). Dealing with non-stationarity in multi-agent deep reinforcement learning. arXiv preprint arXiv:1906.04737.

Google Scholar

[14]

Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. MIT press.

Digital Library

Google Scholar

Cited By

View all

Yuan YRen GCai XLi X(2024)An Adaptive 3D Neighbor Discovery and Tracking Algorithm in Battlefield Flying Ad Hoc Networks with Directional AntennasSensors10.3390/s2417565524:17(5655)Online publication date: 30-Aug-2024
https://doi.org/10.3390/s24175655
Wang JFeng GQin SLiu YZhou JPeng YWang YZhang L(2024)Intelligent Beam Configuration for Neighbor Discovery in Ad Hoc Networks With Directional AntennasIEEE Transactions on Vehicular Technology10.1109/TVT.2024.343742573:12(18846-18862)Online publication date: Dec-2024
https://doi.org/10.1109/TVT.2024.3437425
Zhang HXie JWan YFu SLu K(2024)Advancing Networked Airborne Computing with MmWave for Air-to-Air CommunicationsProceedings of the International Symposium on Intelligent Computing and Networking 202410.1007/978-3-031-67447-1_3(34-50)Online publication date: 8-Aug-2024
https://doi.org/10.1007/978-3-031-67447-1_3
Show More Cited By

Recommendations

Efficient DSR route request flooding with directional antennas

In this paper, an efficient scheme for flooding the DSR route request in ad hoc networks using directional antennas is proposed. The scheme makes use of the local neighbor information provided by the neighbor discovery scheme. Route request packets are ...
How is the capacity of ad hoc networks improved with directional antennas?

The capacity of wireless ad hoc networks is constrained by the interference caused by the neighboring nodes. Gupta and Kumar have shown that the throughput for such networks is only Θ(W/√n) bits per second per node in a unit area domain when ...
A Robust Deafness-Free MAC Protocol for Directional Antennas in Ad Hoc Networks

Directional antennas provide many benefits such as high gain and increased transmission range in wireless networks. However, the deafness problem in directional antennas can greatly decrease transmission efficiency. For example, a source node fails to ...

Comments

Information & Contributors

Information

Published In

ICCBN '21: Proceedings of the 2021 9th International Conference on Communications and Broadband Networking

February 2021

342 pages

ISBN:9781450389174

DOI:10.1145/3456415

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCBN 2021

ICCBN 2021: 2021 9th International Conference on Communications and Broadband Networking

February 25 - 27, 2021

Shanghai, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
77
Total Downloads

Downloads (Last 12 months)22
Downloads (Last 6 weeks)3

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yuan YRen GCai XLi X(2024)An Adaptive 3D Neighbor Discovery and Tracking Algorithm in Battlefield Flying Ad Hoc Networks with Directional AntennasSensors10.3390/s2417565524:17(5655)Online publication date: 30-Aug-2024
https://doi.org/10.3390/s24175655
Wang JFeng GQin SLiu YZhou JPeng YWang YZhang L(2024)Intelligent Beam Configuration for Neighbor Discovery in Ad Hoc Networks With Directional AntennasIEEE Transactions on Vehicular Technology10.1109/TVT.2024.343742573:12(18846-18862)Online publication date: Dec-2024
https://doi.org/10.1109/TVT.2024.3437425
Zhang HXie JWan YFu SLu K(2024)Advancing Networked Airborne Computing with MmWave for Air-to-Air CommunicationsProceedings of the International Symposium on Intelligent Computing and Networking 202410.1007/978-3-031-67447-1_3(34-50)Online publication date: 8-Aug-2024
https://doi.org/10.1007/978-3-031-67447-1_3
Ruan SXu XZhang JZhou J(2023)Efficient Neighbor Discovery for Wide-Range FANET with Non-Uniform Directional Beams2023 9th International Conference on Computer and Communications (ICCC)10.1109/ICCC59590.2023.10507355(1379-1384)Online publication date: 8-Dec-2023
https://doi.org/10.1109/ICCC59590.2023.10507355
Wang JFeng GQin SLiu YZhou JPeng Y(2023)Intelligent Beam Configuration for Neighbor Discovery in Ad Hoc Networks with Directional AntennasICC 2023 - IEEE International Conference on Communications10.1109/ICC45041.2023.10278642(1843-1849)Online publication date: 28-May-2023
https://doi.org/10.1109/ICC45041.2023.10278642
Hong XLv NRen Z(2023)Oblivious neighbor discovery algorithms in airborne networks with directional multi-antennaAd Hoc Networks10.1016/j.adhoc.2022.103074141:COnline publication date: 15-Mar-2023
https://dl.acm.org/doi/10.1016/j.adhoc.2022.103074

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

Efficient DSR route request flooding with directional antennas

How is the capacity of ad hoc networks improved with directional antennas?

A Robust Deafness-Free MAC Protocol for Directional Antennas in Ad Hoc Networks

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations