Abstract
The rental housing market plays a critical role in the United States real estate market. Prior studies have used various approaches to model housing rent, such as interpolation, hedonic modeling, and machine learning. However, only a few studies have modeled rental prices based on textual data, which provides rich and contextual information about rental properties. In addition, many models, especially deep learning models, use an end-to-end black box for prediction, which hides the decision process. Such models are difficult to interpret and explain the driving factors. This study builds on our previous work, aiming to develop and evaluate rental market spatial dynamics models combining Long Short-Term Memory (LSTM) networks and self-attention mechanism. We compare the performance of the proposed model with our previous models on predicting rental prices in Atlanta, Georgia, USA. We also use techniques from saliency maps to explain the generated model. Results show that the self-attention-based model outperforms our previous models. The saliency map techniques reveal how the model attends to a different part of the textual information. The predicted results reflect the spatial variation of textual information. Such a model offers practical pricing references for homeowners and renters, and spatial patterns for urban planners and stakeholders.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alonso W (1960) A theory of the urban land market. Pap Reg Sci 6(1):149–157
Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166
Chen Y, Liu X, Li X, Liu Y, Xu X (2016) Mapping the fine-scale spatial pattern of housing rent in the metropolitan area by using online rental listings and ensemble learning. Appl Geogr 75:200–212
Choo J, Liu S (2018) Visual analytics for explainable deep learning. IEEE Comput Graph Appl 38(4):84–92
Harvey D (1974) Class-monopoly rent, finance capital and the urban revolution. Reg Stud 8(3–4):239–255
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition
Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780
Hu L, He S, Han Z, Xiao H, Su S, Weng M, Cai Z (2019) Monitoring housing rental prices based on social media: an integrated approach of machine-learning algorithms and hedonic modeling to inform equitable housing policies. Land Use Policy 82:657–673
Kalehbasti, P. R., Nikolenko, L., & Rezaei, H. (2019). Airbnb price prediction using machine learning and sentiment analysis. arXiv preprint arXiv:1907.12665. https://arxiv.org/abs/1907.12665.
Kang Y, Zhang F, Peng W, Gao S, Rao J, Duarte F, Ratti C (2020) Understanding house price appreciation using multi-source big geo-data and machine learning. Land Use Policy 104919. https://www.sciencedirect.com/science/article/abs/pii/S0264837719316746
Lopez-Morales E (2011) Gentrification by ground rent dispossession: the shadows cast by large-scale urban renewal in Santiago de Chile. Int J Urban Reg Res 35(2):330–357
Mullainathan S, Spiess J (2017) Machine learning: an applied econometric approach. J Econ Perspect 31(2):87–106
Pennington J, Socher R, Manning CD (2014) Glove: Global vectors for word representation. Paper presented at the proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pp 1532–1543
Shen, T., Zhou, T., Long, G., Jiang, J., Pan, S., & Zhang, C. (2018). Disan: directional self-attention network for rnn/cnn-free language understanding. Paper presented at the Thirty-Second AAAI Conference on Artificial Intelligence
Sirmans G, John B (1991) Determinants of market rent. J Real Estate Res 6(3):357–379
Tan, Z., Wang, M., Xie, J., Chen, Y., & Shi, X. (2018). Deep semantic role labeling with self-attention. Paper presented at the Thirty-Second AAAI Conference on Artificial Intelligence
Thrall GI (2017) Land use and urban form: The consumption theory of land rent. Routledge, Oxford
Tong, W., Li, L., Zhou, X., & Hamilton, A. (2018). Learning Air Pollution with Bidirectional LSTM RNN. Paper presented at the 11th EAI international conference on Mobile multimedia communications
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., . . . Polosukhin, I. (2017). Attention is all you need. Paper presented at the Advances in neural information processing systems
Zhou X, Tong W, Li D (2019) Modeling housing rent in the Atlanta metropolitan area using textual information and deep learning. ISPRS Int J Geo Inf 8(8):349
Availability of data and material
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
Code availability
The code generated during the current study are available from the corresponding author on reasonable request.
Funding
XZ did not receive any specific grant from funding agencies in the public, commercial, or not-for-profit sectors. WT was supported by Office of Research Development and Administration at Eastern Michigan University.
Author information
Authors and Affiliations
Contributions
Not applicable.
Corresponding author
Ethics declarations
Conflicts of interest/competing interests
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Additional information
Communicated by: H. Babaie
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhou, X., Tong, W. Learning with self-attention for rental market spatial dynamics in the Atlanta metropolitan area. Earth Sci Inform 14, 837–845 (2021). https://doi.org/10.1007/s12145-021-00589-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12145-021-00589-3