Xi Yang
Suining He
ABSTRACT
Thanks to advances in the urban big data, the bike sharing, especially station-based bike sharing, has emerged as the important first-/last-mile connectivities in many smart cities. Bike station network (BSN) expansion recommendation, i.e., recommending placement locations of new stations, is essential for satisfying local mobility demands, enhancing the BSN service quality, and may significantly affect the resource fairness and accessibility of different communities in the neighborhood. Furthermore, the dynamic and complex urban mobility environments make the station placement highly challenging to satisfy the mobility needs.
To ease and facilitate the urban planning with awareness of mobility equity, we have designed and proposed CGIRL, a novel equity-aware Cross-Graph Interactive Reinforcement Learning approach for BSN expansion recommendation. Specifically, we have designed a novel reward function within our actor-critic reinforcement learning approach, jointly accounting for the local mobility, bike resource distribution equity, and accessibility of different socioeconomic groups to the expanded stations. To capture the policy of station decisions from the BSN deployment, we integrate the location graph's mobility and equity correlations across the city regions as a graph network, and design a novel cross-graph interaction network with embedding attention and sequential dependency that adaptively captures and interactively differentiates the correlations within station placement. Our extensive experimental studies upon a total of 393 (111 new) bike stations from New York City (NYC), Washington D.C. (DC), and Chicago have validated the effectiveness of CGIRL in the equity-aware BSN expansion recommendation.
- 2021. Aiming for Equity, Indego Adding 30 Bike-Share Stations, E-Bikes in 2022. https://www.nbcphiladelphia.com/news/green/indego-2022-bike-share-expansion/3034356/Google Scholar
- 2021. Bike Share is Rapidly Taking the World by Storm Post-Covid. https://www.globenewswire.com/news-release/2021/09/30/2306599/0/en/Bike-Share-is-Rapidly-Taking-the-World-by-Storm-Post-Covid.htmlGoogle Scholar
- Chacha Chen, Hua Wei, Nan Xu, Guanjie Zheng, Ming Yang, Yuanhao Xiong, Kai Xu, and Zhenhui Li. 2020. Toward a thousand lights: Decentralized deep reinforcement learning for large-scale traffic signal control. In Proc. AAAI.Google ScholarCross Ref
- Kamil Ciosek, Quan Vuong, Robert Loftin, and Katja Hofmann. 2019. Better exploration with optimistic actor-critic. arXiv preprint arXiv:1910.12807 (2019).Google Scholar
- Greg P Griffin and Junfeng Jiao. 2019. Crowdsourcing bike share station locations: Evaluating participation and placement. Journal of the American Planning Association (2019).Google ScholarCross Ref
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proc. IEEE CVPR.Google ScholarCross Ref
- Suining He and Kang G Shin. 2020. Towards fine-grained flow forecasting: A graph attention approach for bike sharing systems. In Proc. ACM WWW.Google ScholarDigital Library
- Suining He and Kang G. Shin. 2022. Information Fusion for (Re)Configuring Bike Station Networks With Crowdsourcing. IEEE TKDE (2022).Google Scholar
- Hsun-Ping Hsieh, Fandel Lin, Jiawei Jiang, Tzu-Ying Kuo, and Yu-En Chang. 2021. Inferring Long-Term Demand of Newly Established Stations for Expansion Areas in Bike Sharing System. Applied Sciences (2021).Google Scholar
- Shenggong Ji, Zhaoyuan Wang, Tianrui Li, and Yu Zheng. 2020. Spatio-temporal feature fusion for dynamic taxi route recommendation via deep reinforcement learning. Knowledge-Based Systems (2020).Google Scholar
- Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).Google Scholar
- Yexin Li, Yu Zheng, Huichu Zhang, and Lei Chen. 2015. Traffic prediction in a bike-sharing system. In Proc. ACM SIGSPATIAL.Google ScholarDigital Library
- Junming Liu, Leilei Sun, Qiao Li, Jingci Ming, Yanchi Liu, and Hui Xiong. 2017. Functional zone based hierarchical demand prediction for bike system expansion. In Proc. ACM SIGKDD.Google ScholarDigital Library
- Kunpeng Liu, Xiaolin Li, Cliff C Zou, Haibo Huang, and Yanjie Fu. 2020. Ambulance dispatch via deep reinforcement learning. In Proc. ACM SIGSPATIAL.Google ScholarDigital Library
- Ryan Lowe, Yi Wu, Aviv Tamar, Jean Harb, Pieter Abbeel, and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. arXiv preprint arXiv:1706.02275 (2017).Google Scholar
- Mahmoud Owais and Mostafa K Osman. 2018. Complete hierarchical multi-objective genetic algorithm for transit network design problem. Expert Systems with Applications (2018).Google Scholar
- Xiaodong Qian and Miguel Jaller. 2020. Bikesharing, equity, and disadvantaged communities: A case study in Chicago. Transportation Research Part A: Policy and Practice (2020).Google Scholar
- Susan A Shaheen, Elliot W Martin, Adam P Cohen, Nelson D Chan, and Mike Pogodzinski. 2014. Public Bikesharing in North America During a Period of Rapid Expansion: Understanding Business Models, Industry Trends & User Impacts, MTI Report 12--29. (2014).Google Scholar
- Umer Siddique, Paul Weng, and Matthieu Zimmer. 2020. Learning Fair Policies in Multi-Objective (Deep) Reinforcement Learning with Average and Discounted Rewards. In Proc. ICML. PMLR.Google Scholar
- David Silver, Guy Lever, Nicolas Heess, Thomas Degris, Daan Wierstra, and Martin Riedmiller. 2014. Deterministic policy gradient algorithms. In Proc. ICML.Google Scholar
- Richard S Sutton, David A McAllester, Satinder P Singh, and Yishay Mansour. 2000. Policy gradient methods for reinforcement learning with function approximation. In Proc. NeurIPS.Google Scholar
- Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 (2017).Google Scholar
- Yi Wei, Jian Gang Jin, Jingfeng Yang, and Linjun Lu. 2019. Strategic network expansion of urban rapid transit systems: A bi-objective programming model. Computer-Aided Civil and Infrastructure Engineering (2019).Google Scholar
- Yu Wei, Minjia Mao, Xi Zhao, Jianhua Zou, and Ping An. 2020. City metro network expansion with reinforcement learning. In Proc. ACM SIGKDD.Google ScholarDigital Library
- Ronald J Williams. 1992. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning (1992).Google Scholar
- An Yan and Bill Howe. 2020. Fairness-Aware Demand Prediction for New Mobility. In Proc. AAAI.Google ScholarCross Ref
- Zhongzhen Yang, Bin Yu, and Chuntian Cheng. 2007. A parallel ant colony algorithm for bus network optimization. Computer-Aided Civil and Infrastructure Engineering (2007).Google Scholar
- Yin Zhang, Yujie Li, Ranran Wang, M Shamim Hossain, and Huimin Lu. 2020. Multi-aspect aware session-based recommendation for intelligent transportation services. IEEE T-ITS (2020).Google Scholar
- Ding Zhou, Hao Liu, Tong Xu, Le Zhang, Rui Zha, and Hui Xiong. 2021. Transportation recommendation with fairness consideration. In Proc. Springer DASFAA.Google Scholar
Index Terms
- Equity-Aware Cross-Graph Interactive Reinforcement Learning for Bike Station Network Expansion
Recommendations
City Metro Network Expansion with Reinforcement Learning
KDD '20: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data MiningCity metro network expansion, included in the transportation network design, aims to design new lines based on the existing metro network. Existing methods in the field of transportation network design either (i) can hardly formulate this problem ...
MetroGNN: Metro Network Expansion with Reinforcement Learning
WWW '24: Companion Proceedings of the ACM on Web Conference 2024Selecting urban regions for metro network expansion to meet maximal transportation demands is crucial for urban development, while computationally challenging to solve. The expansion process relies not only on complicated features like urban demographics ...
Functional Zone Based Hierarchical Demand Prediction For Bike System Expansion
KDD '17: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data MiningBike sharing systems, aiming at providing the missing links in public transportation systems, are becoming popular in urban cities. Many providers of bike sharing systems are ready to expand their bike stations from the existing service area to ...
Comments