Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding Strategies
We study how N intelligent buses serving a loop of M bus stops learn a no-boarding strategy and a holding strategy by reinforcement learning. The no-boarding and holding strategies emerge from the actions of stay or leave when a bus is at a bus stop and everyone who wishes to alight has done so. A r...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2020-01-01
|
| Series: | Complexity |
| Online Access: | http://dx.doi.org/10.1155/2020/7274254 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832566095059353600 |
|---|---|
| author | Vee-Liem Saw Luca Vismara Lock Yue Chew |
| author_facet | Vee-Liem Saw Luca Vismara Lock Yue Chew |
| author_sort | Vee-Liem Saw |
| collection | DOAJ |
| description | We study how N intelligent buses serving a loop of M bus stops learn a no-boarding strategy and a holding strategy by reinforcement learning. The no-boarding and holding strategies emerge from the actions of stay or leave when a bus is at a bus stop and everyone who wishes to alight has done so. A reward that encourages the buses to strive towards a staggered phase difference amongst them whilst picking up passengers allows the reinforcement learning process to converge to an optimal Q-table within a reasonable amount of simulation time. It is remarkable that this emergent behaviour of intelligent buses turns out to minimise the average waiting time of commuters, in various setups where buses move with the same speed or different speeds, during busy as well as lull periods. Cooperative actions are also observed, e.g., the buses learn to unbunch. |
| format | Article |
| id | doaj-art-c04807484f05491f8f147407f3a604b8 |
| institution | Kabale University |
| issn | 1076-2787 1099-0526 |
| language | English |
| publishDate | 2020-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Complexity |
| spelling | doaj-art-c04807484f05491f8f147407f3a604b82025-02-03T01:05:08ZengWileyComplexity1076-27871099-05262020-01-01202010.1155/2020/72742547274254Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding StrategiesVee-Liem Saw0Luca Vismara1Lock Yue Chew2Division of Physics and Applied Physics, School of Physical and Mathematical Sciences, 21 Nanyang Link, Nanyang Technological University, SingaporeDivision of Physics and Applied Physics, School of Physical and Mathematical Sciences, 21 Nanyang Link, Nanyang Technological University, SingaporeDivision of Physics and Applied Physics, School of Physical and Mathematical Sciences, 21 Nanyang Link, Nanyang Technological University, SingaporeWe study how N intelligent buses serving a loop of M bus stops learn a no-boarding strategy and a holding strategy by reinforcement learning. The no-boarding and holding strategies emerge from the actions of stay or leave when a bus is at a bus stop and everyone who wishes to alight has done so. A reward that encourages the buses to strive towards a staggered phase difference amongst them whilst picking up passengers allows the reinforcement learning process to converge to an optimal Q-table within a reasonable amount of simulation time. It is remarkable that this emergent behaviour of intelligent buses turns out to minimise the average waiting time of commuters, in various setups where buses move with the same speed or different speeds, during busy as well as lull periods. Cooperative actions are also observed, e.g., the buses learn to unbunch.http://dx.doi.org/10.1155/2020/7274254 |
| spellingShingle | Vee-Liem Saw Luca Vismara Lock Yue Chew Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding Strategies Complexity |
| title | Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding Strategies |
| title_full | Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding Strategies |
| title_fullStr | Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding Strategies |
| title_full_unstemmed | Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding Strategies |
| title_short | Intelligent Buses in a Loop Service: Emergence of No-Boarding and Holding Strategies |
| title_sort | intelligent buses in a loop service emergence of no boarding and holding strategies |
| url | http://dx.doi.org/10.1155/2020/7274254 |
| work_keys_str_mv | AT veeliemsaw intelligentbusesinaloopserviceemergenceofnoboardingandholdingstrategies AT lucavismara intelligentbusesinaloopserviceemergenceofnoboardingandholdingstrategies AT lockyuechew intelligentbusesinaloopserviceemergenceofnoboardingandholdingstrategies |