Dynamic Rebalancing Problems for Bike-Sharing Systems: Mixed-Integer Programming and Reinforcement Learning Approach

EI-ERIM-OR seminar
ESE - Bike Sharing

Bike-sharing systems (BSSs) offer a sustainable and efficient transportation solution in urban areas, yet face challenges due to fluctuating demand and peak-hour imbalances, often resulting in bike or dock shortages. To tackle these dynamic rebalancing challenges, we utilise both Mixed-Integer Programming (MIP) and Reinforcement Learning (RL) to minimise lost demand across stations. 

Speaker
Jiaqi Liang
Date
Friday 8 Nov 2024, 12:00 - 13:00
Type
Seminar
Room
ET-14
Building
E Building
Add to calendar

We first introduce a comprehensive MIP framework for multi-period rebalancing problems, which allows for a detailed analysis of various modeling assumptions, including time discretisation, trip distribution, variable domains, and event sequences. Through extensive experiments on both synthetic data and real-world data, the effectiveness of different modeling assumptions and techniques is identified.

Building on this foundation, we then leverage RL-based approaches to enable real-time rebalancing, especially addressing the limitations of time discretisation in MIP. Our Markov Decision Process (MDP) model is designed with state and action spaces crafted in a continuous-time framework, facilitating seamless cooperation among multiple rebalancing vehicles.

Two learning methods are explored, where the routing and inventory decisions are made simultaneously or separately. This RL approach further enhances both the realism and efficiency of rebalancing, reducing lost demand and improving system performance.

ESE - Jiaqi Liang

About the speaker

Jiaqi Liang is a postdoctoral fellow at Polytechnique Montreal working on machine learning and rebalancing problems for bike sharing systems.

See also

More information

Lunch will be provided (vegetarian option included).

For more information please contact the Secretariat Econometrics at eb-secr@ese.eur.nl

Compare @count study programme

  • @title

    • Duration: @duration
Compare study programmes