Deep Q-learning for same-day delivery with vehicles and drones
From MaRDI portal
Publication:2076870
Abstract: In this paper, we consider same-day delivery with vehicles and drones. Customers make delivery requests over the course of the day, and the dispatcher dynamically dispatches vehicles and drones to deliver the goods to customers before their delivery deadline. Vehicles can deliver multiple packages in one route but travel relatively slowly due to the urban traffic. Drones travel faster, but they have limited capacity and require charging or battery swaps. To exploit the different strengths of the fleets, we propose a deep Q-learning approach. Our method learns the value of assigning a new customer to either drones or vehicles as well as the option to not offer service at all. In a systematic computational analysis, we show the superiority of our policy compared to benchmark policies and the effectiveness of our deep Q-learning approach. We also show that our policy can maintain effectiveness when the fleet size changes moderately. Experiments on data drawn from varied spatial/temporal distributions demonstrate that our trained policies can cope with changes in the input data.
Recommendations
- Same-day delivery with pickup stations and autonomous vehicles
- The vehicle routing problem with drones: several worst-case results
- The dynamic dispatch waves problem for same-day delivery
- Improved delivery policies for future drone-based delivery systems
- The parallel drone scheduling problem with multiple drones and vehicles
Cites work
- A dynamic traveling salesman problem with stochastic arc costs
- A dynamic vehicle routing problem with multiple delivery routes
- A unified framework for stochastic optimization
- An optimization-driven dynamic vehicle routing algorithm for on-demand meal delivery using drones
- Meso-parametric value function approximation for dynamic customer acceptances in delivery routing
- Neural networks for automated vehicle dispatching
- Reinforcement learning. An introduction
- Same-day delivery with pickup stations and autonomous vehicles
- Scenario-Based Planning for Partially Dynamic Vehicle Routing with Stochastic Customers
- The dynamic dispatch waves problem for same-day delivery
Cited in
(16)- Same-day delivery with pickup stations and autonomous vehicles
- Opportunities for reinforcement learning in stochastic dynamic vehicle routing
- Dynamic service area sizing in urban delivery
- Off-line approximate dynamic programming for the vehicle routing problem with a highly variable customer basis and stochastic demands
- Recent advances in integrating demand management and vehicle routing: a methodological review
- Same-day delivery with fair customer service
- Dynamic priority rules for combining on-demand passenger transportation and transportation of goods
- Balancing resources for dynamic vehicle routing with stochastic customer requests
- Fleet resupply by drones for last-mile delivery
- The stochastic and dynamic inventory routing problem with fine time granularity: a reinforcement learning approach
- Dynamic crowdsourcing problem in urban-rural distribution using the learning-based approach
- Time-dependent electric vehicle-drone routing problem for scheduled deliveries and on-demand pickups considering variable drone speeds and no-fly zones
- Emerging optimization problems for distribution in same-day delivery
- Optimizing task assignment and routing operations with a heterogeneous fleet of unmanned aerial vehicles for emergency healthcare services
- Dynamic pickup-and-delivery for collaborative platforms with time-dependent travel and crowdshipping
- Shaping decision models for stochastic dynamic optimization problems via reinforcement learning
This page was built for publication: Deep Q-learning for same-day delivery with vehicles and drones
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2076870)
