Abstract
We study radiation therapy scheduling problem where dynamically and stochastically arriving patients of different types are scheduled to future days. Unlike similar models in the literature, we consider cancellation of treatments. We formulate this dynamic multi-appointment patient scheduling problem as a Markov Decision Process (MDP). Since the MDP is intractable due to large state and action spaces, we employ a simulation-based approximate dynamic programming (ADP) approach to approximately solve our model. In particular, we develop Least-square based approximate policy iteration for solving our model. The performance of the ADP approach is compared with that of a myopic heuristic decision rule.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Astaraky D, Patrick J (2015) A simulation based approximate dynamic programming approach to multi-class, multi-resource surgica lscheduling. European Journal of Operational Research 245:309–319
Astaraky D (2013).A simulation based approximate dynamic programming approach to multi-class, multi-resource surgical scheduling. Master’s thesis, University of Ottawa
Conforti D, Guerriero F, Guido R, Veltri M (2011) An optimal decision-making approach for the management of radiotherapy patients. OR Spectrum 33:123–148
Conforti D, Guerriero F, Guido R (2010) Non-block scheduling with priority for radiotherapy treatments. European Journal of Operational Research 201:289–296
Crop F, Lacornerie T, Mirabel X, Lartigau E (2015) Workflow optimization for robotic stereotactic radiotherapy treatments: application of constant work in progress workflow. Operations Research for Healthcare 6:18–22
Erdely A, Topaloglu H (2010) Approximate dynamic programming for dynamic capacity allocation with multiple priority levels. IIE Transactions 43:129–142
Gocgun Y, Ghate A (2012) Lagrangian relaxation and constraint generation for allocation and advance scheduling. Computers Operations Research 39:2323–2336
Gocgun Y, Puterman ML (2014) Dynamic scheduling with due dates and time windows: an application to chemotherapy patient appointment booking. Health Care Management Science 17:60–76
Gupta D, Denton B (2008) Appointment scheduling in health care: challenges and opportunities. IIE Transactions 40:800–819
Herring WL, Herrmann JW (2011) Stochastic dynamic program for the single-day surgery scheduling problem. IIE Transactions on Healthcare Systems Engineering 1:213–225
National Cancer Institute (2016) Radiation therapy for cancer. http://www.cancer.gov/about-cancer/treatment/types/radiation-therapy/radiation-fact-sheet
Kim M, Ghate A, Phillips MH (2012) A stochastic control formalism for dynamic biologically conformal radiation therapy. European Journal of Operational Research 219:541–556
Lam SW, Lee LH, Tang LC (2007) An approximate dynamic programming approach for the empty container allocation problem. Transportation Research Part C 15:265–277
Lim GJ, Cao W (2012) A two-phase method for selecting imrt treatment beam angles: branch-and-prune and local neighborhood search. European Journal of Operational Research 217:609–618
Liu N, Ziya S, Kulkarni VG (2010) Dynamic scheduling of outpatient appointments under patient no-shows and cancellation. Manufacturing and Service Operations Management 12:347–364
Misic V, Aleman D, Sharpe M (2010) Neighborhood search approaches to noncoplanar beam orientation optimization for total marrow irradiation using imrt. European Journal of Operational Research 205:522–527
Nelson R (2008) Delay in radiation therapy affects outcomes in breast cancer. Medscape Medical News
Novoa C, Storer R (2009) An approximate dynamic programming approach for the vehicle routing problem with stochastic demands. European Journal of Operational Research 196:509–515
Parizi MS, Ghate A (2016) Multi-class, multi-resource advance scheduling with no-shows, cancellations and overbooking. Computers Operations Research 67:90–101
Patrick J, Puterman ML, Queyranne M (2008) Dynamic multi-priority patient scheduling for a diagnostic resource. Operations Research 56:1507–1525
Patrick J (2012) A markov decision model for determining optimal outpatient scheduling. Health Care Management Science 15:91–102
Peroni CV, Kaisare NS, Lee JH (2005) Optimal control of a fed-batch bioreactor using simulation-based approximate dynamic programming. IEEE Transactions on Control Systems Technology 13:786–790
Petrovic S, Castro E (2011) A genetic algorithm for radiotherapy pre-treatment scheduling. Applications of Evolutionary Computation 6625:454–463
Petrovic S and Leite-Rocha P (2008) Constructive and grasp approaches to radiotherapy treatment scheduling. Proceedings of the Advances in Electrical and Electronics Engineering, pages 192–200
Saure A, Patrick J, Tyldesley S, Puterman ML (2012) Dynamic multi-appointment patient scheduling for radiation therapy. European Journal of Operational Research 223:573–584
Truong VA (2014) Optimal advanced scheduling with expediting. http://www.columbia.edu/ vt2196/AdvanceSchedulingMSRevision2.pdf
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Gocgun, Y. Simulation-based approximate policy iteration for dynamic patient scheduling for radiation therapy. Health Care Manag Sci 21, 317–325 (2018). https://doi.org/10.1007/s10729-016-9388-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10729-016-9388-9