ISBN: 9781849966436

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. It i… More...

Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. It is well-known that many real-world problems modeled by MDPs have huge state and/or action spaces, leading to the notorious curse of dimensionality that makes practical solution of the resulting models intractable. In other cases, the system of interest is complex enough that it is not feasible to specify some of the MDP model parameters explicitly, but simulation samples are readily available (e. g., for random transitions and costs). For these settings, various sampling and population-based numerical algorithms have been developed recently to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function. Specific approaches include:• multi-stage adaptive sampling;• evolutionary policy iteration;• evolutionary random policy search; and• model reference adaptive search. Simulation-based Algorithms for Markov Decision Processesbrings this state-of-the-art research together for the first time and presents it in a manner that makes it accessible to researchers with varying interests and backgrounds. In addition to providing numerous specific algorithms, the exposition includes both illustrative numerical examples and rigorous theoretical convergence results. The algorithms developed and analyzed differ from the successful computational methods for solving MDPs based on neuro-dynamic programming or reinforcement learning and will complement work in those areas. Furthermore, the authors show how to combine the various algorithms introduced with approximate dynamic programming methods that reduce the size of the state space and ameliorate the effects of dimensionality. The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling and control, and simulation but will be a valuable source of instruction and reference for students of control and operations research. | Simulation-based Algorithms for Markov Decision Processes by Hyeong Soo Chang Paperback | Indigo Chapters Books > Science & Nature > Science > Engineering > Mechanical P10117, Hyeong Soo Chang<

2010, ISBN: 9781849966436

[ED: Softcover], [PU: Springer / Springer London / Springer, Berlin], Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in e… More...

[ED: Softcover], [PU: Springer / Springer London / Springer, Berlin], Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences. This book brings the state-of-the-art research together for the first time. It provides practical modeling methods for many real-world problems with high dimensionality or complexity which have not hitherto been treatable with Markov decision processes. 2010. xviii, 189 S. XVIII, 189 p. 38 illus. 235 mm Versandfertig in 6-10 Tagen, DE, [SC: 0.00], Neuware, gewerbliches Angebot, Offene Rechnung (Vorkasse vorbehalten)<

2010, ISBN: 1849966435

[EAN: 9781849966436], Neubuch, [PU: Springer London], CONTROL THEORY DECISION DYNAMIC PROGRAMMING EVOLUTIONARY POLICY ITERATION MARKOV PROCESSES MULTI-STAGE ADAPTIVE SAMPLING OPERATIONS R… More...

[EAN: 9781849966436], Neubuch, [PU: Springer London], CONTROL THEORY DECISION DYNAMIC PROGRAMMING EVOLUTIONARY POLICY ITERATION MARKOV PROCESSES MULTI-STAGE ADAPTIVE SAMPLING OPERATIONS RESEARCH SIMULATION STOCHASTIC MODEL TRANSIT ALGORITHMS MODELING UNTERNEHMENSFORSCHU, Dieser Artikel ist ein Print on Demand Artikel und wird nach Ihrer Bestellung fuer Sie gedruckt. Provides practical modeling methods for many real-world problems with high dimensionality or complextity which have not hitherto been treatable with Markov deci, Books<

2010, ISBN: 1849966435

[EAN: 9781849966436], Neubuch, [PU: Springer London], CONTROL THEORY DECISION DYNAMIC PROGRAMMING EVOLUTIONARY POLICY ITERATION MARKOV PROCESSES MULTI-STAGE ADAPTIVE SAMPLING OPERATIONS R… More...

[EAN: 9781849966436], Neubuch, [PU: Springer London], CONTROL THEORY DECISION DYNAMIC PROGRAMMING EVOLUTIONARY POLICY ITERATION MARKOV PROCESSES MULTI-STAGE ADAPTIVE SAMPLING OPERATIONS RESEARCH SIMULATION STOCHASTIC MODEL TRANSIT ALGORITHMS MODELING UNTERNEHMENSFORSCHU, Dieser Artikel ist ein Print on Demand Artikel und wird nach Ihrer Bestellung fuer Sie gedruckt. Provides practical modeling methods for many real-world problems with high dimensionality or complextity which have not hitherto been treatable with Markov deci, Books<

2010, ISBN: 9781849966436

Paperback

[ED: Kartoniert / Broschiert], [PU: Springer London], Dieser Artikel ist ein Print on Demand Artikel und wird nach Ihrer Bestellung fuer Sie gedruckt. Provides practical modeling methods … More...

[ED: Kartoniert / Broschiert], [PU: Springer London], Dieser Artikel ist ein Print on Demand Artikel und wird nach Ihrer Bestellung fuer Sie gedruckt. Provides practical modeling methods for many real-world problems with high dimensionality or complextity which have not hitherto been treatable with Markov deci, DE, [SC: 0.00], Neuware, gewerbliches Angebot, Softcover, 189, [GW: 299g], 1. Auflage, Banküberweisung, PayPal, [CT: Englischsprachige Bücher / Sonstiges - Englisch]<