Author: Chun-hung Chen
Publisher: World Scientific
ISBN: 9814282642
Category : Computers
Languages : en
Pages : 246
Get Book
Book Description
With the advance of new computing technology, simulation is becoming very popular for designing large, complex and stochastic engineering systems, since closed-form analytical solutions generally do not exist for such problems. However, the added flexibility of simulation often creates models that are computationally intractable. Moreover, to obtain a sound statistical estimate at a specified level of confidence, a large number of simulation runs (or replications) is usually required for each design alternative. If the number of design alternatives is large, the total simulation cost can be very expensive. Stochastic Simulation Optimization addresses the pertinent efficiency issue via smart allocation of computing resource in the simulation experiments for optimization, and aims to provide academic researchers and industrial practitioners with a comprehensive coverage of OCBA approach for stochastic simulation optimization. Starting with an intuitive explanation of computing budget allocation and a discussion of its impact on optimization performance, a series of OCBA approaches developed for various problems are then presented, from the selection of the best design to optimization with multiple objectives. Finally, this book discusses the potential extension of OCBA notion to different applications such as data envelopment analysis, experiments of design and rare-event simulation.
Author: Chun-Hung Chen
Publisher: World Scientific
ISBN: 9814513024
Category : Technology & Engineering
Languages : en
Pages : 274
Get Book
Book Description
Discrete event systems (DES) have become pervasive in our daily lives. Examples include (but are not restricted to) manufacturing and supply chains, transportation, healthcare, call centers, and financial engineering. However, due to their complexities that often involve millions or even billions of events with many variables and constraints, modeling these stochastic simulations has long been a “hard nut to crack”. The advance in available computer technology, especially of cluster and cloud computing, has paved the way for the realization of a number of stochastic simulation optimization for complex discrete event systems. This book will introduce two important techniques initially proposed and developed by Professor Y C Ho and his team; namely perturbation analysis and ordinal optimization for stochastic simulation optimization, and present the state-of-the-art technology, and their future research directions. Contents:Part I: Perturbation Analysis:The IPA Calculus for Hybrid SystemsSmoothed Perturbation Analysis: A Retrospective and Prospective LookPerturbation Analysis and Variance Reduction in Monte Carlo SimulationAdjoints and AveragingInfinitesimal Perturbation Analysis and Optimization AlgorithmsSimulation-based Optimization of Failure-prone Continuous Flow LinesPerturbation Analysis, Dynamic Programming, and BeyondPart II: Ordinal Optimization:Fundamentals of Ordinal OptimizationOptimal Computing Budget Allocation FrameworkNested PartitionsApplications of Ordinal Optimization Readership: Professionals in industrial and systems engineering, graduate reference for probability & statistics, stochastic analysis and general computer science, and research. Keywords:Simulation;Optimization;Stochastic Systems;Discrete-Even Systems;Perturbation Analysis;Ordinal Optimization
Author: Barry Nelson
Publisher: Springer Science & Business Media
ISBN: 146146160X
Category : Business & Economics
Languages : en
Pages : 285
Get Book
Book Description
This graduate-level text covers modeling, programming and analysis of simulation experiments and provides a rigorous treatment of the foundations of simulation and why it works. It introduces object-oriented programming for simulation, covers both the probabilistic and statistical basis for simulation in a rigorous but accessible manner (providing all necessary background material); and provides a modern treatment of experiment design and analysis that goes beyond classical statistics. The book emphasizes essential foundations throughout, rather than providing a compendium of algorithms and theorems and prepares the reader to use simulation in research as well as practice. The book is a rigorous, but concise treatment, emphasizing lasting principles but also providing specific training in modeling, programming and analysis. In addition to teaching readers how to do simulation, it also prepares them to use simulation in their research; no other book does this. An online solutions manual for end of chapter exercises is also provided.
Author: Georg Ch. Pflug
Publisher: Springer
ISBN: 9781461286318
Category : Business & Economics
Languages : en
Pages : 382
Get Book
Book Description
Stochastic models are everywhere. In manufacturing, queuing models are used for modeling production processes, realistic inventory models are stochastic in nature. Stochastic models are considered in transportation and communication. Marketing models use stochastic descriptions of the demands and buyer's behaviors. In finance, market prices and exchange rates are assumed to be certain stochastic processes, and insurance claims appear at random times with random amounts. To each decision problem, a cost function is associated. Costs may be direct or indirect, like loss of time, quality deterioration, loss in production or dissatisfaction of customers. In decision making under uncertainty, the goal is to minimize the expected costs. However, in practically all realistic models, the calculation of the expected costs is impossible due to the model complexity. Simulation is the only practicable way of getting insight into such models. Thus, the problem of optimal decisions can be seen as getting simulation and optimization effectively combined. The field is quite new and yet the number of publications is enormous. This book does not even try to touch all work done in this area. Instead, many concepts are presented and treated with mathematical rigor and necessary conditions for the correctness of various approaches are stated. Optimization of Stochastic Models: The Interface Between Simulation and Optimization is suitable as a text for a graduate level course on Stochastic Models or as a secondary text for a graduate level course in Operations Research.
Author: Michael C Fu
Publisher: Springer
ISBN: 1493913840
Category : Business & Economics
Languages : en
Pages : 387
Get Book
Book Description
The Handbook of Simulation Optimization presents an overview of the state of the art of simulation optimization, providing a survey of the most well-established approaches for optimizing stochastic simulation models and a sampling of recent research advances in theory and methodology. Leading contributors cover such topics as discrete optimization via simulation, ranking and selection, efficient simulation budget allocation, random search methods, response surface methodology, stochastic gradient estimation, stochastic approximation, sample average approximation, stochastic constraints, variance reduction techniques, model-based stochastic search methods and Markov decision processes. This single volume should serve as a reference for those already in the field and as a means for those new to the field for understanding and applying the main approaches. The intended audience includes researchers, practitioners and graduate students in the business/engineering fields of operations research, management science, operations management and stochastic control, as well as in economics/finance and computer science.
Author: James C. Spall
Publisher: John Wiley & Sons
ISBN: 0471441902
Category : Mathematics
Languages : en
Pages : 620
Get Book
Book Description
* Unique in its survey of the range of topics. * Contains a strong, interdisciplinary format that will appeal to both students and researchers. * Features exercises and web links to software and data sets.
Author: Georg Ch. Pflug
Publisher: Springer Science & Business Media
ISBN: 1461314496
Category : Business & Economics
Languages : en
Pages : 384
Get Book
Book Description
Stochastic models are everywhere. In manufacturing, queuing models are used for modeling production processes, realistic inventory models are stochastic in nature. Stochastic models are considered in transportation and communication. Marketing models use stochastic descriptions of the demands and buyer's behaviors. In finance, market prices and exchange rates are assumed to be certain stochastic processes, and insurance claims appear at random times with random amounts. To each decision problem, a cost function is associated. Costs may be direct or indirect, like loss of time, quality deterioration, loss in production or dissatisfaction of customers. In decision making under uncertainty, the goal is to minimize the expected costs. However, in practically all realistic models, the calculation of the expected costs is impossible due to the model complexity. Simulation is the only practicable way of getting insight into such models. Thus, the problem of optimal decisions can be seen as getting simulation and optimization effectively combined. The field is quite new and yet the number of publications is enormous. This book does not even try to touch all work done in this area. Instead, many concepts are presented and treated with mathematical rigor and necessary conditions for the correctness of various approaches are stated. Optimization of Stochastic Models: The Interface Between Simulation and Optimization is suitable as a text for a graduate level course on Stochastic Models or as a secondary text for a graduate level course in Operations Research.
Author: Warren B. Powell
Publisher: John Wiley & Sons
ISBN: 1119815037
Category : Mathematics
Languages : en
Pages : 1090
Get Book
Book Description
REINFORCEMENT LEARNING AND STOCHASTIC OPTIMIZATION Clearing the jungle of stochastic optimization Sequential decision problems, which consist of “decision, information, decision, information,” are ubiquitous, spanning virtually every human activity ranging from business applications, health (personal and public health, and medical decision making), energy, the sciences, all fields of engineering, finance, and e-commerce. The diversity of applications attracted the attention of at least 15 distinct fields of research, using eight distinct notational systems which produced a vast array of analytical tools. A byproduct is that powerful tools developed in one community may be unknown to other communities. Reinforcement Learning and Stochastic Optimization offers a single canonical framework that can model any sequential decision problem using five core components: state variables, decision variables, exogenous information variables, transition function, and objective function. This book highlights twelve types of uncertainty that might enter any model and pulls together the diverse set of methods for making decisions, known as policies, into four fundamental classes that span every method suggested in the academic literature or used in practice. Reinforcement Learning and Stochastic Optimization is the first book to provide a balanced treatment of the different methods for modeling and solving sequential decision problems, following the style used by most books on machine learning, optimization, and simulation. The presentation is designed for readers with a course in probability and statistics, and an interest in modeling and applications. Linear programming is occasionally used for specific problem classes. The book is designed for readers who are new to the field, as well as those with some background in optimization under uncertainty. Throughout this book, readers will find references to over 100 different applications, spanning pure learning problems, dynamic resource allocation problems, general state-dependent problems, and hybrid learning/resource allocation problems such as those that arose in the COVID pandemic. There are 370 exercises, organized into seven groups, ranging from review questions, modeling, computation, problem solving, theory, programming exercises and a “diary problem” that a reader chooses at the beginning of the book, and which is used as a basis for questions throughout the rest of the book.
Author: Barry L. Nelson
Publisher: Springer Nature
ISBN: 3030861945
Category : Business & Economics
Languages : en
Pages : 323
Get Book
Book Description
This graduate-level textbook covers modelling, programming and analysis of stochastic computer simulation experiments, including the mathematical and statistical foundations of simulation and why it works. The book is rigorous and complete, but concise and accessible, providing all necessary background material. Object-oriented programming of simulations is illustrated in Python, while the majority of the book is programming language independent. In addition to covering the foundations of simulation and simulation programming for applications, the text prepares readers to use simulation in their research. A solutions manual for end-of-chapter exercises is available for instructors.
Author: Abhijit Gosavi
Publisher: Springer
ISBN: 1489974911
Category : Business & Economics
Languages : en
Pages : 508
Get Book
Book Description
Simulation-Based Optimization: Parametric Optimization Techniques and Reinforcement Learning introduce the evolving area of static and dynamic simulation-based optimization. Covered in detail are model-free optimization techniques – especially designed for those discrete-event, stochastic systems which can be simulated but whose analytical models are difficult to find in closed mathematical forms. Key features of this revised and improved Second Edition include: · Extensive coverage, via step-by-step recipes, of powerful new algorithms for static simulation optimization, including simultaneous perturbation, backtracking adaptive search and nested partitions, in addition to traditional methods, such as response surfaces, Nelder-Mead search and meta-heuristics (simulated annealing, tabu search, and genetic algorithms) · Detailed coverage of the Bellman equation framework for Markov Decision Processes (MDPs), along with dynamic programming (value and policy iteration) for discounted, average, and total reward performance metrics · An in-depth consideration of dynamic simulation optimization via temporal differences and Reinforcement Learning: Q-Learning, SARSA, and R-SMART algorithms, and policy search, via API, Q-P-Learning, actor-critics, and learning automata · A special examination of neural-network-based function approximation for Reinforcement Learning, semi-Markov decision processes (SMDPs), finite-horizon problems, two time scales, case studies for industrial tasks, computer codes (placed online) and convergence proofs, via Banach fixed point theory and Ordinary Differential Equations Themed around three areas in separate sets of chapters – Static Simulation Optimization, Reinforcement Learning and Convergence Analysis – this book is written for researchers and students in the fields of engineering (industrial, systems, electrical and computer), operations research, computer science and applied mathematics.
