Fast Sequential Monte Carlo Methods for Counting and Optimization

A comprehensive overview of Monte Carlo simulation that explores the latest topics, techniques, and real-world applications More and more of today’s numerical problems found in engineering and finance are solved through Monte Carlo methods. The heightened popularity of these methods and their continuing development makes it important for researchers to have a comprehensive understanding of the Monte Carlo approach. Handbook of Monte Carlo Methods provides the theory, algorithms, and applications that helps provide a thorough understanding of the emerging dynamics of this rapidly-growing field. The authors begin with a discussion of fundamentals such as how to generate random numbers on a computer. Subsequent chapters discuss key Monte Carlo topics and methods, including: Random variable and stochastic process generation Markov chain Monte Carlo, featuring key algorithms such as the Metropolis-Hastings method, the Gibbs sampler, and hit-and-run Discrete-event simulation Techniques for the statistical analysis of simulation data including the delta method, steady-state estimation, and kernel density estimation Variance reduction, including importance sampling, latin hypercube sampling, and conditional Monte Carlo Estimation of derivatives and sensitivity analysis Advanced topics including cross-entropy, rare events, kernel density estimation, quasi Monte Carlo, particle systems, and randomized optimization The presented theoretical concepts are illustrated with worked examples that use MATLAB®, a related Web site houses the MATLAB® code, allowing readers to work hands-on with the material and also features the author's own lecture notes on Monte Carlo methods. Detailed appendices provide background material on probability theory, stochastic processes, and mathematical statistics as well as the key optimization concepts and techniques that are relevant to Monte Carlo simulation. Handbook of Monte Carlo Methods is an excellent reference for applied statisticians and practitioners working in the fields of engineering and finance who use or would like to learn how to use Monte Carlo in their research. It is also a suitable supplement for courses on Monte Carlo methods and computational statistics at the upper-undergraduate and graduate levels.

This introduction to Monte Carlo Methods seeks to identify and study the unifying elements that underlie their effective application. It focuses on two basic themes. The first is the importance of random walks as they occur both in natural stochastic systems and in their relationship to integral and differential equations. The second theme is that of variance reduction in general and importance sampling in particular as a technique for efficient use of the methods. Random walks are introduced with an elementary example in which the modelling of radiation transport arises directly from a schematic probabilistic description of the interaction of radiation with matter. Building on that example, the relationship between random walks and integral equations is outlined. The applicability of these ideas to other problems is shown by a clear and elementary introduction to the solution of the Schrodinger equation by random walks. The detailed discussion of variance reduction includes Monte Carlo evaluation of finite-dimensional integrals. Special attention is given to importance sampling, partly because of its intrinsic interest in quadrature, partly because of its general usefulness in the solution of integral equations. One significant feature is that Monte Carlo Methods treats the «Metropolis algorithm» in the context of sampling methods, clearly distinguishing it from importance sampling. Physicists, chemists, statisticians, mathematicians, and computer scientists will find Monte Carlo Methods a complete and stimulating introduction.

Markov Chain Monte Carlo (MCMC) methods are now an indispensable tool in scientific computing. This book discusses recent developments of MCMC methods with an emphasis on those making use of past sample information during simulations. The application examples are drawn from diverse fields such as bioinformatics, machine learning, social science, combinatorial optimization, and computational physics. Key Features: Expanded coverage of the stochastic approximation Monte Carlo and dynamic weighting algorithms that are essentially immune to local trap problems. A detailed discussion of the Monte Carlo Metropolis-Hastings algorithm that can be used for sampling from distributions with intractable normalizing constants. Up-to-date accounts of recent developments of the Gibbs sampler. Comprehensive overviews of the population-based MCMC algorithms and the MCMC algorithms with adaptive proposals. This book can be used as a textbook or a reference book for a one-semester graduate course in statistics, computational biology, engineering, and computer sciences. Applied or theoretical researchers will also find this book beneficial.

In a probabilistic model, a rare event is an event with a very small probability of occurrence. The forecasting of rare events is a formidable task but is important in many areas. For instance a catastrophic failure in a transport system or in a nuclear power plant, the failure of an information processing system in a bank, or in the communication network of a group of banks, leading to financial losses. Being able to evaluate the probability of rare events is therefore a critical issue. Monte Carlo Methods, the simulation of corresponding models, are used to analyze rare events. This book sets out to present the mathematical tools available for the efficient simulation of rare events. Importance sampling and splitting are presented along with an exposition of how to apply these tools to a variety of fields ranging from performance and dependability evaluation of complex systems, typically in computer science or in telecommunications, to chemical reaction analysis in biology or particle transport in physics. Graduate students, researchers and practitioners who wish to learn and apply rare event simulation techniques will find this book beneficial.

Simulation and Monte Carlo is aimed at students studying for degrees in Mathematics, Statistics, Financial Mathematics, Operational Research, Computer Science, and allied subjects, who wish an up-to-date account of the theory and practice of Simulation. Its distinguishing features are in-depth accounts of the theory of Simulation, including the important topic of variance reduction techniques, together with illustrative applications in Financial Mathematics, Markov chain Monte Carlo, and Discrete Event Simulation. Each chapter contains a good selection of exercises and solutions with an accompanying appendix comprising a Maple worksheet containing simulation procedures. The worksheets can also be downloaded from the web site supporting the book. This encourages readers to adopt a hands-on approach in the effective design of simulation experiments. Arising from a course taught at Edinburgh University over several years, the book will also appeal to practitioners working in the finance industry, statistics and operations research.

This accessible new edition explores the major topics in Monte Carlo simulation that have arisen over the past 30 years and presents a sound foundation for problem solving Simulation and the Monte Carlo Method, Third Edition reflects the latest developments in the field and presents a fully updated and comprehensive account of the state-of-the-art theory, methods and applications that have emerged in Monte Carlo simulation since the publication of the classic First Edition over more than a quarter of a century ago. While maintaining its accessible and intuitive approach, this revised edition features a wealth of up-to-date information that facilitates a deeper understanding of problem solving across a wide array of subject areas, such as engineering, statistics, computer science, mathematics, and the physical and life sciences. The book begins with a modernized introduction that addresses the basic concepts of probability, Markov processes, and convex optimization. Subsequent chapters discuss the dramatic changes that have occurred in the field of the Monte Carlo method, with coverage of many modern topics including: Markov Chain Monte Carlo, variance reduction techniques such as importance (re-)sampling, and the transform likelihood ratio method, the score function method for sensitivity analysis, the stochastic approximation method and the stochastic counter-part method for Monte Carlo optimization, the cross-entropy method for rare events estimation and combinatorial optimization, and application of Monte Carlo techniques for counting problems. An extensive range of exercises is provided at the end of each chapter, as well as a generous sampling of applied examples. The Third Edition features a new chapter on the highly versatile splitting method, with applications to rare-event estimation, counting, sampling, and optimization. A second new chapter introduces the stochastic enumeration method, which is a new fast sequential Monte Carlo method for tree search. In addition, the Third Edition features new material on: • Random number generation, including multiple-recursive generators and the Mersenne Twister • Simulation of Gaussian processes, Brownian motion, and diffusion processes • Multilevel Monte Carlo method • New enhancements of the cross-entropy (CE) method, including the “improved” CE method, which uses sampling from the zero-variance distribution to find the optimal importance sampling parameters • Over 100 algorithms in modern pseudo code with flow control • Over 25 new exercises Simulation and the Monte Carlo Method, Third Edition is an excellent text for upper-undergraduate and beginning graduate courses in stochastic simulation and Monte Carlo techniques. The book also serves as a valuable reference for professionals who would like to achieve a more formal understanding of the Monte Carlo method. Reuven Y. Rubinstein, DSc, was Professor Emeritus in the Faculty of Industrial Engineering and Management at Technion-Israel Institute of Technology. He served as a consultant at numerous large-scale organizations, such as IBM, Motorola, and NEC. The author of over 100 articles and six books, Dr. Rubinstein was also the inventor of the popular score-function method in simulation analysis and generic cross-entropy methods for combinatorial optimization and counting. Dirk P. Kroese, PhD, is a Professor of Mathematics and Statistics in the School of Mathematics and Physics of The University of Queensland, Australia. He has published over 100 articles and four books in a wide range of areas in applied probability and statistics, including Monte Carlo methods, cross-entropy, randomized algorithms, tele-traffic c theory, reliability, computational statistics, applied probability, and stochastic modeling.

Fully describes optimization methods that are currently most valuable in solving real-life problems. Since optimization has applications in almost every branch of science and technology, the text emphasizes their practical aspects in conjunction with the heuristics useful in making them perform more reliably and efficiently. To this end, it presents comparative numerical studies to give readers a feel for possibile applications and to illustrate the problems in assessing evidence. Also provides theoretical background which provides insights into how methods are derived. This edition offers revised coverage of basic theory and standard techniques, with updated discussions of line search methods, Newton and quasi-Newton methods, and conjugate direction methods, as well as a comprehensive treatment of restricted step or trust region methods not commonly found in the literature. Also includes recent developments in hybrid methods for nonlinear least squares; an extended discussion of linear programming, with new methods for stable updating of LU factors; and a completely new section on network programming. Chapters include computer subroutines, worked examples, and study questions.

Mark H.A. Davis introduced the Piecewise-Deterministic Markov Process (PDMP) class of stochastic hybrid models in an article in 1984. Today it is used to model a variety of complex systems in the fields of engineering, economics, management sciences, biology, Internet traffic, networks and many more. Yet, despite this, there is very little in the way of literature devoted to the development of numerical methods for PDMDs to solve problems of practical importance, or the computational control of PDMPs. This book therefore presents a collection of mathematical tools that have been recently developed to tackle such problems. It begins by doing so through examples in several application domains such as reliability. The second part is devoted to the study and simulation of expectations of functionals of PDMPs. Finally, the third part introduces the development of numerical techniques for optimal control problems such as stopping and impulse control problems.

This accessible new edition explores the major topics in Monte Carlo simulation Simulation and the Monte Carlo Method, Second Edition reflects the latest developments in the field and presents a fully updated and comprehensive account of the major topics that have emerged in Monte Carlo simulation since the publication of the classic First Edition over twenty-five years ago. While maintaining its accessible and intuitive approach, this revised edition features a wealth of up-to-date information that facilitates a deeper understanding of problem solving across a wide array of subject areas, such as engineering, statistics, computer science, mathematics, and the physical and life sciences. The book begins with a modernized introduction that addresses the basic concepts of probability, Markov processes, and convex optimization. Subsequent chapters discuss the dramatic changes that have occurred in the field of the Monte Carlo method, with coverage of many modern topics including: Markov Chain Monte Carlo Variance reduction techniques such as the transform likelihood ratio method and the screening method The score function method for sensitivity analysis The stochastic approximation method and the stochastic counter-part method for Monte Carlo optimization The cross-entropy method to rare events estimation and combinatorial optimization Application of Monte Carlo techniques for counting problems, with an emphasis on the parametric minimum cross-entropy method An extensive range of exercises is provided at the end of each chapter, with more difficult sections and exercises marked accordingly for advanced readers. A generous sampling of applied examples is positioned throughout the book, emphasizing various areas of application, and a detailed appendix presents an introduction to exponential families, a discussion of the computational complexity of stochastic programming problems, and sample MATLAB programs. Requiring only a basic, introductory knowledge of probability and statistics, Simulation and the Monte Carlo Method, Second Edition is an excellent text for upper-undergraduate and beginning graduate courses in simulation and Monte Carlo techniques. The book also serves as a valuable reference for professionals who would like to achieve a more formal understanding of the Monte Carlo method.

Provides a tutorial on the computational tools that use mathematical optimization concepts and representations for the curation, analysis and redesign of metabolic networks Organizes, for the first time, the fundamentals of mathematical optimization in the context of metabolic network analysis Reviews the fundamentals of different classes of optimization problems including LP, MILP, MLP and MINLP Explains the most efficient ways of formulating a biological problem using mathematical optimization Reviews a variety of relevant problems in metabolic network curation, analysis and redesign with an emphasis on details of optimization formulations Provides a detailed treatment of bilevel optimization techniques for computational strain design and other relevant problems