Sequential Stochastic Optimization

A unique interdisciplinary foundation for real-world problem solving Stochastic search and optimization techniques are used in a vast number of areas, including aerospace, medicine, transportation, and finance, to name but a few. Whether the goal is refining the design of a missile or aircraft, determining the effectiveness of a new drug, developing the most efficient timing strategies for traffic signals, or making investment decisions in order to increase profits, stochastic algorithms can help researchers and practitioners devise optimal solutions to countless real-world problems. Introduction to Stochastic Search and Optimization: Estimation, Simulation, and Control is a graduate-level introduction to the principles, algorithms, and practical aspects of stochastic optimization, including applications drawn from engineering, statistics, and computer science. The treatment is both rigorous and broadly accessible, distinguishing this text from much of the current literature and providing students, researchers, and practitioners with a strong foundation for the often-daunting task of solving real-world problems. The text covers a broad range of today’s most widely used stochastic algorithms, including: Random search Recursive linear estimation Stochastic approximation Simulated annealing Genetic and evolutionary methods Machine (reinforcement) learning Model selection Simulation-based optimization Markov chain Monte Carlo Optimal experimental design The book includes over 130 examples, Web links to software and data sets, more than 250 exercises for the reader, and an extensive list of references. These features help make the text an invaluable resource for those interested in the theory or practice of stochastic search and optimization.

A comprehensive account of the theory and application of Monte Carlo methods Based on years of research in efficient Monte Carlo methods for estimation of rare-event probabilities, counting problems, and combinatorial optimization, Fast Sequential Monte Carlo Methods for Counting and Optimization is a complete illustration of fast sequential Monte Carlo techniques. The book provides an accessible overview of current work in the field of Monte Carlo methods, specifically sequential Monte Carlo techniques, for solving abstract counting and optimization problems. Written by authorities in the field, the book places emphasis on cross-entropy, minimum cross-entropy, splitting, and stochastic enumeration. Focusing on the concepts and application of Monte Carlo techniques, Fast Sequential Monte Carlo Methods for Counting and Optimization includes: Detailed algorithms needed to practice solving real-world problems Numerous examples with Monte Carlo method produced solutions within the 1-2% limit of relative error A new generic sequential importance sampling algorithm alongside extensive numerical results An appendix focused on review material to provide additional background information Fast Sequential Monte Carlo Methods for Counting and Optimization is an excellent resource for engineers, computer scientists, mathematicians, statisticians, and readers interested in efficient simulation techniques. The book is also useful for upper-undergraduate and graduate-level courses on Monte Carlo methods.

The only comprehensive guide to the theory and practice of one of today's most important probabilistic techniques The past 15 years have witnessed many significant advances in sequential estimation, especially in the areas of three-stage and nonparametric methodology. Yet, until now, there were no references devoted exclusively to this rapidly growing statistical field. Sequential Estimation is the first, single-source guide to the theory and practice of both classical and modern sequential estimation techniques–including parametric and nonparametric methods. Researchers in sequential analysis will appreciate the unified, logically integrated treatment of the subject, as well as coverage of important contemporary procedures not covered in more general sequential analysis texts, such as: * Shrinkage estimation * Empirical and hierarchical Bayes procedures * Multistage sampling and accelerated sampling procedures * Time-sequential estimation * Sequential estimation in finite population sampling * Reliability estimation and capture-recapture methodologies leading to sequential tagging schemes An indispensable resource for researchers in sequential analysis, Sequential Estimation is an ideal graduate-level text as well.

A thorough and highly accessible resource for analysts in a broad range of social sciences. Optimization: Foundations and Applications presents a series of approaches to the challenges faced by analysts who must find the best way to accomplish particular objectives, usually with the added complication of constraints on the available choices. Award-winning educator Ronald E. Miller provides detailed coverage of both classical, calculus-based approaches and newer, computer-based iterative methods. Dr. Miller lays a solid foundation for both linear and nonlinear models and quickly moves on to discuss applications, including iterative methods for root-finding and for unconstrained maximization, approaches to the inequality constrained linear programming problem, and the complexities of inequality constrained maximization and minimization in nonlinear problems. Other important features include: More than 200 geometric interpretations of algebraic results, emphasizing the intuitive appeal of mathematics Classic results mixed with modern numerical methods to aid users of computer programs Extensive appendices containing mathematical details important for a thorough understanding of the topic With special emphasis on questions most frequently asked by those encountering this material for the first time, Optimization: Foundations and Applications is an extremely useful resource for professionals in such areas as mathematics, engineering, economics and business, regional science, geography, sociology, political science, management and decision sciences, public policy analysis, and numerous other social sciences. An Instructor's Manual presenting detailed solutions to all the problems in the book is available upon request from the Wiley editorial department.

WILEY-INTERSCIENCE PAPERBACK SERIES The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. «. . .this is a very competently written and useful addition to the statistical literature; a book every statistician should look at and that many should study!» —Short Book Reviews, International Statistical Institute «. . .reading this book was an enjoyable learning experience. The suggestions and recommendations on the methods [make] this book an excellent reference for anyone interested in simulation. With its compact structure and good coverage of material, it [is] an excellent textbook for a simulation course.» —Technometrics ". . .this work is an excellent comprehensive guide to simulation methods, written by a very competent author. It is especially recommended for those users of simulation methods who want more than a 'cook book'. " —Mathematics Abstracts This book is a comprehensive guide to simulation methods with explicit recommendations of methods and algorithms. It covers both the technical aspects of the subject, such as the generation of random numbers, non-uniform random variates and stochastic processes, and the use of simulation. Supported by the relevant mathematical theory, the text contains a great deal of unpublished research material, including coverage of the analysis of shift-register generators, sensitivity analysis of normal variate generators, analysis of simulation output, and more.

A beginner’s guide to stochastic growth modeling The chief advantage of stochastic growth models over deterministic models is that they combine both deterministic and stochastic elements of dynamic behaviors, such as weather, natural disasters, market fluctuations, and epidemics. This makes stochastic modeling a powerful tool in the hands of practitioners in fields for which population growth is a critical determinant of outcomes. However, the background requirements for studying SDEs can be daunting for those who lack the rigorous course of study received by math majors. Designed to be accessible to readers who have had only a few courses in calculus and statistics, this book offers a comprehensive review of the mathematical essentials needed to understand and apply stochastic growth models. In addition, the book describes deterministic and stochastic applications of population growth models including logistic, generalized logistic, Gompertz, negative exponential, and linear. Ideal for students and professionals in an array of fields including economics, population studies, environmental sciences, epidemiology, engineering, finance, and the biological sciences, Stochastic Differential Equations: An Introduction with Applications in Population Dynamics Modeling: • Provides precise definitions of many important terms and concepts and provides many solved example problems • Highlights the interpretation of results and does not rely on a theorem-proof approach • Features comprehensive chapters addressing any background deficiencies readers may have and offers a comprehensive review for those who need a mathematics refresher • Emphasizes solution techniques for SDEs and their practical application to the development of stochastic population models An indispensable resource for students and practitioners with limited exposure to mathematics and statistics, Stochastic Differential Equations: An Introduction with Applications in Population Dynamics Modeling is an excellent fit for advanced undergraduates and beginning graduate students, as well as practitioners who need a gentle introduction to SDEs. Michael J. Panik, PhD, is Professor in the Department of Economics, Barney School of Business and Public Administration at the University of Hartford in Connecticut. He received his PhD in Economics from Boston College and is a member of the American Mathematical Society, The American Statistical Association, and The Econometric Society.

The revised and updated new edition of the popular optimization book for engineers The thoroughly revised and updated fifth edition of Engineering Optimization: Theory and Practice offers engineers a guide to the important optimization methods that are commonly used in a wide range of industries. The author—a noted expert on the topic—presents both the classical and most recent optimizations approaches. The book introduces the basic methods and includes information on more advanced principles and applications. The fifth edition presents four new chapters: Solution of Optimization Problems Using MATLAB; Metaheuristic Optimization Methods; Multi-Objective Optimization Methods; and Practical Implementation of Optimization. All of the book's topics are designed to be self-contained units with the concepts described in detail with derivations presented. The author puts the emphasis on computational aspects of optimization and includes design examples and problems representing different areas of engineering. Comprehensive in scope, the book contains solved examples, review questions and problems, and is accompanied by a website hosting a solutions manual. This important book: Offers an updated edition of the classic work on optimization Includes approaches that are appropriate for all branches of engineering Contains numerous practical design and engineering examples Offers more than 140 illustrative examples, 500 plus references in the literature of engineering optimization, and more than 500 review questions and answers Demonstrates the use of MATLAB for solving different types of optimization problems using different techniques Written for students across all engineering disciplines, the revised edition of Engineering Optimization: Theory and Practice is the comprehensive book that covers the new and recent methods of optimization and reviews the principles and applications.

This book presents basic stochastic processes, stochastic calculus including L?vy processes on one hand, and Markov and Semi Markov models on the other. From the financial point of view, essential concepts such as the Black and Scholes model, VaR indicators, actuarial evaluation, market values, fair pricing play a central role and will be presented. The authors also present basic concepts so that this series is relatively self-contained for the main audience formed by actuaries and particularly with ERM (enterprise risk management) certificates, insurance risk managers, students in Master in mathematics or economics and people involved in Solvency II for insurance companies and in Basel II and III for banks.

An Application-Oriented Introduction to Essential Optimization Concepts and Best Practices Optimization is an inherent human tendency that gained new life after the advent of calculus; now, as the world grows increasingly reliant on complex systems, optimization has become both more important and more challenging than ever before. Engineering Optimization provides a practically-focused introduction to modern engineering optimization best practices, covering fundamental analytical and numerical techniques throughout each stage of the optimization process. Although essential algorithms are explained in detail, the focus lies more in the human function: how to create an appropriate objective function, choose decision variables, identify and incorporate constraints, define convergence, and other critical issues that define the success or failure of an optimization project. Examples, exercises, and homework throughout reinforce the author’s “do, not study” approach to learning, underscoring the application-oriented discussion that provides a deep, generic understanding of the optimization process that can be applied to any field. Providing excellent reference for students or professionals, Engineering Optimization: Describes and develops a variety of algorithms, including gradient based (such as Newton’s, and Levenberg-Marquardt), direct search (such as Hooke-Jeeves, Leapfrogging, and Particle Swarm), along with surrogate functions for surface characterization Provides guidance on optimizer choice by application, and explains how to determine appropriate optimizer parameter values Details current best practices for critical stages of specifying an optimization procedure, including decision variables, defining constraints, and relationship modeling Provides access to software and Visual Basic macros for Excel on the companion website, along with solutions to examples presented in the book Clear explanations, explicit equation derivations, and practical examples make this book ideal for use as part of a class or self-study, assuming a basic understanding of statistics, calculus, computer programming, and engineering models. Anyone seeking best practices for “making the best choices” will find value in this introductory resource.