Skip to main content
Free carbon-neutral shipping over $39.99  ·  Thousands of books on sale — sale ends soon

Partially Observed Markov Decision Processes

by Vikram Krishnamurthy

Cambridge University Press

Hardback or Cased Book 00651 pages Jun 05, 2025

(No reviews yet) Write a Review
Millions of titlesEvery book you're looking for
Carbon-neutral shippingFree on orders over $39.99
Fast shipping worldwideDelivered to your door
Covering formulation, algorithms and structural results and linking theory to real-world applications in controlled sensing (including social learning, adaptive radars and sequential detection), this book focuses on the conceptual foundations of partially observed Markov decision processes (POMDPs). It emphasizes structural results in stochastic dynamic programming, enabling graduate students and researchers in engineering, operations research, and economics to understand the underlying unifying themes without getting weighed down by mathematical technicalities. In light of major advances in machine learning over the past decade, this edition includes a new Part V on inverse reinforcement learning as well as a new chapter on non-parametric Bayesian inference (for Dirichlet processes and Gaussian processes), variational Bayes and conformal prediction.
Author:
Vikram Krishnamurthy
Publisher:
Cambridge University Press
Publication Date:
Jun 05, 2025
Number of pages:
00651 pages
Binding:
Hardback or Cased Book
ISBN-10:
1009449435
ISBN-13:
9781009449434