The answer on this question depends on your goals: do you want to learn about optimal stopping in dicrete or continuous time? In the latter case, are you satisfied with diffusions - or you want to study it in general?
Bernt Øksendal has a very nice book "Stochastic Differential Equations" which may be the best one to start reading about this topic in a continuous time setting. The first chapter contains some examples of "real-world" problems which need a stochastic treatment, among which there are optimal stopping problems (OSP). Moreover, Chapter 10 is fully devoted to the OSPs - the only point is that stochastic processes there are considered to be Ito diffusions, so their paths are continuous.
For the general exposition you may want to take a look on "Optimal Stopping Rules" by Albert Shiryaev (the last edition should be from 2007). This book presents the general theory for the optimal stopping of Markov processes both in discrete and continuous time. It is also quite short (220 pages) and material is given nicely and rigorously.
The book "Optimal stopping and free-boundary problems" by Goran Peskir and Albert Shiryaev could be considered (partly) as the extension of "Optimal Stopping Rules" and seems to contain one of the most comprehensive expositions on OSP. Besides Markov processes, the theory for general processes is included using martingale methods. The considered class of functionals to be optimized is much richer (including supremum and integral functionals). There are several cool examples both for diffusions and for jump processes. The methods used for solution of these examples are also very interesting conceptually.
There are also many book on stochastic mathematical finance which would necessary include OSPs due to American option problems, optimal portfolio theory etc. To be honest, the area of mathematical finance is one of the main areas given applications for OSP. However, I don't know if you are interested in such applications - so please tell me if you want to know which books on OSP you should account there, I will extend the list.
With changepoint detection I guess you meant something close to the disorder problem: namely, given a stochastic process $X$ and some random time $\theta$ you would like to find a stopping time $\tau^*$ adapted to the natural filtration of the original process, $\mathbb F^X$ such that say $ |\tau^*-\sigma| = \min\limits_\tau |\tau-\sigma| $ where $\tau$ is any $\mathbb F^X$-adapted stopping time and $\sigma$ is unobservable from $\mathbb F^X$. Well, you can start with "Optimal Stopping and Free-boundary problems" where such problem is treated both for the Brownian motion and a Poisson process with the full solution given.
Next, the problem for the Poisson process was extended in two ways: extending the functional to be minimized and considering the compound Poisson process with not only intensity but also the distribution of jumps changing at some random time $\theta$. I know on research in this area done by Ioannis Karataz, Erhan Bayraktar and Savas Dayanik in the following three papers: the first, the second and the third. I think it is enough to start with.