A principal series representation is never square integrable. Probably in the case of $GL_2$ one can compute matrix coefficients explicitly to verify this, but it also follows from the (somewhat more theoretical) computation of matrix coefficients via the Jacquet module. A good reference for this is Casselman's notes (available on his web-page), which develop the theory of the Jacquet module and its application to matrix coefficients essentially from scratch. (Casselman work's in the context of an arbitrary reductive group, and so uses some basic Lie theoretic results as input; but in the case of $GL_2$ one can just replace that input by explicit facts and computations about $GL_2$ and its Borel subgroups.)
In the case when the induced representation is trivial, the infinite dimensional constituent (which I would call special; but I don't know what Bump's terminology is) will be square integrable (up to a twist; one may need to apply a twist to ensure that the central character is unitary, if it is not already).
Again, this can be seen via a Jacquet module computation: the Jacquet module of an induced representation for $GL_2$ is two-dimensional, and so there are two exponents, one of which gives rise to square integrable matrix coefficients, but the other of which doesn't. In the reducible case, the one-dimensional constituent is contributing the "bad" exponent, and so when we remove that constituent, the infinite-dimensional piece that's left has just a one-dimensional Jacquet module, whose exponent is good enough to ensure square integrability.
My memory is that Casselman discusses this example specifically in his notes.