Let $\mu$ be a $\sigma$-finite measure on $(A,\mathcal{A})$. Then there are finite measures $(\mu_n)_{n \in \mathbb{N}}$ on $(X,\mathcal{A})$ such that $$\mu = \sum_{n \in \mathbb{N}}\mu_n$$
So if $\mu$ is $\sigma$-finite, we have that $$X = \bigcup_{n \in \mathbb{N}}X_n$$ for some measurable sets $X_n$ with $\mu(X_n) < \infty$ for any $n \in \mathbb{N}$. My first idea was something like restricting this measures to the sets $X_n$ but $\mu_n$ must be defined on $\mathcal{A}$. Any hint?