Pay attention to the phrase: an outcome specifies the numbers of caught fish of each of the five types. The value $5^{10}$ calculates the total amount of permutations with repetition. This value supposes that the outcomes
$$(1,1,1,1,1,1,1,1,1,2) \text{ and } (2,1,1,1,1,1,1,1,1,1)$$
are different since the order here differ.
And according to the condition of the problem, they are the same. In both cases the first kind of fish is caught 9 times, and the second one is caught once, so it is the same outcome.
Therefore one should use combinations with repetition to calculate how many different outcomes are possible
$$
\binom{n+m-1}{n}=\binom{10+5-1}{10}.
$$
This value calculates the total number of outcomes, if one outcome is described by the numbers of caught fish of each of the five types. Say, here are possible outcomes:
$(10,0,0,0,0)$ - 10 fish of first kind, no other fish,
$(9,0,1,0,0)$ - 9 fish of first kind, one fish of third kind,
$(0,2,0,0,8)$ - 2 fish of second kind, 8 fish of last kind ans so on.