The Frobenius inner product is the component-wise inner product of two matrices as though they are vectors.
In other words, it is the sum of the entries of the Hadamard product, that is,
\[
A : B = \operatorname{trace}(A^{\mathsf T}B) = \operatorname{trace}(AB^{\mathsf T});
\]