The manual tests need extra setup so skip those, we also don't
need extra gtest invocation since some time.

Fixes: d3e7b54c

Signed-off-by: Guido Günther <[email protected]>