If stealth is just adding nothing to a ship, no one would build anything else than a pilot seat with a truster bolted at the back. I don't think stealth should be just a cloaking device, but something like it would make them bigger/expensive/and more specialized than just a brick with trusters.
And as I said before:
It's like playing Rock-paper-scissors and knowing the answer of the opponent and he knows yours.