Humans don‘t explode in a vacuum, that‘s an urban myth. The atmosphere difference between the earths surface and space is magnitudes less than between the ocean floor and the surface.
Whats killing us is the boiling blood and the water in our bodies due to the decreased boiling point.