Yeah it does. That's kinda the whole point. If a shader is stalled or bottlenecked by something else and can't fill the GPU, you run another shader(with a different bottleneck than the first) to maximize utilization.
Iif you scaled up your entire GPU exactly 2x, it would be able to run the first shader twice as fast, right?(or at least twice as many threads at once), and would have roughly the same percentage of idling compute units.
Now if you added even more compute units to the mix on top of that(hawaiii), even more are gonna be idle, because you didn't add more of the other hardware to keep them busy. This is the most likely reason why hawaii and fiji benefit more than most older GCN models. They have a higher ratio of ALU to everything else on the chip, comparatively.
The reason xbox and playstation can benefit so much is because they can tune it to each specific GPU, which makes a big difference. Imagine if there was a console with fury x in it. Async compute gains would be ridiculous lol.