That has happened to me, and I think it is related to the EGR not working right. When my EGR clears itself, response is much better and it whistles at idle. But when it is clogged up, I lose the whistle at idle, but it seems fine under load.
RL
RL