04 2.5-Rough idle after start

[cue2671]

2004 xc90 2.5 195,000 miles.
After starting, if I don't let the engine idle for a few minutes (before I drive off or touch the accelerator pedal) it will die and be very difficult to get started again. And if I do get it started, I have to rev it up to keep it running, it will not idle at that point. It will eventually clear up after a minute or so and I can continue on. This process starts over every time I start the vehicle. Whether it's warm, cold or even if I had just turned it off. Outside of that main issue, if I accelerate heavily ill get a few hesitations. Also, intermittently, I'll hear a rushing air noise coming from the passenger side engine compartment that coincides with acceleration. I don't know that the last two issues are related to the first, but figured I'd give all the info I have. I've changed the fuel filter and tested fuel pressure (55psi) and I did start the car and immediately try to drive off while monitoring the fuel pressure. It did its normal thing of failing to idle and at that time the gauge did bounce around a bit from 52-57psi. Also, if I cycle the key off to on a couple of times before I start it, I can usually drive off and won't have the issue. I may get some hesitation, no throttle response a block down the road for a bit but it won't go through its normal drama. I changed the boost pressure solenoid valve with a pierburg part several months ago. Thats all I can think of at the moment. No codes thrown that I'm able to pick up with my obdII port scanner. Thanks for the help!