The headers affect requests between the end client (your browser) and your php server, not between your server and the third party url.
Anyhoo, afaik, PHP doesn't provide any caching for HTTP downloads or data retrieved from streams so any caching issues that you're encountering is either on...