P.S. Also remember Vishera (AMD's current 8 thread processor) is a big expensive die without iGPU. Whereas a 4C/8T Zen with small iGPU would be much smaller and have the versatility to be used in a wider range of devices.
What do you define as a "small" iGPU? Remember, compute units only make up a part of a GPU's die space. You've also got some room occupied by fixed-function units (UVD, VCE, TrueAudio, etc.) and memory controllers (which, in an APU, are going to be shared between CPU and GPU in any case).
I suspect there would be negligible savings in going below 8 CUs (512 shaders). Note that Carrizo, despite being designed for low-power laptop usage, has that many CUs - and this is on a 28nm process. With 14nm FinFET, the die space occupied will be even smaller (though it may be more expensive on a per-sq.mm. basis, at least at first).
Based on AMD's leaked roadmap, it doesn't seem like we're going to get what you are looking for. They plan to bring out Summit Ridge (server/HEDT Zen with no iGPU) in mid-2016, then Raven Ridge (mainstream Zen APU) in 2017. Summit Ridge will be 8C/16T (though of course there will probably be die-harvested parts), but we don't know yet what Raven Ridge will be - the roadmap doesn't say.
It's important to note that AMD, during Financial Analyst Day, specifically said they want to get away from the low end. That's why I think Raven Ridge will be a more ambitious product than just a next-generation version of the current APUs - after all, the current products are largely failures. I wouldn't be surprised if Raven Ridge was 4C/8T with a really beefy iGPU, the most powerful seen so far - something like 2048 shaders (Tonga equivalent) would be well within plausibility on 14nm FinFET. This would all be tied together with shared HBM2 (8GB or 16GB depending on SKU), thus erasing the disadvantage of existing APUs and providing every bit as much performance as one of today's $200 dGPUs. Of course, it would be more expensive than today's APU products, probably about on par with the cost of Intel's Broadwell Iris Pro offerings. With something like this, AMD could explore new markets in set-top gaming (small form factors become much easier), get more console design wins, and maybe score a contract for Retina iMacs as well.