Yeah, the memory could be an issue for the 4S, but it could be down to the GPU as well. Seeing as the 5 is twice as fast in GFX tasks, so this would help out with the task switching animations etc.
Well I installed iOS9 on my 5S last night and its very fast, although I'm not sure if it's...