I have to say that I would find it rather hard to get worked up over a 3ms increase. In the grand scheme of things it's not a big deal. Approaching 10ms increase, maybe it's worth caring about
That said, I seem to have got the best of both worlds, 6Mb increase and maybe 1 or 2ms decrease..