What kind of series you use? If it is line series, you can try to make use of fast drawing
optimizations. See line demo for an example.
On my (fast) computer, I get 0.9 sec per refresh for 4,1*10^6 points.
You may also use Sorted property to substantially speed up zoomed-in drawing
in this case.