Something else you might want to think about is weight. The f4 version of the lens will be much lighter then the 2.8 version. I myself use a 70-200 f4 Non IS, and am really happy with it, admittedly I have never got the opportunity to use one of the 2.8 lineups!
It really does depend on what you want it for. If you are after it for portrait work, or anything that requires a very soft bokeh, then the 2.8 is the way to go, if you need it for low light shots of moving things (people etc.), then the 2.8 is also the way to go. If you desire it for low light pics of inanimate objects, then the f4 IS is probably slightly better (the IS is 3 stop).
I predominantly use mine for motor sport, so 2.8 is of minimal importance to me, but the lighter lens makes it much nicer to carry around all day.
I don't know if it is important to you, but the f4 will not come with a tripod collar, but the f2.8 will.
Just my thoughts!
Tristan