I don't know "a lot", but here's what I know:
I've only flown the RV-4, and from what I know about both types, the answer to your question depends on how, exactly, you define "performance".
They're very similar where it counts most: stall speed and takeoff/landing distances.
It's interesting to compare the two, because they can be built with the same engine.
Put a 160-hp engine in either plane, and you'll see roughly equal performance in climb and cruise.
The 8 is a bit roomier, carries more weight in people and baggage, and has more range, but the 4 will fly almost 800 miles at 170 mph while burning less than 8 gph.... and that's only with 150 hp. The one I have flown has a 150-hp O-320, and it will cruise at over 140 mph at just shy of 6gph. That's the kind of performance that
I like (because I'm not rich), and that's part of the reason why my friend owns that airplane.
I'd imagine that in terms of roll rate, etc. they are about the same (the 4's wing area is only 6 sq. ft. smaller, and the span is only a foot less than the 8).
On the other hand. the 8 will climb like a homesick angel with 200 hp available and can cruise very fast.
If the 8 is less sporty than the 4, it is probably still pretty damn sporty. The Rv-4 is an exciting airplane to fly- it rolls like a fighter and has excellent positive neutral stability (it tends to keep doing what you just told it to do). A little less of that would still be a lot of fun.
But the RV-4 is not for husky folks who like to travel with a lot of stuff... hence the 8. Basically the same airplane, only with more room and a higher GTW, along with the ability to use a 200-hp engine.
If economy is an issue, go with the 4. If more X-C utility is needed, go with the 8.
But if all you want is raw excitement, buy or build a single-seat RV-3!