SF Benchmarking rules and general discussion.

[paulpicks21]

After some thought, I figured it would be a good idea to have a thread dedicated to some basic rules and general discussion of all the benchmarks here on SF.

I don't think it is fair that 1 person should be solely responsible for making all the rules so I think we should all discuss any rules that you think should/should not be in place for the benchmarks here.

Also this thread can be useful for any discussion relating to the benchmarks too.

 

[paulpicks21]

Rules-

#1. Lucid/Virtu MVP is NOT allowed in any of the leaderboards. If you wish to run it and post a score you must make everyone aware you used it and it will be for interest only.

 

[paulpicks21]

The first topic of discussion is Lucid MVP.

Here are my thoughts on it, please all pipe in and let me know your thoughts too.

Personally I think Lucid MVP should be allowed but obviously it must be declared that it is being used and it will be entered into the SLI/Xfire section. The GPU would be listed as (for example) GTX780/HD4000.

I don't see any reason why we could not allow an entry in both the single card and the SLI/Xfire sections per person, there is nothing stopping people who have 2 discrete cards disabling one and having a shot at the single card leaderboards, so why not allow people using Lucid to have a shot at the SLI/Xfire leaderboards if they so wish?

Paul.

 

[Golden]

Why not. Go for it.

 

[ganjiry]

I can't see any reason not to let people use it

 

[Dude]

I have used it, it actually scored lower in some apps. I say go ahead and allow it too.

 

[Solarstarshines]

Allow it just for those who aren't using Big boy cards they are the one's who benefit really from it

I am using it right now because all i have is one card it helps a little but not by leaps and bounds

 

[paulpicks21]

Can't allow it just for certain cards solar, that would be a total nightmare. What qualifies as not a big boy card etc.

It's all or nothing on this.

 

[paulpicks21]

Also Solar, the point was for people using Lucid to be entered into the SLI/Xfire leaderboard. I can't see how it would be a good idea to just let the lower end cards do that. If they are struggling already then they ain't gonna fair too well against 2x 780TI's are they :roflmao:

 

[Solarstarshines]

Also Solar, the point was for people using Lucid to be entered into the SLI/Xfire leaderboard. I can't see how it would be a good idea to just let the lower end cards do that. If they are struggling already then they ain't gonna fair too well against 2x 780TI's are they :roflmao:

It was just a thought you know people with Lucid using 560 or something along that line no 280x or no 7970's anything above 760 shouldn't use it

Just trying to get the little guys onbaord either way it goes it doesn't matter once we agree it's the rules

 

[paulpicks21]

Also Solar, the point was for people using Lucid to be entered into the SLI/Xfire leaderboard. I can't see how it would be a good idea to just let the lower end cards do that. If they are struggling already then they ain't gonna fair too well against 2x 780TI's are they :roflmao:

It was just a thought you know people with Lucid using 560 or something along that line no 280x or no 7970's anything above 760 shouldn't use it

Just trying to get the little guys onbaord either way it goes it doesn't matter once we agree it's the rules

Hi Solar, please don't think I was trying to have a go at you or anything, I am not. I know you are just chucking some idea's round and thank you for your input mate

I am just trying to work out exactly what you mean.

So basically we pretty much agreed that if someone is going to use Lucid then that entry must go into the SLI/Xfire section as the person is using a dedicated GPU and the graphics from the CPU combined.

From what I can make out, you are saying that it is fine for someone with say a 560 and HD4000 to have to go up against the mighty 2x 780TI's, the 2x 780s and the 2x 7970s etc where (lets be honest) they won't stand a chance and will look real bad.
But if you own say a single 780TI, 780 or R9 290X with the HD4000 for example then you can't have a go at beating them?

Sorry if I am a little confused but won't that be bad for everyone?

Paul.

 

[Solarstarshines]

It was just some thoughts on users who get really beat up by our scores give them a chance to climb the ladder

But you are right the performance gain is not by much and would still get murdered as some already said it hurts performance at times to so it probably is a hit and miss with games too but any little bit helps

More like a Game Booster wouldn't you say?

 

[paulpicks21]

It was just some thoughts on users who get really beat up by our scores give them a chance to climb the ladder

But you are right the performance gain is not by much and would still get murdered as some already said it hurts performance at times to so it probably is a hit and miss with games too but any little bit helps

More like a Game Booster wouldn't you say?

I could see it working well in some games yes mate. I see they have BF3 on the supported list, shame they don't have BF4, it would work well if you use the resolution scaling thing in that game as it really hits the FPS.

The performance gain can be quite a lot using it in benchmarks, I have it working well on Heaven right now and it has given around a 30% increase in score. I won't post the score yet though.
It looks like it works pretty well in 3D Mark and 3D mark 11, but I am yet to test it fully.
I may give it a bash tonight and see how much I can get out of them but until we are all decided that Lucid is fine for the SLI/Xfire section then I won't post anything.

 

[essenbe]

Well, I agree we can't come up with some arbitrary high end cards and low end cards. That would end up being a nightmare, but I uderstand what Solar was trying to do. I will throw out a suggestion I think may be fair for everyone except Paul. We have a leaderboard for single cards and for CFX/SLI. why not add another catagory of with Lucid. Of course, that would require everyone to be honest, but I'm not concerned about that with out regulars. But, that would keep everyone on a level playing field just like the single and CFX/SLI does. I know my opinion differs from others, and that's OK. Everyone is entitled to their opinion. But, it seems no matter how you do it other than a seperate catagory, someone is going to be at a disadvantage. Of course the simplest way is to just say it cannot be used and there will be no problem. That's pretty much the way it has always been and we've always been happy that way.

Also something else to consider. Solar posted a link to what Mark 3D said about Lucid. It said that Lucid can give much higher frames rendered and a higher score, but that the results were not real. What does 'the results are not real' mean. If the results are not real it would mean that Lucid is only fooling the test into thinking the frame rendering is higher than it actually is, which none of us really want. I have no idea if that is true, but if it is, then my opinion is it should not be used in any benchmark. Just my 2 cents.

 

[Solarstarshines]

Fair enough

 

[essenbe]

Fair enough what Solar. I'm not sure what you mean. I was just throwing out several ideas to be discussed. This is not my world, I just happen to live in it with everyone else.

 

[Solarstarshines]

Fair enough what Solar. I'm not sure what you mean. I was just throwing out several ideas to be discussed. This is not my world, I just happen to live in it with everyone else.

I mean fair enough for what is being said about testing with this program like you pointed out 3d11 says scores aren't real and after this conversation about should we or shouldn't we might be a little too much

I would love to use it and get good results but there is too many variables to consider when using this product good idea but becoming a issue how to properly use it in this thread

 

[essenbe]

Very little doubt about that. There are a lot of variables and it seems that however it is used it will be unfair to someone. Not to mention the fact of Mark 3D saying it's not real.

 

[paulpicks21]

I think this is all getting too serious and complicated.

I understand your idea Steve, and thanks for your input. However having a separate section for Lucid it totally pointless. It will be exactly the same people as the single card leaderboard doing it and everyone will score exactly the same but just with a precise percentage increase due to Lucid. The people in the SLI/Xfire leaderboard cannot take part as it doesn't work for SLI/Xfire.

The way I saw it originally was just for a bit of fun, i.e people with a single card could have a shot at trying to beat the SLI/Xfire boys, just a bit of harmless fun nothing serious.
Likewise if they want to have a shot at beating the single card boys then they can disable one of their cards.
That to me is simple and straightforward. But of course I am only one person and yes I asked for peoples thoughts.

As you have said to me before Steve, you will never get everyone to agree on 1 thing, if everyone did it would be a boring world right?

So realistically in this kind of situation I can either back down from the idea totally or just go with the majority vote.

I am however a little concerned about this "results are not real" thing from 3D Mark, obviously that could be bad.
But right now this is not a competition where money or prizes are on the line so I don't think we need to worry about it too much until some kind of concrete information comes out.

I know you love making things easy for me Steve :roflmao:

 

[essenbe]

So, that was a long way of saying.... I'm not sure. So, what's the rule? SLI/CFX or not use it? Either way, I'm OK with it just tell me, master of the leaderboard.