BoingCube benchmark results

Hi, this Boing Cube (found here), I've implemented a benchmark mode, maybe not much to the world but just for the fun of it... I'm a little curious what you might get on your system?

On my Sam440ep-flex, 800Mhz, 1GB RAM, Radeon 9250 and AmigaOS 4.1 FE I get:

With version 1.30

The 3rd test with -noaccgfx -noaccbuffer options is like the previous versions with "only" software graphics (+ some optimizations). Now hardware acc. graphics is used by default.

1.> boingcube -benchmark

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.30 (20151219)
Mode: Windowed NON-vsynced
Hardware acc.: Buff: ON (hardware) Gfx: ON (hardware)
Iterations: 618 frames
Duration: 10011 ms (10.011 seconds)
Rendering time: 145 ms (0.145 seconds) [lower is better]
D. frame-rate: 61.732094695835 FPS (acquired displayed frames/second)
Result: 4262.0689655172 FPS (rendering frame-rate) [higher is better]

1.> boingcube -benchmark -gofullscreen

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.30 (20151219)
Mode: Fullscreen NON-vsynced
Hardware acc.: Buff: ON (hardware) Gfx: ON (hardware)
Iterations: 563 frames
Duration: 10001 ms (10.001 seconds)
Rendering time: 186 ms (0.186 seconds) [lower is better]
D. frame-rate: 56.294370562944 FPS (acquired displayed frames/second)
Result: 3026.8817204301 FPS (rendering frame-rate) [higher is better]

1.> boingcube -benchmark -noaccgfx -noaccbuffer

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.30 (20151219)
Mode: Windowed NON-vsynced
Hardware acc.: Buff: OFF (software) Gfx: OFF (software)
Iterations: 556 frames
Duration: 10012 ms (10.012 seconds)
Rendering time: 819 ms (0.819 seconds) [lower is better]
D. frame-rate: 55.533359968038 FPS (acquired displayed frames/second)
Result: 678.87667887668 FPS (rendering frame-rate) [higher is better]


-- --


With version 1.20:

1.> boingcube -benchmark

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.20 (20151129)
Mode: Windowed NON-synced
Iterations: 544 frames
Duration: 10003 ms (10.003 seconds)
Rendering time: 872 ms (0.872 seconds) [lower is better]
Frame rate: 54.383684894532 FPS (frames/second)
Result: 623.85321100917 RFPS (rendering frame-rate) [higher is better]

1.> boingcube -gofullscreen -benchmark

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.20 (20151129)
Mode: Fullscreen NON-synced
Iterations: 504 frames
Duration: 10005 ms (10.005 seconds)
Rendering time: 869 ms (0.869 seconds) [lower is better]
Frame rate: 50.374812593703 FPS (frames/second)
Result: 579.97698504028 RFPS (rendering frame-rate) [higher is better]


-- --


With old version 1.10:

1.> boingcube -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 524 frames (higher is better)
Duration: 10011 ms (10.011 seconds)
Result: 52.342423334332 FPS (iterations/second)

1.> boingcube -gofullscreen -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 491 frames (higher is better)
Duration: 10010 ms (10.01 seconds)
Result: 49.050949050949 FPS (iterations/second)

@Marko

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 605 frames (higher is better)
Duration: 10012 ms (10.012 seconds)
Result: 60.427487015581 FPS (iterations/second)


*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 598 frames (higher is better)
Duration: 10013 ms (10.013 seconds)
Result: 59.72236093079 FPS (iterations/second)


AmigaOne X1000, 1.2 GHz (i think), 2 GB RAM, RadeonHD 7750, AmigaOS4.1 FE


I do get some (gfx) bugs:

1) One of the sides of the cube is partly blue
2) When the cube hits the lower corner of both sides the background checkmark gets wrongly filled on a hit
3) The cube draws a "spike" out of the left side when facing frontal to the viewer
EDIT
4) I don't hear any sound

@Marko

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 600 frames (higher is better)
Duration: 10013 ms (10.013 seconds)
Result: 59.922101268351 FPS (iterations/second)

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 573 frames (higher is better)
Duration: 10008 ms (10.008 seconds)
Result: 57.254196642686 FPS (iterations/second)

Sam460 1ghz, Radeon HD7770, AOS4.1FE.

Cheers

BoingCube -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 604 frames (higher is better)
Duration: 10004 ms (10.004 seconds)
Result: 60.375849660136 FPS (iterations/second)

BoingCube -gofullscreen -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 601 frames (higher is better)
Duration: 10008 ms (10.008 seconds)
Result: 60.051958433253 FPS (iterations/second)


Sam460ex 1.15GHZ Radeon HD7750 AmigaOS 4.1FE

@Marko

What kind of syncing are you using ?

@Raziel
Quote:
If you haven't downclocked it then it should be 1,8 GHz.

@Marko
#BoingCube -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 602 frames (higher is better)
Duration: 10008 ms (10.008 seconds)
Result: 60.151878497202 FPS (iterations/second)

#BoingCube -gofullscreen -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 600 frames (higher is better)
Duration: 10012 ms (10.012 seconds)
Result: 59.928086296444 FPS (iterations/second)


SAM460ex_1.15GHz RAM:2GB SSD:120GB VGA:RadeonHD6570

> BoingCube -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 610 frames (higher is better)
Duration: 10013 ms (10.013 seconds)
Result: 60.920802956157 FPS (iterations/second)
> BoingCube -benchmark -gofullscreen

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 616 frames (higher is better)
Duration: 10015 ms (10.015 seconds)
Result: 61.507738392411 FPS (iterations/second)

X1000, RadeonHD 5450.

@Raziel

I get a few graphics glitches too, the blue on the ball side and occasionally a triangle flashes.

Sound is disabled for benchmarking.

@TSK

Looks like it's using WaitTOF() to tync frames.

if I put my monitor in 'game mode' I get a few more frames:

> BoingCube -benchmark

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 615 frames (higher is better)
Duration: 10001 ms (10.001 seconds)
Result: 61.493850614939 FPS (iterations/second)

> BoingCube -benchmark -gofullscreen

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 615 frames (higher is better)
Duration: 10014 ms (10.014 seconds)
Result: 61.41402037148 FPS (iterations/second)

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 613 frames (higher is better)
Duration: 10005 ms (10.005 seconds)
Result: 61.269365317341 FPS (iterations/second)

5.RAM Disk:BoingCube> BoingCube -benchmark -gofullscreen

*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 613 frames (higher is better)
Duration: 10008 ms (10.008 seconds)
Result: 61.250999200639 FPS (iterations/second)


Pegasos2 G4@1266mhz Radeon9000 Pro

@Severin

Quote:
I was wondering because everybody's getting FPS results the same as refresh rates of modern LCD monitors with different hardware. Sam440 is the only one which can't keep up with that, it looks.

@marko

X1000/FE R7-250X

boingcube -benchmark
*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Windowed
Iterations: 616 frames (higher is better)
Duration: 10004 ms (10.004 seconds)
Result: 61.575369852059 FPS (iterations/second)


boingcube -gofullscreen -benchmark
*** BoingCube benchmark ***
Version: 1.10 (20151125)
Name: -benchmark10 (Counts iterations per ten seconds.)
Mode: Fullscreen
Iterations: 615 frames (higher is better)
Duration: 10008 ms (10.008 seconds)
Result: 61.450839328537 FPS (iterations/second)

@thread

Thanks all, hmm interesting results!


@Raziel

> 1) One of the sides of the cube is partly blue
That's a feature But if it looks weird I might remove it or make an option to remove it.

> 3) The cube draws a "spike" out of the left side when facing frontal to the viewer
If you mean the occasional triangle then that's a known glitch thanks, on the TOFIX/BUG list.

> 4) I don't hear any sound
The sound is muted when benchmarking, if boingcube is ran normally then sound should be audable, no?


@TSK

> What kind of syncing are you using ?
It should not sync at all when benchmarking.

@Severin

> I get a few graphics glitches too, the blue on the ball side and occasionally a triangle flashes.
The blue side is a feature If it looks too weird I might remove it or make an option for it.


@TSK
> I was wondering because everybody's getting FPS results the same as refresh
> rates of modern LCD monitors with different hardware.

Everybody maxing at about 61 FPS, indeed looks little weird :S
I'll take a look now and see if it actually still is syncing somewhere...

@Marko

Seems I got a new, fixed version when I fetched it just now, but the FPS rates seem to be similar to the results above. X1000, Radeon HD 6650, 2560×1600×32 WB.

$ BoingCube -benchmark

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.11 (20151127)
Mode: Windowed
Iterations: 611 frames (higher is better)
Duration: 10004 ms (10.004 seconds)
Result: 61.075569772091 FPS (iterations/second)

$ BoingCube -gofullscreen -benchmark

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.11 (20151127)
Mode: Fullscreen
Iterations: 588 frames (higher is better)
Duration: 10003 ms (10.003 seconds)
Result: 58.782365290413 FPS (iterations/second)

Best regards,

Niels

@nbache

Hmmm.. Yes, still looks little fishy with the FPS :S
Seems I have to dig a bit further to find the issue, as I didn't see anything obvious, except the thing I fixed...

Thanks for the report

@Marko
Quote:
I was going to ask if you're using ChangeScreenBuffer() for full-screen mode as that's implicitly vsynced, but that wouldn't explain the result for windowed mode.

It is possible to measure the rendering frame-rate while still being vsynced. What you need to do is measure just the time that is being rendered. Something like:
- startTime = getTimeStamp()
- render()
- flush()
- waitIdle()
- endTime = getTimeStamp()
- timeThisFrame = endTime - startTime
- currFrameRate = 1.0 / timeThisFrame (NOTE: convert to seconds before doing this)
- totalTime += timeThisFrame
- ++totalFrames

This gives you both an instantaneous and average frame-rate. Some people also calculate a low-pass filtered frame-rate to make the fps display less flickery, e.g.: lpfFrameRate = 0.9 * prevFrameRate + 0.1 * currFrameRate;

Hans

@Hans

Thanks for the pointers, appreciated I will give it another go little later today/tomorrow...

As a test I put my monitor into a 1280x1024x32 mode which is 75Hz and got these results:

> BoingCube -benchmark

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.11 (20151127)
Mode: Windowed
Iterations: 617 frames (higher is better)
Duration: 10004 ms (10.004 seconds)
Result: 61.675329868053 FPS (iterations/second)

> BoingCube -benchmark -gofullscreen

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.11 (20151127)
Mode: Fullscreen
Iterations: 618 frames (higher is better)
Duration: 10004 ms (10.004 seconds)
Result: 61.775289884046 FPS (iterations/second)

so it's not a sync problem, just a coincidence.

Edit: Tested with V1.11

X1000 with RadeonHD7850

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.11 (20151127)
Mode: Windowed
Iterations: 612 frames (higher is better)
Duration: 10007 ms (10.007 seconds)
Result: 61.157189967023 FPS (iterations/second)

*** BoingCube benchmark ***
Name: -benchmark10 (Counts iterations per ten seconds.)
Version: 1.11 (20151127)
Mode: Fullscreen
Iterations: 616 frames (higher is better)
Duration: 10015 ms (10.015 seconds)
Result: 61.507738392411 FPS (iterations/second)