[Embench] Benchmark question

Mark Hill mark.hill at huawei.com
Thu May 21 23:50:18 CEST 2020

Hi Dave,

One area we see use of double precision floating point in embedded products is kalman filtering to combine inputs from various sensors, unfortunately the code we have is proprietary but perhaps there are some public domain implementations that could be used as a suitable benchmark.


From: Embench [mailto:embench-bounces at lists.librecores.org] On Behalf Of Roger Shepherd
Sent: 21 May 2020 16:50
To: pattrsn at cs.berkeley.edu
Cc: embench at lists.librecores.org
Subject: Re: [Embench] Benchmark question


Yes! I think getting some of the BDTI benchmarks would be great, especially if they retain some BDTI branding/copyright. When I last worked on DSPs, BDTI’s benchmarks had a very high reputation (partly because BDTI had results for a wide range of DSPs and processors).

Which makes me think, part of the utility of a benchmark suite comes from having results from a large number of processors/platforms. Perhaps we could actively address getting a wider set of results for Embench? Maybe a topic for our next call?


On 21 May 2020, at 16:27, David PATTERSON <pattrsn at cs.berkeley.edu<mailto:pattrsn at cs.berkeley.edu>> wrote:

Following up from request for floating point benchmarks for Embench 0.6.

I presume I should follow up with an offer from BDTI for DSP benchmarks?


---------- Forwarded message ---------
From: Jeff Bier <bier at bdti.com<mailto:bier at bdti.com>>
Date: Thu, May 21, 2020 at 8:20 AM
Subject: RE: Benchmark question
To: pattrsn at cs.berkeley.edu<mailto:pattrsn at cs.berkeley.edu> <pattrsn at cs.berkeley.edu<mailto:pattrsn at cs.berkeley.edu>>

Hi Dave,

Sorry for the slow response on this.  My dad has been in the hospital this week -- he’s doing OK, but conditions related to Covid-19 made things much more complicated.

Regarding floating-point embedded benchmarks, here are some ideas…
·       My company, BDTI, would be willing to open source BDTI could open source the C reference code for a subset of our floating-point DSP benchmarks.  If this is of interest, let’s talk.  (This could be at the function level, like FFTs and FIR filters, and/or at the task level, like an OFDM wireless receiver baseband.)
·       https://www.fourmilab.ch/fbench/
·       Linear algebra libraries, e.g. matrix multiplication, matrix inversion.  (I don’t have a specific pointer, but I’m guessing there are open source libraries available.)
·       OpenCV is now C++, but earlier versions were C.  (Some computer vision tasks are pixel-oriented and inherently integer, but others are geometric and more naturally float-based.)
·       Here’s an audio application in C, with all sorts of algorithms such as de-clipper, eq, reverb, etc.  https://github.com/ePirat/Postfish.  (However it may be a bit challenging to extract individual algorithms from the entire framework…)

I hope this helps.


From: David PATTERSON <pattrsn at cs.berkeley.edu<mailto:pattrsn at cs.berkeley.edu>>
Sent: Tuesday, May 12, 2020 7:53 AM
To: Jeff Bier <bier at edge-ai-vision.com<mailto:bier at edge-ai-vision.com>>
Subject: Benchmark question

The embedded benchmarking effort I'm involved in wants to branch out to floating point programs from integer programs, and allow a little larger programs (250 KB of data).

Do you have any suggestions?

Ideally they we be open source C programs, including data sets.

DSP apps should be fine.

If there was an existing such benchmark for DSP or some other area, and they had an open source license, we might be able to follow their lead.

Embench mailing list
Embench at lists.librecores.org<mailto:Embench at lists.librecores.org>

Roger Shepherd
roger.shepherd at chipless.eu<mailto:roger.shepherd at chipless.eu>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.librecores.org/pipermail/embench/attachments/20200521/de4fecb2/attachment.htm>

More information about the Embench mailing list