[Embench] Benchmark question

Roger Shepherd roger.shepherd at chipless.eu
Fri May 22 12:10:15 CEST 2020


Mark et al,

I’ve taken a very quick look at this application. It does seem from this paper (https://pdf.sciencedirectassets.com/314898/1-s2.0-S1474667015X60939/1-s2.0-S1474667015373353/main.pdf <https://pdf.sciencedirectassets.com/314898/1-s2.0-S1474667015X60939/1-s2.0-S1474667015373353/main.pdf?X-Amz-Security-Token=IQoJb3JpZ2luX2VjEOn//////////wEaCXVzLWVhc3QtMSJGMEQCIG0kOeXogzqUU60+PRoniXTGgwwM7/+5qcp6aZIVuxzYAiAzACiXoPgHp3C+T0vN6BdXWohfKU6AHdnbyoG7IhQrECq0AwhCEAMaDDA1OTAwMzU0Njg2NSIM0PsGwTqlnXK6qVvNKpEDfea0BFlgqZWG+Si8NxcDWCxVNM7+CmIcCuAAYSA2roeLVQbuBaseq63F6JktwsDismrvoIaJJCOGR0nHaKCEPUpJQvtLyzW0KS0P5xZvVeTvH/NuetdIcUSmDfu6l2+3kMw7txAvIfmPNkA/Id29UMHLOIT7A8mms8xx2KeyHEMf+PH2c7JSSXyywKvQk5RZbYbK4b2S+xw8XNHIirXAK+zHPQeKs+BzpgBKgYjId7EWJuzVIb+FzL8kOAPfHY0ObUgALZsc9M9DpO9kW5MuiLWV+tVFF2MZaJgILYW9bQ7XlYs/++p//h2Mc+Exs81spTNT3OLUhkfAj8JbbheN4LUy5AdioaaK0j1qyQ4g9J+KzvYR1Qd7rCY43sr9hqIEAxJsqZUZ/uTmoYmphIutAxxHXS9mUaPIhqahRLZx8LZb5ju3i3H3ub1CN42FnBq5+vgDktZfPiGGhH2ANe0M8M8nlSCKMacqnL3Oz4fi1pe4q3ZEYtz9cr1ydoKRDfhBkOSZDjahj3Pt7oDbPc8d/q8w3qWe9gU67AGHqxi6XoxKMhYPKUmf1CX7E86ZGozmlIn2ASVeO2tW32k33xbCe1JfWM4SR1gMe7js6MB2cvzugUsReXzMWYai4YCKb41Cwd4EJo80HgzzSbSc0UET0jReTwH16vSy+DNslUgoszFt8GHxXSQxv4tZp4+nvafOquLqEM+genqYgFQRDlzmsSTOx73tELrWqP73vNrLt3QCwPCPaFhoYmT8n4aymgcBkYjtGn8+ZDDqAukut+Pn7kVfa2dxEnHkYyB03UoTwCPGKcu3bzcPGRTV9t2ZrUWfJ+ZGHgAC+93d3K7Mc32qzD0eH8ivgQ==&X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Date=20200522T095442Z&X-Amz-SignedHeaders=host&X-Amz-Expires=300&X-Amz-Credential=ASIAQ3PHCVTY4O52FRIU/20200522/us-east-1/s3/aws4_request&X-Amz-Signature=79f2c18ce0836d5de3f7d3548a16300d7e7fa2cdba2d55f3ff79fa1e29b8617e&hash=ceac7b4905f3e89c329495f1e5257eaa6b8abf8884faf1801f375f8efbb79d0e&host=68042c943591013ac2b2430a89b270f6af2c76d8dfd086a07176afe7c76c2c61&pii=S1474667015373353&tid=spdf-6ab13429-1e31-4d1b-b058-76e59f2aefe5&sid=e16dc2807f72b3408b0aba26a9136590d080gxrqb&type=client>) that double precision f.p. is reasonable for this task - the paper suggests that 69-bit fixed point would be needed. My question here is whether this type of filtering would be done in the class of processors we are currently considering? Perhaps Mark could let on about what sort of processor system (architecture, frequency, memory) is needed to support the application?

Roger

> On 21 May 2020, at 22:50, Mark Hill <mark.hill at huawei.com> wrote:
> 
> Hi Dave,
> 
> One area we see use of double precision floating point in embedded products is kalman filtering to combine inputs from various sensors, unfortunately the code we have is proprietary but perhaps there are some public domain implementations that could be used as a suitable benchmark.
> 
> Mark
> 
> 
> From: Embench [mailto:embench-bounces at lists.librecores.org] On Behalf Of Roger Shepherd
> Sent: 21 May 2020 16:50
> To: pattrsn at cs.berkeley.edu
> Cc: embench at lists.librecores.org
> Subject: Re: [Embench] Benchmark question
> 
> Dave,
> 
> Yes! I think getting some of the BDTI benchmarks would be great, especially if they retain some BDTI branding/copyright. When I last worked on DSPs, BDTI’s benchmarks had a very high reputation (partly because BDTI had results for a wide range of DSPs and processors).
> 
> Which makes me think, part of the utility of a benchmark suite comes from having results from a large number of processors/platforms. Perhaps we could actively address getting a wider set of results for Embench? Maybe a topic for our next call?
> 
> Roher
> 
> 
> 
> 
> On 21 May 2020, at 16:27, David PATTERSON <pattrsn at cs.berkeley.edu <mailto:pattrsn at cs.berkeley.edu>> wrote:
> 
> Following up from request for floating point benchmarks for Embench 0.6.
> 
> I presume I should follow up with an offer from BDTI for DSP benchmarks?
> 
> Dave
> 
> ---------- Forwarded message ---------
> From: Jeff Bier <bier at bdti.com <mailto:bier at bdti.com>>
> Date: Thu, May 21, 2020 at 8:20 AM
> Subject: RE: Benchmark question
> To: pattrsn at cs.berkeley.edu <mailto:pattrsn at cs.berkeley.edu> <pattrsn at cs.berkeley.edu <mailto:pattrsn at cs.berkeley.edu>>
> 
> 
> Hi Dave,
> 
> Sorry for the slow response on this.  My dad has been in the hospital this week -- he’s doing OK, but conditions related to Covid-19 made things much more complicated.
> 
> Regarding floating-point embedded benchmarks, here are some ideas…
> ·       My company, BDTI, would be willing to open source BDTI could open source the C reference code for a subset of our floating-point DSP benchmarks.  If this is of interest, let’s talk.  (This could be at the function level, like FFTs and FIR filters, and/or at the task level, like an OFDM wireless receiver baseband.)
> ·       https://www.fourmilab.ch/fbench/ <https://www.fourmilab.ch/fbench/>
> ·       Linear algebra libraries, e.g. matrix multiplication, matrix inversion.  (I don’t have a specific pointer, but I’m guessing there are open source libraries available.)
> ·       OpenCV is now C++, but earlier versions were C.  (Some computer vision tasks are pixel-oriented and inherently integer, but others are geometric and more naturally float-based.)
> ·       Here’s an audio application in C, with all sorts of algorithms such as de-clipper, eq, reverb, etc.  https://github.com/ePirat/Postfish <https://github.com/ePirat/Postfish>.  (However it may be a bit challenging to extract individual algorithms from the entire framework…)
> 
> I hope this helps.
> 
> -jeff-
> 
> From: David PATTERSON <pattrsn at cs.berkeley.edu <mailto:pattrsn at cs.berkeley.edu>>
> Sent: Tuesday, May 12, 2020 7:53 AM
> To: Jeff Bier <bier at edge-ai-vision.com <mailto:bier at edge-ai-vision.com>>
> Subject: Benchmark question
> 
> The embedded benchmarking effort I'm involved in wants to branch out to floating point programs from integer programs, and allow a little larger programs (250 KB of data).
> 
> Do you have any suggestions?
> 
> Ideally they we be open source C programs, including data sets.
> 
> DSP apps should be fine.
> 
> If there was an existing such benchmark for DSP or some other area, and they had an open source license, we might be able to follow their lead.
> 
> Best,
> Dave
> --
> Embench mailing list
> Embench at lists.librecores.org <mailto:Embench at lists.librecores.org>
> https://lists.librecores.org/listinfo/embench <https://lists.librecores.org/listinfo/embench>
> 
> --
> Roger Shepherd
> roger.shepherd at chipless.eu <mailto:roger.shepherd at chipless.eu>
--
Roger Shepherd
roger.shepherd at chipless.eu




-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.librecores.org/pipermail/embench/attachments/20200522/d1bb9931/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 833 bytes
Desc: Message signed with OpenPGP
URL: <http://lists.librecores.org/pipermail/embench/attachments/20200522/d1bb9931/attachment.sig>


More information about the Embench mailing list