[Embench] Embench meeting/call 17 Feb 2020

Jeremy Bennett jeremy.bennett at embecosm.com
Sun Feb 16 10:06:10 CET 2020

Hash: SHA1

Hi all,

A reminder that our next regular meeting of the Embench group will be
on Monday, 17 February, 8-10am California time.

This is our last meeting before the official launch of Embench 0.5 at
Embedded World.

We will meet using the same Zoom details as before. Please email me if
you do not have them - I am reluctant to post details on an open
mailing list.


1. Actions from previous meeting
- --------------------------------

ACTION: Jeremy Bennett to merge pull request 29 from Ola Jepsson.
- - Complete

ACTION: Jeremy Bennett to raise issue of better analytics with Stefan
Wallentowitz at FOSSi.
- - In progress.

ACTION: Jeremy Bennett and Roger Shepherd to try to re-engage with EEMBC.
- - Jeremy to meet with Peter Torelli at Embedded World

ACTION: Dave Patterson to send Jeremy documentation to upload to the Wiki.
- - Complete: documentation in process of being merged.

ACTION: Dave Patterson to prepare a paper for HotChips in August 2020.
- - In progress: To address after Embedded World (deadline 23 March)

ACTION: Jon Taylor to advise when to submit proposal to speak at Arm
TechCon in autumn 2020.
- - Ongoing

ACTION: Jeremy Bennett to investigate channels for press release for
Embedded World. Dave Patterson to write text of press release.
- - See below

ACTION: Jeremy Bennett to complete work on Arm Cortex M4 data points
as new baseline, for presentation at next meeting.
- - Complete - see below

2. GitHub pull requests
- -----------------------

The following pull requests have been merged:

- - Fix calculation in relative computation
- - Thanks to Luis Marques for the patch

- - Provide option to control timeout when building benchmarks
- - Thanks to Luis Marques for the patch

- - Document the requirement for at last Python 3.6
- - Thanks to J Monesti for the patch

- - Correct some mistakes in README.md
- - Thanks to Lyell Read for the patch

- - Adds a default target
- - Merge completes action from last month
- - Thanks to Ola Jeppsson for this big patch

The following pull request is outstanding:

- - Support for Arm Cortex M4
- - This work will be merged prior to Embedded World

3. New GitHub issues
- --------------------

- - Problem with building RISC-V benchmarks (empty binaries)
- - Needs diagnosis, but may be affected by recent changes
- - Thanks to Lyell Read for raising the issue

- - Avoiding full paths
- - This highlights a weakness in documenting the scripts
- - Thanks to Lyell Read for raising the issue

4. Website analytics
- --------------------

Update from Cesare Garlati

I have asked Stefan Wallentowitz to advise on how we can get better
data for offline processing (action in progress from previous meeting).

5. EEMBC process
- ----------------

Jeremy Bennett is to meet with Peter Torelli at Embedded World (action
from previous meeting).

6. Update on benchmarks
- -----------------------

Jeremy Bennett and Paolo Savini will present the new baseline results
using the Cortex M4. These have been measured using a low cost
STMicroelectronics Discovery board. The baseline also uses official
releases of GCC (9.2) and binutils (2.32).

These are not yet upstream, because we wish to provide results under
embargo to the press. They will go live during the talk at Embedded
World. If the meeting wishes, I shall present them under embargo
during the call. All results will undergo review prior to completion
of the press release.

With a new baseline existing results will all be reworked. We are in
the process of sanitizing our existing data, including preparation of
a new, cleaner embench-iot-results repository.

7. Process and documentation
- ----------------------------

Jon Taylor and Dave Patterson have prepared updated documentation,
which is in the process of being incorporated into the repository.

8. Publicity
- ------------

Embench was presented at the RISC-V London meetup hosted by the
British Computer Society (video to appear in due course) and at the
FOSDEM LLVM Developer's room. That latter talk looked at the value of
Embench in compiler development - slides and videos:


The official launch of Embench will be at Embedded World, 25-27
February. Unfortunately, due to Covid-19, this will be a much smaller
meeting than usual, and there is some risk it may even be cancelled.

Jeremy Bennett will be attending if it does go ahead (Embecosm GmbH is
based in N├╝rnberg), and will present on behalf of the Embench group.
The presentation will be prepared by Dave Patterson.

Dave Patterson and Jeremy Bennett will prepare a press release this
week, which will be shared under embargo with key journalists by
Cesare Garlati.

At our next meeting we shall review the launch and consider what we
should like to present at Hot Chips.

9. Next meeting
- ---------------

We meet regularly on the third Monday of each month 8-10am
California time. Our future meetings will be
- - Mon 16 Mar 2020
- - Mon 20 Apr 2020
- - Mon 18 May 2020
- - Mon 15 Jun 2020
- - Mon 20 Jul 2020
- - Mon 17 Aug 2020
- - Mon 21 Sep 2020
- - Mon 19 Oct 2020
- - Mon 16 Nov 2020
- - Mon 21 Dec 2020

At our next meeting, we shall consider whether monthly meetings are
needed - we may want to drop to quarterly meetings, at least until
closer to the next release.

I've been created a calendar entry for our regular attendees,
to provide automated reminders.

10. AOB
- -------

Best wishes,

Jeremy Bennett
Vice chair



More information about the Embench mailing list