integrate PolyBench/C benchmark

[Luca388]

Added the PolyBench/C 4.2 benchmark suite for issue #442, updated benchmark.py to run PolyBench benchmarks, and added polybench.py to compile them to WebAssembly.

[clover2123]

This is a huge update because it includes all the polybench source code.
IMO what about adding a submodule under the test/wasmBenchmarker directory instead of including these source files?
(Currently, we are using many submodules in the third_party directory, such as GCutil and sljit)

It seems that the following repo would be suitable for a submodule (it is a 4.2.1 version, but I cannot find any 4.2 version repo)
https://github.com/MatthiasJReisinger/PolyBenchC-4.2.1

[Luca388]

This is a huge update because it includes all the polybench source code. IMO what about adding a submodule under the test/wasmBenchmarker directory instead of including these source files? (Currently, we are using many submodules in the third_party directory, such as GCutil and sljit)

It seems that the following repo would be suitable for a submodule (it is a 4.2.1 version, but I cannot find any 4.2 version repo) https://github.com/MatthiasJReisinger/PolyBenchC-4.2.1

Thanks for the suggestion. I updated the PR to use the PolyBenchC-4.2.1 repository as a submodule under test/wasmBenchmarker.

[clover2123]

It seems that the added polybench tests are not running at all in CI.
The default test directory of benchmark.py is set to ctests, and the current CI just uses this default directory.
(please check below code)

walrus/.github/workflows/actions.yml

Lines 435 to 437 in e0cc0f1

	- name: Run Tests
	run: |
	test/wasmBenchmarker/benchmark.py --engines $GITHUB_WORKSPACE/out/linux/${{ matrix.arch }}/walrus --iterations 2 --verbose --summary --results i j2i n2i j n2j

walrus/test/wasmBenchmarker/benchmark.py

Lines 29 to 31 in e0cc0f1

	TEST_DIR = join(dirname(abspath(__file__)), "ctests")

[clover2123]

It may be more complicated to merge polybench into the existing wasmBenchmarker.
Instead, what about simply separating/adding a new directory, such as test/polybench along with its own python script?
In this case, you also need to add a job in .github/workflow/actions.yml to explicitly run the polybench tests.

[Luca388]

It may be more complicated to merge polybench into the existing wasmBenchmarker. Instead, what about simply separating/adding a new directory, such as test/polybench along with its own python script? In this case, you also need to add a job in .github/workflow/actions.yml to explicitly run the polybench tests.

I separated PolyBench into test/polybench with its own Python runner and added a dedicated x64/x86 CI job.

The new runner follows the existing benchmark.py behavior for performance measurements, JIT comparisons, memory measurement, summaries, and reports.

[clover2123]

minor typo)
The name of the submodule (test/wasmBenchmarker/polybench) and its path(test/polybench/PolyBenchC-4.2.1) are not identical.
Please unify these as test/polybench
Also, add ignore = untracked at the bottom

[Luca388]

Thanks for pointing this out.

I updated the submodule name and path to test/polybench/PolyBenchC-4.2.1 and added ignore = untracked to the submodule configuration.

[clover2123]

LGTM