3
0
Fork 0
mirror of https://github.com/YosysHQ/sby.git synced 2025-04-06 22:34:07 +00:00
Commit graph

50 commits

Author SHA1 Message Date
Jannis Harder 5265a52b65 Refactor flow to use a common prep model
The goal of this is to make sure that all backend flows are compatible
and we can map between them, so that e.g. the aiger model can be used to
minimize a counterexample trace produced by smtbmc. Reducing the parts
that differ per backend (including parts that receive different input
depending on the used backend) also makes testing more effective as the
common parts are easier to cover.
2022-08-05 16:31:15 +02:00
Jannis Harder 523b7a252e Regression test for YosysHQ/yosys#3433 2022-08-03 16:08:19 +02:00
N. Engelhardt 1cf206fc1c add cvc5 executable to required tool mapping 2022-07-25 17:01:17 +02:00
N. Engelhardt 3ff2c9affc avoid erroring out when coarse-grain logic loops can be resolved by mapping to fine grain operators 2022-07-25 16:22:32 +02:00
Jannis Harder ea7fc7dc2c tests: Windows fixes
Make tests runnable on Windows, as long as a unix like environment as
e.g. provided by MSYS2 is available.
2022-07-05 15:34:27 +02:00
Jannis Harder ff802086b4 test uninited FFs with const clks and fix btor script for this 2022-07-04 14:03:56 +02:00
Jannis Harder e01ac8b848 tests: Test for invalid x-value FF init optimizations 2022-07-04 13:33:39 +02:00
Jannis Harder e3123283ea
Merge pull request #170 from programmerjake/add-simcheck-option
switch to using hierarchy -smtcheck for smtlib2 solvers, allowing smtlib2_module modules
2022-07-03 11:47:22 +02:00
Jannis Harder 48a02f9cc4 Test autotune 2022-06-27 15:58:42 +02:00
Jacob Lifshay db740839b7 switch to using hierarchy -smtcheck for smtlib2 solvers, allowing smtlib2_module modules.
Fixes: #168

Depends on: https://github.com/YosysHQ/yosys/pull/3391
2022-06-22 21:17:29 -07:00
Jannis Harder 05d963b0df aiger: check supported modes and aigbmc fixes 2022-06-14 17:41:06 +02:00
Jannis Harder a200043709
Merge pull request #172 from jix/smtbmc-unroll-noincr-traces-fix
Regression test for smtbmc --unroll --noincr
2022-06-13 14:05:37 +02:00
Jannis Harder 499371fd39 Use the test Makefile for all examples
* Rename and move sbysrc/demo[123].sby to docs/examples/demos
    * Make them use multiple tasks for multiple engines
* Scan docs/examples for sby files for make test
* `make ci` is now `NOSKIP` by default
* Skip scripts using `verific` w/o yosys verific support
    * This does not fail even with NOSKIP set
2022-06-13 13:42:58 +02:00
Jannis Harder 4ef02d2c5c Regression test for smtbmc --unroll --noincr 2022-06-13 13:36:42 +02:00
Jannis Harder d0da57f54f Test that cvc4 and cvc5 can be used 2022-06-08 13:33:12 +02:00
Jannis Harder 675dc03dfe tests: Remove unused tool list in test Makefile
The checks for available tools moved to a python script, so need need to
have a copy of the tool list in the Makefile.
2022-06-08 11:32:35 +02:00
Jannis Harder 534ac21742
Merge pull request #169 from jix/yices-forall
Test designs using $allconst
2022-06-08 09:43:47 +02:00
Jannis Harder 34d6adf098 tests: Move required tool checks from rule generation to execution
This avoids regenerating the test makefile rules when the set of
installed tools changes and is a bit simpler overall.
2022-06-07 14:29:25 +02:00
Jannis Harder 80eacf34ca Don't fail tests when xmlschema is missing 2022-06-03 17:22:45 +02:00
Jannis Harder b4c110815c Test designs using $allconst 2022-06-03 16:55:06 +02:00
Jannis Harder d398a3c2df tests: Fail on CI when any required tool is missing 2022-06-02 16:38:21 +02:00
Jannis Harder 00efdecb4b tests: Check for btorsim --vcd 2022-06-02 16:38:21 +02:00
Jannis Harder dc22d97362 Better checking of available solvers
Check for required auxiliary tools and always regenerate the make rules
when the set of available tools changes.
2022-05-30 15:02:26 +02:00
Jacob Lifshay a87d21a802 add depth 1 2022-05-25 03:35:21 -07:00
Jacob Lifshay 3f32deb8c9 add test for yosys's $divfloor and $modfloor cells
Depends on: https://github.com/YosysHQ/yosys/pull/3335
2022-05-24 17:51:48 -07:00
Jannis Harder 8da6f07cb3 Refactor tests
Organize tests into subdirectories and use a new makefile that scans
.sby files and allows selecting tests by mode, engine, solver and/or
subdirectory. Automatically skips tests that use engines/solvers that
are not found in the PATH.

See `cd tests; make help` for a description of supported make targets.
2022-04-11 17:50:38 +02:00
Jannis Harder ef236eeddc Regression test: do not merge FFs with unconstrained initvals
Currently done by `opt -keepdc` via `opt_merge` but not valid in a
formal context.
2022-04-01 19:25:09 +02:00
Jannis Harder b725bfed0c Prefer the first tracefile for each failing assertion 2022-03-30 13:47:14 +02:00
N. Engelhardt 2e0087fd2f
Merge pull request #150 from nakengelhardt/fix_junit_type_assignment
note unexpected return statuses in junit
2022-03-30 12:53:48 +02:00
Jannis Harder 81e8b6737b
Merge pull request #147 from jix/smtbmc-keepgoing
Support and tests for smtbmc `--keep-going`
2022-03-30 11:42:48 +02:00
Jannis Harder 2d3d96478a Tests for --keep-going
This also changes the test Makefile to run `.check.py` files after
running the corresponding `.sby` file to allow more precise testing of
the keep going feature.
2022-03-30 11:26:58 +02:00
N. Engelhardt 008d020c4d note unexpected return statuses in junit 2022-03-29 19:10:29 +02:00
N. Engelhardt 53abf14514
Merge pull request #145 from nakengelhardt/fix_junit_tracefile
junit: handle multiple asserts failing with the same trace
2022-03-28 16:32:54 +02:00
N. Engelhardt 3d8f56b89a
Merge pull request #142 from nakengelhardt/fix_backslash_smt2
translate backslashes in cell names the same way as smt2 backend does
2022-03-28 16:32:10 +02:00
Jannis Harder a434252ca1 Test signals with nonzero start offsets in aim files with smtbmc 2022-03-25 15:18:45 +01:00
N. Engelhardt c7e4785a8a junit: handle multiple asserts failing with the same trace 2022-03-22 16:16:02 +01:00
N. Engelhardt 5dc7fc9a4d translate backslashes in cell names the same way as smt2 backend does 2022-03-22 11:14:48 +01:00
N. Engelhardt 2441940653 ci housekeeping 2022-03-15 15:12:59 +01:00
N. Engelhardt 8a81b61321 fix ci 2022-03-07 08:34:01 +01:00
N. Engelhardt 7142f790e4 add testcase for overall run result 2022-02-24 22:44:11 +01:00
N. Engelhardt 89ed843ff1 validate junit files (with extra attributes added to schema) 2022-02-22 16:16:37 +01:00
N. Engelhardt 7ee357fcc8 fix induction 2022-02-07 22:01:52 +01:00
N. Engelhardt 7d3545dc86 fix junit error/failure/skipped count 2022-02-07 19:20:29 +01:00
N. Engelhardt 53eb25fcae handle unreached cover properties 2022-02-07 15:29:36 +01:00
N. Engelhardt 1cf27e7c31 parse solver location output for assert failures (cover not functional yet) 2022-01-27 13:41:07 +01:00
N. Engelhardt cdf5650c12 add JUnit schema and validator
Signed-off-by: N. Engelhardt <nak@yosyshq.com>
2022-01-13 13:43:38 +01:00
N. Engelhardt ad07ea0e85 add testcase exposing #137 2022-01-12 11:06:05 +01:00
N. Engelhardt b6dc1c9da3 fix test rule 2020-07-24 16:06:44 +02:00
Claire Wolf a23c76a169 Remove redundant copy of picorv32
Signed-off-by: Claire Wolf <claire@symbioticeda.com>
2020-07-24 15:13:45 +02:00
N. Engelhardt 8c5b65cf97 add tests directory with additional tests 2020-07-24 13:51:39 +02:00