Roey Berman 2385ef9dfe Rerun failed tests automatically (#6668) ...

## What changed?

Leverage gotestsum to automatically retry failed tests in all suites
(unit, integration, functional, xdc, ndc).
By default, tests will be retried twice if there are no more than 10
failed tests in the suite.

### Changes to the `Makefile`

Add `FAILED_TEST_RETRIES` variable, defaulting to `2`.

Removed the use of `SINGLE_TEST_ARGS`, `TEST_ARGS` can be used instead.
Moved `-race` flag to its own separate flag and freed up `TEST_ARGS` to
be set by callers without.

Added:
```
# Whether or not to test with the race detector. All of (1 on y yes t true) are true values.
TEST_RACE_FLAG ?= on
# Whether or not to shuffle tests. All of (1 on y yes t true) are true values.
TEST_SHUFFLE_FLAG ?= on
```

Added `COMPILED_TEST_ARGS` that combines the common flags and options to
be reused by all test invocations.

### Changes to `run-tests.yml`

Removed the use of `SINGLE_TEST_ARGS`.

Merged the `Run single unit test` step into `Run unit tests`.

Set `FAILED_TEST_RETRIES: "0"` on flaky test detection steps.

Removed steps to upload test results to buildkite and relevant script /
Makefile content.

Moved flaky test detection to after the upload test results (to GH) step
in all jobs.

## Why?

So we can enable flaky tests to get coverage without hurting the CI
experience.

2024-10-21 06:24:29 -07:00

..

docker-compose

Remove version field from docker compose yaml file (#6610)

2024-10-09 10:38:26 -07:00

github

Reduce cassandra heap size in CI (#6673)

2024-10-17 16:51:48 -07:00

buf-breaking.sh

Fix buf-breaking script to account for already merged commit (#6296)

2024-07-26 14:56:59 -07:00

protoc.sh

Check for breaking proto changes (#6114)

2024-07-10 16:44:07 -07:00