438e07b30e
refactor: Remove idf_test component
...
Split the idf_performance.h and target ver, which hold the performance
thresholds, into the headers of each testing.
In the past pytest also parse the common header to get the thresholds.
Now the logic is also removed. Performance thresholds are supposed to be
in the pytest scripts.
2026-01-01 02:26:42 +08:00
7b180fbca2
change(ci): limit printing OpenOCD connection errors
2025-12-18 00:35:17 +01:00
2ee022ed3d
ci: attach_log_url for multi dut tests
2025-11-06 08:55:06 +01:00
3175db5346
ci: move extra targets need to be built by default to --additional-build-targets
2025-09-29 13:22:42 +02:00
76181e5fce
ci: skip app downloader for host test cases
2025-07-16 14:11:08 +02:00
d1a860bda5
ci: use fixed telnetlib since python 3.13 removed this from stdlib
2025-07-16 09:12:03 +02:00
037af2d40a
Merge branch 'ci/enable_sysview_tests' into 'master'
...
ci: enable sysview example tests for all chips
Closes IDF-13342
See merge request espressif/esp-idf!39532
2025-07-15 21:52:41 +08:00
ee65205183
ci: OpenOCD class as fixture
2025-07-15 12:57:19 +02:00
6ef01c9c26
ci: fix master pipeline artifacts downloading
2025-07-15 11:49:56 +02:00
7ada32c39a
ci: apply idf-ci for artifacts
2025-07-09 10:33:29 +02:00
15b411270e
ci: apply idf-ci on generating child pipelines
2025-07-09 10:33:29 +02:00
a5257dcc39
ci: apply idf-ci pytest plugin
...
Removed
- target markers. Now must use target as parametrization in esp-idf
- host test markers. Now will be automatically added with linux target and qemu marker
2025-07-09 10:33:28 +02:00
24d2720793
Revert "ci: OpenOCD class as fixture"
...
This reverts commit 0eb74ffcc3
2025-05-28 08:38:08 +02:00
0eb74ffcc3
ci: OpenOCD class as fixture
2025-05-27 04:48:18 +08:00
a1d5d5cbd6
ci: rename local idf_ci folder, avoid name collision
2025-04-25 11:13:17 +02:00
bbcef0570d
ci: add test marks linter
2025-03-04 15:53:32 +08:00
2c814ef2fa
feat(tools): Enforce utf-8 encoding with open() function
2024-12-27 17:12:21 +08:00
5bbc767f2e
ci: make app path relative to IDF_PATH minimum free heap size log
2024-12-18 09:22:45 +08:00
819703c442
ci: add app_path to log_minimum_free_heap_size to allow better identification of the app based on its path
2024-12-13 11:22:53 +08:00
cd59d96ff4
ci: add dut_log_url column to failed testcases report
...
Introduced changes:
- add xml attribute "dut_log_url" to pytest report
- add column "dut_log_url" to failed testcases table of dynamic pipeline report
- make the table header sticky
- add permalinks to the Table Titles
- split target test report by testcase type for better clarity
- fix the logic of finding the testcases failed on cur branch / other branches
2024-07-17 17:52:11 +08:00
d3abfa3d73
Merge branch 'ci/fix_pytest_embedded_log_dir' into 'master'
...
ci: move log dir from pytest_embedded_log to pytest-embedded
See merge request espressif/esp-idf!30747
2024-05-10 16:28:49 +08:00
152db1a4ba
ci: move log dir from pytest_embedded_log to pytest-embedded
2024-05-09 12:23:04 +02:00
1680c2fe33
Merge branch 'bugfix/pytest_build_dir_arg' into 'master'
...
fix(pytest): respect --build-dir argument from pytest-embedded
See merge request espressif/esp-idf!30609
2024-05-07 21:12:57 +08:00
948fdfcc2c
ci: apply new fix in pytest-embedded 1.10
2024-05-07 17:28:28 +08:00
087d055090
fix(pytest): respect --build-dir argument from pytest-embedded
2024-05-02 15:18:34 +02:00
6034638e4a
ci: quote spec character in url
2024-04-25 18:33:06 +08:00
b887f476da
ci: reduce pytest job stdout log
2024-04-02 16:14:02 +08:00
7641776ae2
ci: support filter pytest with sdkconfig name
2024-03-12 11:16:39 +01:00
9783207f0b
Merge branch 'ci/qemu_respect_all_test_triggerer' into 'master'
...
ci: fix idf_relpath issue while searching the apps
See merge request espressif/esp-idf!28645
2024-01-30 16:01:24 +08:00
432c5a783d
ci: gitlab auth failing hint
2024-01-29 13:52:40 +01:00
142a3c8a7a
ci: fix idf_relpath issue while searching the apps
...
Now `PytestCase`, collect_app_info file, are all using relpath to idf
instead
2024-01-29 20:45:00 +08:00
2ddb0fb3f6
ci: fix app.requires_elf_or_map. Use absolute paths
2024-01-22 11:14:03 +01:00
23c339e231
ci: raise RuntimeError instead of SystemExit to avoid kill the process
...
otherwise the pytest process will be killed immediately
2024-01-16 20:21:40 +01:00
61aafd1e89
ci: fix download with multi-dut test cases with markers only
2024-01-15 22:36:09 +01:00
c8dffc9378
ci: fix collect multi-dut test case with markers issue
...
While collecting, we stop registering the new plugin.
Otherwise the new created plugin will override the one we passed
also run the tests inside idf. the behavior is different.
2024-01-15 22:36:09 +01:00
edf735a458
ci: fix get binaries from pipeline via the build report
...
should extract to IDF_PATH, not the current workdir
2024-01-12 08:43:20 +01:00
fba96d58c2
ci: dynamic pipeline
...
build:
- upgrade idf-build-apps to 2.x
- unify get_pytest_apps and get_cmake_apps to get_all_apps
- returns (test_apps, non_test_apps) tuple
- add tests for the new get_all_apps
assign:
- generate build report
- generate target test pipeline based on the build report
target test:
- download artifacts from minio server
- users can use `pytest --pipeline-id xxxxx` to download and flash
the binaries from the artifacts
.post:
- generate target test reports
2024-01-10 15:37:34 +01:00
06af021c9f
ci(pytest): stop ambiguous markers for multi-dut test case
...
also add `tools/ci/idf_pytest/tests` for testing
2024-01-10 15:29:42 +01:00
e0a40feb5c
refactor: changed logic of unity_tester, replaced threads by generators
2023-12-06 15:58:05 +08:00
a3362727cc
ci: assign the test_case_name attribute to the case item while setting up a pytest session
2023-10-23 20:45:05 +08:00
24b2e0a56d
ci: different test case name with different params
2023-10-04 16:05:29 +00:00
5e4427ab13
ci(pytest): add plugin pytest-ignore-test-results
...
pass with warning if test job got ignored.
2023-08-18 10:50:18 +08:00
39f3a5f3ac
ci(pytest): skip test case if no app found while collecting, not setup
2023-08-18 08:36:06 +08:00
1d69302eae
ci(pytest): move pytest utils into tools/ci/idf_pytest
...
For future usage
2023-08-18 08:36:06 +08:00
36511a3005
Merge branch 'feature/add_sleep_test_for_ot_ci' into 'master'
...
OpenThread CI: add a test case of sleepy device
See merge request espressif/esp-idf!24715
2023-08-01 20:38:29 +08:00
ef50beb4d0
ci: Added napt pytest with vlan example
...
CI: add vlan example to ethernet patterns
Included a Pytest for the vlan_support example, which focuses on testing
the NAPT module in lwip by forwarding packets between different VLAN interfaces.
2023-07-31 13:42:26 +00:00
5f51dcc686
ci(openthread): Add a test case for openthread sleepy device
2023-07-31 15:38:11 +08:00
7c3143dba8
ci: name the test case id with _qemu postfix for qemu test cases
2023-07-26 17:09:38 +08:00
9f5f8fa939
ci(pytest): Add functionality to merge JUnit files of the multidut testcases into one file with the unique testcases
2023-07-25 10:11:55 +08:00
7645723127
fix(ci): update HTTP client example tests runner assignment
...
HTTP client example tests now connect with locally hosted httpbin service
for more stable results across multiple runs
2023-07-21 10:55:25 +05:30
Xiao Xufeng
Erhan Kurubas
igor.udot
Fu Hanxi
Samuel Obuch
Marius Vikhammer
Marek Fiala
Aleksei Apaseev
Ivan Grokhotkov
Xu Si Yu
Abhik Roy
Harshit Malpani