Bare metal greentea support #11721

rajkan01 · 2019-10-21T13:28:00Z

Description (required)

Enabling green tea test support for bare metal and test cases update

Summary of change (What the change is for and why)

Added the baremetal.json under Tests directory to provide configuration for green tea test framework for bare metal.
Added the required components(mbed-crypto,mbedtls, filesystem etc.,) in baremetal.json to make mbed os build success even though some of those test cases are not supported in bare-metal.
Removed the EMAC and USB_DEVICE from the build even though target have support but those components are not supported in bare metal
Whichever test cases heavily depend on RTOS are guarded with MBED_CONF_RTOS_PRESENT flag so that the green tea framework will mark those test case as "Build Skips" category.

Note: Whichever component test cases use the RTOS API but still, those particular components (example: events) can run without RTOS so later we need to work on this issue to make those components test cases to run on bare-metal.

Tested the green tea test on below list of targets with bare metal config and added the logs in IOTCORE-1397[https://jira.arm.com/browse/IOTCORE-1397] Jira ticket
- K64F
- K66F
- Nucleo F429ZI
- Nucleo F411RE
- Nucleo L073RZ
- Nucleo F207ZG
Command to run green tea test for bare metal for NUCLEO_F429ZI,K64F:
mbed test -m NUCLEO_F429ZI -t GCC_ARM --app-config TESTS/configs/baremetal.json
mbed test -m K64F -t GCC_ARM --app-config TESTS/configs/baremetal.json

Documentation (Details of any document updates required)

Pull request type (required)

[x] Patch update (Bug fix / Target update / Docs update / Test update / Refactor)
[] Feature update (New feature / Functionality change / New API)
[] Major update (Breaking change E.g. Return code change / API behaviour change)

Test results (required)

[] No Tests required for this change (E.g docs only update)
[x] Covered by existing mbed-os tests (Greentea or Unittest)
[] Tests / results supplied as part of this PR

Reviewers (optional)

@evedon @hugueskamba @jamesbeyond

Release Notes (required for feature/major PRs)

Summary of changes

Impact of changes

Migration actions required

TESTS/baremetal.json

features/frameworks/greentea-client/source/greentea_metrics.cpp

ciarmcom · 2019-10-21T15:00:30Z

@rajkan01, thank you for your changes.
@jamesbeyond @hugueskamba @evedon @ARMmbed/mbed-os-maintainers please review.

TESTS/baremetal.json

features/frameworks/greentea-client/source/greentea_metrics.cpp

features/frameworks/greentea-client/source/greentea_test_env.cpp

evedon · 2019-10-23T15:42:46Z

Update the PR description and mark that this PR introduces Test update change.

jamesbeyond

Discussed with @rajkan01, 155 changes file would too much for review.
Suggested to breakdown in to smaller PRs, and let individual team-leads to review

-Added the baremetal.json on Tests directory to enable bare-metal -Conditional enable of greentea metrics Note: Run green tea with bare metal mbed test -m target -t GCC_ARM -n tests-mbed_platform-transaction --app-config TESTS/baremetal.json

-Added the mbedtls,crypto,psa,filesystem,fat,littlefs in baremetal.json to resolve compiler issue -Disable metrics that are not available for bare metal -Moved the baremetal.json inside TESTS/configs directory

- RTOS supported test case guarded with MBED_CONF_RTOS_PRESENT flag - Added the #error to non supported test case for bare metal

…s to back to original -Change the #error description more precisely -Separated the MBED_CONF_RTOS_PRESENT guarded

evedon

I think we have to enable more bare metal tests. If it does not take too much time we will do it in this PR; if not we will raise tickets to work on it separately.

TESTS/configs/baremetal.json

TESTS/events/timing/main.cpp

TESTS/integration/COMMON/file_test.cpp

TESTS/integration/COMMON/file_test.h

TESTS/usb_device/basic/USBEndpointTester.cpp

TESTS/usb_device/basic/USBEndpointTester.h

TESTS/usb_device/basic/USBTester.cpp

TESTS/usb_device/basic/USBTester.h

TESTS/usb_device/msd/TestUSBMSD.h

TESTS/configs/baremetal.json

…al greentea test

TESTS/usb_device/msd/main.cpp

TESTS/mbed_drivers/race_test/main.cpp

TESTS/mbedmicro-rtos-mbed/basic/main.cpp

TESTS/mbedmicro-rtos-mbed/event_flags/main.cpp

TESTS/mbedmicro-rtos-mbed/mail/main.cpp

TESTS/mbedmicro-rtos-mbed/mutex/main.cpp

TESTS/mbedmicro-rtos-mbed/semaphore/main.cpp

TESTS/mbedmicro-rtos-mbed/signals/main.cpp

TESTS/mbedmicro-rtos-mbed/threads/main.cpp

jamesbeyond

LGTM now

TESTS/integration/COMMON/download_test.h

TESTS/integration/COMMON/file_test.h

TESTS/integration/fs-single/main.cpp

TESTS/mbed_drivers/race_test/main.cpp

TESTS/mbedmicro-rtos-mbed/systimer/main.cpp

…test case

rajkan01 · 2019-11-11T13:15:04Z

@adbridge @0xc0170 Please start the CI

0xc0170 · 2019-11-11T14:55:31Z

CI started

mbed-ci · 2019-11-11T17:59:00Z

Test run: SUCCESS

Summary: 11 of 11 test jobs passed
Build number : 1
Build artifacts

VeijoPesonen

Looks good to me

0xc0170

As stated, we will need to fix some tests that should run with baremetal (everything in platform/hal should do). This comes as result "rtos always included".

…d#11721 This test is failed since ARMmbed#11721 Bare metal greentea support on many STM32 boards: NUCLEO_F072RB, NUCLEO_F070RB NUCLEO_F411RE, NUCLEO_F439ZI, NUCLEO_F446ZE, DISCO_F407VG NUCLEO_F303RE ...

tests-mbed_hal-sleep_manager: fix regression found on since PR #11721

0xc0170 reviewed Oct 21, 2019

View reviewed changes

TESTS/baremetal.json Outdated Show resolved Hide resolved

rajkan01 changed the title ~~Bare metal greentea support~~ Work In progress - Bare metal greentea support Oct 21, 2019

jamesbeyond reviewed Oct 21, 2019

View reviewed changes

features/frameworks/greentea-client/source/greentea_metrics.cpp Outdated Show resolved Hide resolved

ciarmcom requested review from evedon, hugueskamba, jamesbeyond and a team October 21, 2019 15:00

ciarmcom added the needs: review label Oct 21, 2019

evedon requested changes Oct 21, 2019

View reviewed changes

TESTS/baremetal.json Outdated Show resolved Hide resolved

features/frameworks/greentea-client/source/greentea_metrics.cpp Outdated Show resolved Hide resolved

features/frameworks/greentea-client/source/greentea_test_env.cpp Outdated Show resolved Hide resolved

rajkan01 force-pushed the feature-baremetal-greentea branch from 1b5cfbc to e00bad2 Compare October 22, 2019 17:17

evedon added the do not merge label Oct 23, 2019

rajkan01 changed the title ~~Work In progress - Bare metal greentea support~~ Bare metal greentea support Nov 1, 2019

rajkan01 force-pushed the feature-baremetal-greentea branch 2 times, most recently from c319b85 to 2b8f26c Compare November 5, 2019 14:27

jamesbeyond suggested changes Nov 5, 2019

View reviewed changes

rajkan01 added 2 commits November 5, 2019 08:49

Bare metal greentea support

f402dbb

-Added the baremetal.json on Tests directory to enable bare-metal -Conditional enable of greentea metrics Note: Run green tea with bare metal mbed test -m target -t GCC_ARM -n tests-mbed_platform-transaction --app-config TESTS/baremetal.json

Fixed the greentea test dependency and incorporated the review comments

3fc8905

-Added the mbedtls,crypto,psa,filesystem,fat,littlefs in baremetal.json to resolve compiler issue -Disable metrics that are not available for bare metal -Moved the baremetal.json inside TESTS/configs directory

rajkan01 force-pushed the feature-baremetal-greentea branch 2 times, most recently from e2e8b37 to aef2d84 Compare November 5, 2019 19:00

evedon removed the do not merge label Nov 6, 2019

rajkan01 added 2 commits November 6, 2019 01:57

- Emac,NFC-EEPROM,PSA-CRYPTO components build issue fixed

302f595

- RTOS supported test case guarded with MBED_CONF_RTOS_PRESENT flag - Added the #error to non supported test case for bare metal

-New PR for PSA,Netsocket,storage components,reverted all the change…

b1731ce

…s to back to original -Change the #error description more precisely -Separated the MBED_CONF_RTOS_PRESENT guarded

rajkan01 force-pushed the feature-baremetal-greentea branch from aef2d84 to b1731ce Compare November 6, 2019 10:42

This was referenced Nov 6, 2019

Bare metal green tea test for storage component #11825

Merged

Skip Bare Metal green tea test for Network component #11824

Merged

Skip Bare Metal green tea test for PSA component #11821

Merged

evedon requested changes Nov 6, 2019

View reviewed changes

VeijoPesonen reviewed Nov 7, 2019

View reviewed changes

TESTS/configs/baremetal.json Show resolved Hide resolved

Enabled the sleep,sleep_manager,watchdog_reset test case for bare met…

74d1939

…al greentea test

rajkan01 force-pushed the feature-baremetal-greentea branch from 688fbe7 to 74d1939 Compare November 7, 2019 18:34

jamesbeyond suggested changes Nov 8, 2019

View reviewed changes

jamesbeyond approved these changes Nov 8, 2019

View reviewed changes

evedon requested changes Nov 8, 2019

View reviewed changes

Incorporated review comments

9e994cf

rajkan01 force-pushed the feature-baremetal-greentea branch from 35718a0 to 9e994cf Compare November 8, 2019 14:49

evedon requested changes Nov 8, 2019

View reviewed changes

TESTS/mbedmicro-rtos-mbed/systimer/main.cpp Outdated Show resolved Hide resolved

rajkan01 force-pushed the feature-baremetal-greentea branch 2 times, most recently from f842e19 to bd5fc8d Compare November 9, 2019 00:09

Error message correction and rx_lib header filer removed on systimer …

6437f99

…test case

rajkan01 force-pushed the feature-baremetal-greentea branch from bd5fc8d to 6437f99 Compare November 9, 2019 00:11

evedon approved these changes Nov 11, 2019

View reviewed changes

adbridge added needs: CI and removed needs: work labels Nov 11, 2019

VeijoPesonen approved these changes Nov 12, 2019

View reviewed changes

0xc0170 added the release-version: 6.0.0-alpha-1 First pre-release version of 6.0.0 label Nov 12, 2019

0xc0170 approved these changes Nov 12, 2019

View reviewed changes

0xc0170 added release-version: 5.15.0-rc1 and removed release-version: 6.0.0-alpha-1 First pre-release version of 6.0.0 needs: CI labels Nov 12, 2019

0xc0170 merged commit 09d9287 into ARMmbed:master Nov 12, 2019

ABOSTM mentioned this pull request Nov 26, 2019

DISCO_H747I: add support of MBED_TICKLESS #11950

Merged

ABOSTM mentioned this pull request Nov 27, 2019

tests-mbed_hal-sleep_manager: fix regression found on since PR #11721 #11956

Merged

0xc0170 added a commit that referenced this pull request Nov 27, 2019

Merge pull request #11956 from ABOSTM/FIX_SLEEP_MANAGER

d5f813b

tests-mbed_hal-sleep_manager: fix regression found on since PR #11721

LDong-Arm mentioned this pull request May 7, 2020

Tutorial on creating a bare metal application ARMmbed/mbed-os-5-docs#1305

Merged

Bare metal greentea support #11721

Bare metal greentea support #11721

Uh oh!

Conversation

rajkan01 commented Oct 21, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description (required)

Summary of change (What the change is for and why)

Documentation (Details of any document updates required)

Pull request type (required)

Test results (required)

Reviewers (optional)

Release Notes (required for feature/major PRs)

Summary of changes

Impact of changes

Migration actions required

Uh oh!

Uh oh!

Uh oh!

ciarmcom commented Oct 21, 2019

Uh oh!

Uh oh!

Uh oh!

Uh oh!

evedon commented Oct 23, 2019

Uh oh!

jamesbeyond left a comment

Choose a reason for hiding this comment

Uh oh!

evedon left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

jamesbeyond left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

rajkan01 commented Nov 11, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

0xc0170 commented Nov 11, 2019

Uh oh!

mbed-ci commented Nov 11, 2019

Test run: SUCCESS

Uh oh!

VeijoPesonen left a comment

Choose a reason for hiding this comment

Uh oh!

0xc0170 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

rajkan01 commented Oct 21, 2019 •

edited

Loading

rajkan01 commented Nov 11, 2019 •

edited

Loading