How to run tests with CI test shield?

[JohnK1987]

Hello @multiplemonomials,

My plan for next few weeks is make the CI test shield and try to run the test. I recently bought a Bus Pirate device. So I hope the shield is the last but not least what I need. The last is knowledge how to run the test.

• Is it possible to make a short sequence of what need to be done to running tests, please?
• Because I want to make it on a CNC PCB Mill machine and for that I need to have it in Eagle. Do you have more source files what can be ported to to Eagle? If not, then nwm I will make it by my self.

This all is in context of my attempt to add STM32H5 family to the Mbed-CE. I bought Nucleo-H503RB (a more powerful H563ZI is not on the stock anywhere) and already made some small steps - successfully run the Blinky, Buffered/UnbufferedSerial (STDIO console included) examples (bare metal).

Thank you
BR, Jan

[multiplemonomials]

This is awesome! I've actually just been working on more CI Shield tests in the last few weeks. I'm stoked to hear that you want to try it too!

Unfortunately the CI shield was made in Altium, not Eagle, so I don't have source files you can edit. But I can run a Gerber export which you can feed into PCBWay. (this was made with PCBWay design rules)

Mbed CI Test Shield Gerbers and BOM.zip

That should have the design files you need. Also note that in the "BOM" spreadsheet, the "Supplier Part Number 1" column has the part number of each piece on DigiKey.

[JohnK1987]

Ah, maybe I missed that how I started from scratch, I will check it at home and come back to you.

[JohnK1987]

OK, I had this submodule empty because i forgot that. The test still failing but now with different description. Can you check that please?

Traceback (most recent call last):
File "C:\Users\user\MbedCE\Mbed-CI-Test-Shield\Software\host_tests\spi_basic_test.py", line 121, in setup
self.buspirate_spi.config = pyBusPirateLite.SPI.CONFIG_DRIVERS_OPEN_DRAIN |
^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\user\MbedCE\Mbed-CI-Test-Shield\Software\host_tests..\pyBusPirateLite\pyBusPirateLite\SPI.py", line 187, in config
raise ValueError("Could not set SPI configuration")
ValueError: Could not set SPI configuration

Result of CI for Nucleo-F767ZI

Software reset is performed
Executing: mbedhtrun --skip-flashing -p COM5 --skip-reset -e C:/Users/user/MbedCE/Mbed-CI-Test-Shield/Software/host_tests -m NUCLEO_F767ZI --baud-rate=115200
[1700079647.90][HTST][INF] host test executor ver. 0.0.16
[1700079647.90][HTST][INF] copy image onto target... SKIPPED!
[1700079647.90][HTST][INF] starting host test process...
[1700079648.59][CONN][INF] starting connection process...
[1700079648.59][CONN][INF] notify event queue about extra 60 sec timeout for serial port pooling
[1700079648.60][CONN][INF] initializing serial port listener...
[1700079648.60][SERI][INF] using specified port 'COM5'
[1700079648.60][SERI][INF] serial(port=COM5, baudrate=115200, read_timeout=0.01, write_timeout=5)
[1700079648.60][HTST][INF] setting timeout to: 60 sec
[1700079648.60][SERI][TXD] mbedmbedmbedmbedmbedmbedmbedmbedmbedmbed
[1700079648.60][CONN][INF] sending up to 2 __sync packets (specified with --sync=2)
[1700079648.60][CONN][INF] sending preamble 'f7389999-625d-4e14-adb5-75635e54f126'
[1700079648.60][SERI][TXD] {{__sync;f7389999-625d-4e14-adb5-75635e54f126}}
[1700079648.61][CONN][RXD] mbedmbedmbedmbedmbedmbedmbedmbed
[1700079648.61][CONN][INF] found SYNC in stream: {{__sync;f7389999-625d-4e14-adb5-75635e54f126}} it is #0 sent, queued...
[1700079648.61][HTST][INF] sync KV found, uuid=f7389999-625d-4e14-adb5-75635e54f126, timestamp=1700079648.614134
[1700079648.63][CONN][RXD] >>> Running 23 test cases...
[1700079648.63][CONN][INF] found KV pair in stream: {{__version;1.3.0}}, queued...
[1700079648.63][CONN][INF] found KV pair in stream: {{__timeout;20}}, queued...
[1700079648.63][CONN][INF] found KV pair in stream: {{__host_test_name;spi_basic_test}}, queued...
[1700079648.63][HTST][INF] DUT greentea-client version: 1.3.0
[1700079648.63][HTST][INF] setting timeout to: 20 sec
[1700079648.63][HTST][INF] host test class: '<class 'spi_basic_test.SpiBasicTestHostTest'>'
[1700079648.64][CONN][INF] found KV pair in stream: {{__testcase_name;Send 8 Bit Data via Single Word API}}, queued...
[1700079648.64][CONN][INF] found KV pair in stream: {{__testcase_name;Send 16 Bit Data via Single Word API}}, queued...
[1700079648.65][CONN][INF] found KV pair in stream: {{__testcase_name;Send 8 Bit Data via Transactional API (Tx only)}}, queued...
[1700079648.65][CONN][INF] found KV pair in stream: {{__testcase_name;Send 16 Bit Data via Transactional API (Tx only)}}, queued...
Traceback (most recent call last):
  File "C:\Users\user\MbedCE\Mbed-CI-Test-Shield\Software\host_tests\spi_basic_test.py", line 121, in setup
    self.buspirate_spi.config = pyBusPirateLite.SPI.CONFIG_DRIVERS_OPEN_DRAIN | \
    ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\user\MbedCE\Mbed-CI-Test-Shield\Software\host_tests\..\pyBusPirateLite\pyBusPirateLite\SPI.py", line 187, in config
    raise ValueError("Could not set SPI configuration")
ValueError: Could not set SPI configuration
[1700079648.66][TEST][INF] SPI Basic Test host test setup complete.
[1700079648.66][HTST][INF] host test setup() call...
[1700079648.66][HTST][INF] CALLBACKs updated
[1700079648.66][HTST][INF] host test detected: spi_basic_test
[1700079648.66][HTST][INF] __notify_complete(False)
[1700079648.66][HTST][INF] __exit_event_queue received
[1700079648.66][HTST][INF] test suite run finished after 0.03 sec...
[1700079648.66][CONN][INF] found KV pair in stream: {{__testcase_name;Read Data via Transactional API (Rx only)}}, queued...
[1700079648.66][CONN][INF] found KV pair in stream: {{__testcase_name;Read Data via Transactional API (Rx only)}}, queued...
[1700079648.67][CONN][INF] found KV pair in stream: {{__testcase_name;Transfer Data via Transactional API (Tx/Rx)}}, queued...
[1700079648.67][CONN][INF] found KV pair in stream: {{__testcase_name;Transfer Data via Transactional API (Tx/Rx)}}, queued...
[1700079648.67][CONN][INF] received special event '__host_test_finished' value='True', finishing
[1700079648.73][HTST][INF] CONN exited with code: 0
[1700079648.73][HTST][INF] Some events in queue
[1700079648.73][HTST][INF] stopped consuming events
[1700079648.73][HTST][INF] host test result() call skipped, received: False
[1700079648.73][HTST][WRN] missing __exit event from DUT
[1700079648.73][HTST][INF] calling blocking teardown()
[1700079648.84][HTST][INF] teardown() finished
[1700079648.84][HTST][INF] {{result;failure}}
CMake Error at mbed-run-greentea-test-testshield-spi-basic.cmake:20 (execute_process):
  execute_process failed command indexes:

    1: "Child return code: 1"

[multiplemonomials]

ah yes, I have gotten this error too... sometimes the Bus Pirate just does not want to work and frankly I'm kinda out of ideas. It's actually why for the past 3 months or so I have actually been working on a new version of the CI shield which uses something else instead. I'm close to getting it working (I think) and when I do I will ship you one as well.

Sometimes I've found that running the SPI sniff script (under pyBusPirateLite/bin) can help with this issue.

[JohnK1987]

Ok, I trust you, so I'll wait and not waste your time :)

[multiplemonomials]

no I'm glad you've been so interested in testing it out! I'm really grateful that you've been here to help me test and develop stuff -- otherwise I'd end up making stuff that's not well documented & too hard to use