vac:qa:waku:status-go-functional-testing-2024q4
Description
Collaborate with Status QA in creating a test framework that uses status-backend to do functional testing for status go, by integrating existing Status CLI tests into it.
The Status Go devs have created a new tool for functional testing of Status Go features. Status QA and VAC QA will collaborate to build a testing framework around this tool and add new test coverage through this framework. In the beginning, Status QA will move the statusd tests, while VAC QA will integrate the status-cli tests to set up the framework. After that, VAC QA will be responsible for the message tests, though this is still to be determined. The tests should validate Status features under normal and abnormal conditions and usage. We will track test coverage to measure progress.
Alignment with VAC Narratives:
- By helping create a robust functional testing framework for Status Go, VAC QA contributes directly to the narrative of internal collaboration and efficiency.
- Additionally, it aligns with the goal of fostering a strong RFC culture by ensuring the tests provide valuable feedback for maintaining high standards in the specifications.
Task List
Migrate to Status Backend
- fully qualified name:
vac:qa:waku:status-go-functional-testing-2024q4:migrate-to-status-backend - owner: shashankshampi
- status: started
- start-date: 2024/10/07
- end-date: 2024/10/21
Description
Update the existing tests to use status-backend and ensure alignment with the Status Go testing framework. The existing Status Go tests created by VAC QA and Status QA have been using the status-cli or statusd tools, which are primarily CLI-based. Now, developers want to replace them with status-backend, a more advanced tool with a JSON-RPC based approach.
Deliverables
- PR with the updated tests
- CI runs showing similar execution results with the new tool compared to the old one
All tests in status-go repo
- fully qualified name:
vac:qa:waku:status-go-functional-testing-2024q4:all-tests-in-status-go-repo - owner: fbarbu15
- status: not started
- start-date: 2024/10/21
- end-date: 2024/11/11
Description
Move all the tests we developed into the status-go repo since Status QA has started a similar effort using Python.
Deliverables
- PR with the migrated tests
- CI runs within the new repo
Message tests
- fully qualified name:
vac:qa:waku:status-go-functional-testing-2024q4:message-tests - owner: fbarbu15
- status: not started
- start-date: 2024/11/11
- end-date: 2024/11/25
Description
It seems that the intention is for message-related tests to be handled by the Waku/VAC team, but this is still to be confirmed, so this task may change.
Deliverables
- PR with the new tests