Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(WIP) Add tck tests #1

Merged
merged 26 commits into from
Mar 19, 2020
Merged

(WIP) Add tck tests #1

merged 26 commits into from
Mar 19, 2020

Conversation

jstoiko
Copy link
Contributor

@jstoiko jstoiko commented Jan 22, 2020

Use make (on MacOS, upgrade to gmake: brew install gmake) to run the tests and generate a HTML report:

$ cd runner/ && make

After adding, moving or deleting TCK test files, the manifest needs to be regenerated for the tests to be visible in the report:

$ npm run gen-manifest

Parsers currently being tested are amf-client-js and asyncapi-parser.


After PR is merged:

  • replace all mentions of add_tck_tests branch with master

AsyncAPI Object
AsyncAPI Version String
Contact Object
Identifier
Info Object
License Object
Servers Object
Server Object
Server Variable Object
Channels Object
Channel Item Object
Operation Object
Operation Trait Object
Channel Bindings Object
Message Bindings Object
Operation Bindings Object
Parameter Object
Parameters Object
Server Bindings Object
Message Object
External Documentation Object
Message Trait Object
Tag Object
Correlation ID Object
Security Requirement Object
Security Scheme Object
Specification Extensions
@jstoiko jstoiko requested a review from fmvilas January 22, 2020 19:13
Copy link
Member

@fmvilas fmvilas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great stuff, @jstoiko 👏

I left some comments. In many cases, test files are too large containing irrelevant information for the test that could be avoided. It's been the reason for many of the mistakes. We should aim for the minimum needed to test that a specific thing is failing. What do you think?

Also, I'd not add more tests to this PR. Let's fix the existing ones and merge the PR. We can then iterate in smaller chunks 😅

@postatum postatum requested a review from fmvilas March 4, 2020 08:57
@postatum
Copy link
Contributor

postatum commented Mar 4, 2020

@fmvilas thanks for the review!

I've fixed most of issues you reported and left responses to some of your comments.

@fmvilas fmvilas added this to the Make JS parser stable milestone Mar 13, 2020
@fmvilas fmvilas merged commit fb062a4 into master Mar 19, 2020
@fmvilas fmvilas deleted the add_tck_tests branch March 19, 2020 11:38
@fmvilas fmvilas mentioned this pull request Mar 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants