aboutsummaryrefslogtreecommitdiff
path: root/conformance/conformance_test.cc
Commit message (Collapse)AuthorAgeFilesLines
* Make conformance tests more strict about the failure list.Josh Haberman2016-06-031-15/+40
| | | | | | The failure lists were falling out of date because the tests would pass even if people forgot to remove failures from the list.
* Allow conformance test runner to tolerate crashes, and re-enable conformance ↵Josh Haberman2016-01-111-1/+7
| | | | tests.
* Fix up the conformance testsThomas Van Lenten2016-01-051-0/+11
| | | | | - Update all the new runner cases to handle a skip result as a skip and not a failure. - Make ObjC use the new serialize_error result if it fails to generate the data.
* Fix conformance test to only report skips in verbose mode.Thomas Van Lenten2016-01-051-3/+0
| | | | | | | commit e841bac4fcf47f809e089a70d5f84ac37b3883df seems to have mis-merged the change to reporting skipped tests. I didn't check if there were other merge issues.
* Make conformance tests build for C++ and Java.Feng Xiao2015-12-161-2/+1
| | | | Change-Id: Ibb3fe6f919cc7ca0df91da5e1697ba33d259e433
* Down-integrate from internal code base.Feng Xiao2015-12-111-19/+1476
|
* Conformance test implementation for Python.Josh Haberman2015-12-021-3/+5
|
* Added support for Json and valid input to conformance tests.Josh Haberman2015-07-101-19/+167
| | | | | | | | | | | | | | | | | | | | | | | | | This was enabled by the recent open-sourcing of JSON support and MessageDifferencer. MessageDifferencer allows the conformance suite to expand because it allows us to write tests for payloads that parse successfully. To verify the testee's output payload, we need to parse it back into a message and compare the message instances. Comparing output bytes vs. a golden message is *not* valid, because protobufs do not have a canonical encoding (especially in the presence of maps, which have no prescribed serialization order). We only add one small JSON test for now, but with the framework in place we now have the foundation to dramatically expand the coverage of the conformance test suite. Also added the ability for the testee to skip tests that exercise features that are unimplemented. This allows Java (which currently has no JSON support) to skip tests involving JSON. Change-Id: I697b4363da432b61ae3b638b4287c4cda1af4deb
* Removed test_name from conformance.proto.Josh Haberman2015-06-041-8/+9
| | | | Change-Id: I382dcda97fa123a6da4ff5faad5d7ece95853f33
* Conformance tests can now be excluded based on their names.Josh Haberman2015-06-031-43/+117
| | | | | | | This allows us to enable conformance tests even when we know that some tests are failing and need to be fixed. Change-Id: I372f43663008747db6f2b2cf06e6ffa4c6d85b2d
* down-integrate internal changesBo Yang2015-05-211-0/+1
|
* Factored conformance tests so they can run in-process.Josh Haberman2015-04-151-175/+90
| | | | | | This is necessary for testing on iOS. Change-Id: I54ec1e3aa2e9fbfff9a6cd6580920a6a62069b63
* Added first version of conformance tests.Josh Haberman2015-04-081-0/+395
Change-Id: Ib75664194491643f8e4f1503a2ed942a2d1e1655