Regression Tests Failure using "ctest" #887
Labels
state: help needed
the issue needs help to proceed
state: stale
the issue has not been updated in a while and will be closed automatically soon unless it is updated
Comments
|
Could you try to use the last 3.0.0 release? If the tests are still failing, could you run ctest with the |
nlohmann
added
the
state: needs more info
|
I downloaded the "json-release-3.0.0.tar.gz" and installed it and built it with the following instructions: $ mkdir build Here is the output of the test with the "--output-on-failure" flag below. Best regards, |
|
This is really strange, because we have a similar compiler running the tests successfully on Travis:
It seems that for some reason, your configuration decides to create a different representation for doubles. This is not critical, but strange. I hope this is fixed with #777 and #360. |
nlohmann
added
state: help needed
|
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
stale
bot
added
the
state: stale
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Bug Report
After using the build process to create the tests (documented at bottom of README.md file), all of the tests run by "ctest" are built and run successfully, except for two regression tests. The "ctest" application produced the following results:
-- The CXX compiler identification is GNU 6.2.0
-- Check for working CXX compiler: /usr/bin/c++
-- Check for working CXX compiler: /usr/bin/c++ -- works
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Configuring done
-- Generating done
-- Build files have been written to: /usr/local/src/json-develop/build
Scanning dependencies of target catch_main
[ 1%] Building CXX object test/CMakeFiles/catch_main.dir/src/unit.cpp.o
[ 1%] Built target catch_main
Scanning dependencies of target test-unicode
[ 2%] Building CXX object test/CMakeFiles/test-unicode.dir/src/unit-unicode.cpp.o
[ 4%] Linking CXX executable test-unicode
[ 4%] Built target test-unicode
Scanning dependencies of target test-reference_access
[ 5%] Building CXX object test/CMakeFiles/test-reference_access.dir/src/unit-reference_access.cpp.o
[ 7%] Linking CXX executable test-reference_access
[ 7%] Built target test-reference_access
Scanning dependencies of target test-msgpack
[ 8%] Building CXX object test/CMakeFiles/test-msgpack.dir/src/unit-msgpack.cpp.o
[ 9%] Linking CXX executable test-msgpack
[ 9%] Built target test-msgpack
Scanning dependencies of target test-modifiers
[ 11%] Building CXX object test/CMakeFiles/test-modifiers.dir/src/unit-modifiers.cpp.o
[ 12%] Linking CXX executable test-modifiers
[ 12%] Built target test-modifiers
Scanning dependencies of target test-meta
[ 14%] Building CXX object test/CMakeFiles/test-meta.dir/src/unit-meta.cpp.o
[ 15%] Linking CXX executable test-meta
[ 15%] Built target test-meta
Scanning dependencies of target test-json_pointer
[ 16%] Building CXX object test/CMakeFiles/test-json_pointer.dir/src/unit-json_pointer.cpp.o
[ 18%] Linking CXX executable test-json_pointer
[ 18%] Built target test-json_pointer
Scanning dependencies of target test-class_parser
[ 19%] Building CXX object test/CMakeFiles/test-class_parser.dir/src/unit-class_parser.cpp.o
[ 21%] Linking CXX executable test-class_parser
[ 21%] Built target test-class_parser
Scanning dependencies of target test-regression
[ 22%] Building CXX object test/CMakeFiles/test-regression.dir/src/unit-regression.cpp.o
[ 23%] Linking CXX executable test-regression
[ 23%] Built target test-regression
Scanning dependencies of target test-class_lexer
[ 25%] Building CXX object test/CMakeFiles/test-class_lexer.dir/src/unit-class_lexer.cpp.o
[ 26%] Linking CXX executable test-class_lexer
[ 26%] Built target test-class_lexer
Scanning dependencies of target test-cbor
[ 28%] Building CXX object test/CMakeFiles/test-cbor.dir/src/unit-cbor.cpp.o
[ 29%] Linking CXX executable test-cbor
[ 29%] Built target test-cbor
Scanning dependencies of target test-udt
[ 30%] Building CXX object test/CMakeFiles/test-udt.dir/src/unit-udt.cpp.o
[ 32%] Linking CXX executable test-udt
[ 32%] Built target test-udt
Scanning dependencies of target test-algorithms
[ 33%] Building CXX object test/CMakeFiles/test-algorithms.dir/src/unit-algorithms.cpp.o
[ 35%] Linking CXX executable test-algorithms
[ 35%] Built target test-algorithms
Scanning dependencies of target test-comparison
[ 36%] Building CXX object test/CMakeFiles/test-comparison.dir/src/unit-comparison.cpp.o
[ 38%] Linking CXX executable test-comparison
[ 38%] Built target test-comparison
Scanning dependencies of target test-class_const_iterator
[ 39%] Building CXX object test/CMakeFiles/test-class_const_iterator.dir/src/unit-class_const_iterator.cpp.o
[ 40%] Linking CXX executable test-class_const_iterator
[ 40%] Built target test-class_const_iterator
Scanning dependencies of target test-element_access1
[ 42%] Building CXX object test/CMakeFiles/test-element_access1.dir/src/unit-element_access1.cpp.o
[ 43%] Linking CXX executable test-element_access1
[ 43%] Built target test-element_access1
Scanning dependencies of target test-iterator_wrapper
[ 45%] Building CXX object test/CMakeFiles/test-iterator_wrapper.dir/src/unit-iterator_wrapper.cpp.o
[ 46%] Linking CXX executable test-iterator_wrapper
[ 46%] Built target test-iterator_wrapper
Scanning dependencies of target test-noexcept
[ 47%] Building CXX object test/CMakeFiles/test-noexcept.dir/src/unit-noexcept.cpp.o
[ 49%] Linking CXX executable test-noexcept
[ 49%] Built target test-noexcept
Scanning dependencies of target test-allocator
[ 50%] Building CXX object test/CMakeFiles/test-allocator.dir/src/unit-allocator.cpp.o
[ 52%] Linking CXX executable test-allocator
[ 52%] Built target test-allocator
Scanning dependencies of target test-capacity
[ 53%] Building CXX object test/CMakeFiles/test-capacity.dir/src/unit-capacity.cpp.o
[ 54%] Linking CXX executable test-capacity
[ 54%] Built target test-capacity
Scanning dependencies of target test-class_iterator
[ 56%] Building CXX object test/CMakeFiles/test-class_iterator.dir/src/unit-class_iterator.cpp.o
[ 57%] Linking CXX executable test-class_iterator
[ 57%] Built target test-class_iterator
Scanning dependencies of target test-convenience
[ 59%] Building CXX object test/CMakeFiles/test-convenience.dir/src/unit-convenience.cpp.o
[ 60%] Linking CXX executable test-convenience
[ 60%] Built target test-convenience
Scanning dependencies of target test-concepts
[ 61%] Building CXX object test/CMakeFiles/test-concepts.dir/src/unit-concepts.cpp.o
[ 63%] Linking CXX executable test-concepts
[ 63%] Built target test-concepts
Scanning dependencies of target test-readme
[ 64%] Building CXX object test/CMakeFiles/test-readme.dir/src/unit-readme.cpp.o
[ 66%] Linking CXX executable test-readme
[ 66%] Built target test-readme
Scanning dependencies of target test-constructor1
[ 67%] Building CXX object test/CMakeFiles/test-constructor1.dir/src/unit-constructor1.cpp.o
[ 69%] Linking CXX executable test-constructor1
[ 69%] Built target test-constructor1
Scanning dependencies of target test-pointer_access
[ 70%] Building CXX object test/CMakeFiles/test-pointer_access.dir/src/unit-pointer_access.cpp.o
[ 71%] Linking CXX executable test-pointer_access
[ 71%] Built target test-pointer_access
Scanning dependencies of target test-deserialization
[ 73%] Building CXX object test/CMakeFiles/test-deserialization.dir/src/unit-deserialization.cpp.o
/usr/local/src/json-develop/test/src/unit-deserialization.cpp: In function ‘void ____C_A_T_C_H____T_E_S_T____0()’:
/usr/local/src/json-develop/test/src/unit-deserialization.cpp:72:18: warning: ‘std::istream& nlohmann::operator<<(nlohmann::basic_json<>&, std::istream&)’ is deprecated [-Wdeprecated-declarations]
j << ss;
^~
In file included from /usr/local/src/json-develop/test/src/unit-deserialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:13119:26: note: declared here
friend std::istream& operator<<(basic_json& j, std::istream& i)
^~~~~~~~
In file included from /usr/local/src/json-develop/test/src/unit-deserialization.cpp:29:0:
/usr/local/src/json-develop/test/src/unit-deserialization.cpp:129:34: warning: ‘std::istream& nlohmann::operator<<(nlohmann::basic_json<>&, std::istream&)’ is deprecated [-Wdeprecated-declarations]
CHECK_THROWS_AS(j << ss1, json::parse_error&);
^
In file included from /usr/local/src/json-develop/test/src/unit-deserialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:13119:26: note: declared here
friend std::istream& operator<<(basic_json& j, std::istream& i)
^~~~~~~~
In file included from /usr/local/src/json-develop/test/src/unit-deserialization.cpp:29:0:
/usr/local/src/json-develop/test/src/unit-deserialization.cpp:130:36: warning: ‘std::istream& nlohmann::operator<<(nlohmann::basic_json<>&, std::istream&)’ is deprecated [-Wdeprecated-declarations]
CHECK_THROWS_WITH(j << ss2,
^
In file included from /usr/local/src/json-develop/test/src/unit-deserialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:13119:26: note: declared here
friend std::istream& operator<<(basic_json& j, std::istream& i)
^~~~~~~~
/usr/local/src/json-develop/test/src/unit-deserialization.cpp:532:18: warning: ‘std::istream& nlohmann::operator<<(nlohmann::basic_json<>&, std::istream&)’ is deprecated [-Wdeprecated-declarations]
j << s;
^
In file included from /usr/local/src/json-develop/test/src/unit-deserialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:13119:26: note: declared here
friend std::istream& operator<<(basic_json& j, std::istream& i)
^~~~~~~~
/usr/local/src/json-develop/test/src/unit-deserialization.cpp:534:18: warning: ‘std::istream& nlohmann::operator<<(nlohmann::basic_json<>&, std::istream&)’ is deprecated [-Wdeprecated-declarations]
j << s;
^
In file included from /usr/local/src/json-develop/test/src/unit-deserialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:13119:26: note: declared here
friend std::istream& operator<<(basic_json& j, std::istream& i)
^~~~~~~~
[ 74%] Linking CXX executable test-deserialization
[ 74%] Built target test-deserialization
Scanning dependencies of target test-testsuites
[ 76%] Building CXX object test/CMakeFiles/test-testsuites.dir/src/unit-testsuites.cpp.o
[ 77%] Linking CXX executable test-testsuites
[ 77%] Built target test-testsuites
Scanning dependencies of target test-conversions
[ 78%] Building CXX object test/CMakeFiles/test-conversions.dir/src/unit-conversions.cpp.o
[ 80%] Linking CXX executable test-conversions
[ 80%] Built target test-conversions
Scanning dependencies of target test-element_access2
[ 81%] Building CXX object test/CMakeFiles/test-element_access2.dir/src/unit-element_access2.cpp.o
[ 83%] Linking CXX executable test-element_access2
[ 83%] Built target test-element_access2
Scanning dependencies of target test-inspection
[ 84%] Building CXX object test/CMakeFiles/test-inspection.dir/src/unit-inspection.cpp.o
[ 85%] Linking CXX executable test-inspection
[ 85%] Built target test-inspection
Scanning dependencies of target test-json_patch
[ 87%] Building CXX object test/CMakeFiles/test-json_patch.dir/src/unit-json_patch.cpp.o
[ 88%] Linking CXX executable test-json_patch
[ 88%] Built target test-json_patch
Scanning dependencies of target test-iterators1
[ 90%] Building CXX object test/CMakeFiles/test-iterators1.dir/src/unit-iterators1.cpp.o
[ 91%] Linking CXX executable test-iterators1
[ 91%] Built target test-iterators1
Scanning dependencies of target test-serialization
[ 92%] Building CXX object test/CMakeFiles/test-serialization.dir/src/unit-serialization.cpp.o
/usr/local/src/json-develop/test/src/unit-serialization.cpp: In function ‘void ____C_A_T_C_H____T_E_S_T____0()’:
/usr/local/src/json-develop/test/src/unit-serialization.cpp:71:18: warning: ‘std::ostream& nlohmann::operator>>(const nlohmann::basic_json<>&, std::ostream&)’ is deprecated [-Wdeprecated-declarations]
j >> ss;
^~
In file included from /usr/local/src/json-develop/test/src/unit-serialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:12933:26: note: declared here
friend std::ostream& operator>>(const basic_json& j, std::ostream& o)
^~~~~~~~
/usr/local/src/json-develop/test/src/unit-serialization.cpp:80:18: warning: ‘std::ostream& nlohmann::operator>>(const nlohmann::basic_json<>&, std::ostream&)’ is deprecated [-Wdeprecated-declarations]
j >> ss;
^~
In file included from /usr/local/src/json-develop/test/src/unit-serialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:12933:26: note: declared here
friend std::ostream& operator>>(const basic_json& j, std::ostream& o)
^~~~~~~~
/usr/local/src/json-develop/test/src/unit-serialization.cpp:91:18: warning: ‘std::ostream& nlohmann::operator>>(const nlohmann::basic_json<>&, std::ostream&)’ is deprecated [-Wdeprecated-declarations]
j >> ss;
^~
In file included from /usr/local/src/json-develop/test/src/unit-serialization.cpp:31:0:
/usr/local/src/json-develop/src/json.hpp:12933:26: note: declared here
friend std::ostream& operator>>(const basic_json& j, std::ostream& o)
^~~~~~~~
[ 94%] Linking CXX executable test-serialization
[ 94%] Built target test-serialization
Scanning dependencies of target test-constructor2
[ 95%] Building CXX object test/CMakeFiles/test-constructor2.dir/src/unit-constructor2.cpp.o
[ 97%] Linking CXX executable test-constructor2
[ 97%] Built target test-constructor2
Scanning dependencies of target test-iterators2
[ 98%] Building CXX object test/CMakeFiles/test-iterators2.dir/src/unit-iterators2.cpp.o
[100%] Linking CXX executable test-iterators2
[100%] Built target test-iterators2
Test project /usr/local/src/json-develop/build
Start 1: test-algorithms_default
1/70 Test #1: test-algorithms_default ............. Passed 0.01 sec
Start 2: test-algorithms_all
2/70 Test #2: test-algorithms_all ................. Passed 0.01 sec
Start 3: test-allocator_default
3/70 Test #3: test-allocator_default .............. Passed 0.00 sec
Start 4: test-allocator_all
4/70 Test #4: test-allocator_all .................. Passed 0.00 sec
Start 5: test-capacity_default
5/70 Test #5: test-capacity_default ............... Passed 0.01 sec
Start 6: test-capacity_all
6/70 Test #6: test-capacity_all ................... Passed 0.01 sec
Start 7: test-cbor_default
7/70 Test #7: test-cbor_default ................... Passed 3.87 sec
Start 8: test-cbor_all
8/70 Test #8: test-cbor_all ....................... Passed 47.03 sec
Start 9: test-class_const_iterator_default
9/70 Test #9: test-class_const_iterator_default ... Passed 0.01 sec
Start 10: test-class_const_iterator_all
10/70 Test #10: test-class_const_iterator_all ....... Passed 0.01 sec
Start 11: test-class_iterator_default
11/70 Test #11: test-class_iterator_default ......... Passed 0.01 sec
Start 12: test-class_iterator_all
12/70 Test #12: test-class_iterator_all ............. Passed 0.01 sec
Start 13: test-class_lexer_default
13/70 Test #13: test-class_lexer_default ............ Passed 0.01 sec
Start 14: test-class_lexer_all
14/70 Test #14: test-class_lexer_all ................ Passed 0.00 sec
Start 15: test-class_parser_default
15/70 Test #15: test-class_parser_default ........... Passed 0.17 sec
Start 16: test-class_parser_all
16/70 Test #16: test-class_parser_all ............... Passed 0.17 sec
Start 17: test-comparison_default
17/70 Test #17: test-comparison_default ............. Passed 0.02 sec
Start 18: test-comparison_all
18/70 Test #18: test-comparison_all ................. Passed 0.02 sec
Start 19: test-concepts_default
19/70 Test #19: test-concepts_default ............... Passed 0.00 sec
Start 20: test-concepts_all
20/70 Test #20: test-concepts_all ................... Passed 0.00 sec
Start 21: test-constructor1_default
21/70 Test #21: test-constructor1_default ........... Passed 0.05 sec
Start 22: test-constructor1_all
22/70 Test #22: test-constructor1_all ............... Passed 0.04 sec
Start 23: test-constructor2_default
23/70 Test #23: test-constructor2_default ........... Passed 0.00 sec
Start 24: test-constructor2_all
24/70 Test #24: test-constructor2_all ............... Passed 0.01 sec
Start 25: test-convenience_default
25/70 Test #25: test-convenience_default ............ Passed 0.00 sec
Start 26: test-convenience_all
26/70 Test #26: test-convenience_all ................ Passed 0.00 sec
Start 27: test-conversions_default
27/70 Test #27: test-conversions_default ............ Passed 0.03 sec
Start 28: test-conversions_all
28/70 Test #28: test-conversions_all ................ Passed 0.03 sec
Start 29: test-deserialization_default
29/70 Test #29: test-deserialization_default ........ Passed 0.01 sec
Start 30: test-deserialization_all
30/70 Test #30: test-deserialization_all ............ Passed 0.02 sec
Start 31: test-element_access1_default
31/70 Test #31: test-element_access1_default ........ Passed 0.02 sec
Start 32: test-element_access1_all
32/70 Test #32: test-element_access1_all ............ Passed 0.02 sec
Start 33: test-element_access2_default
33/70 Test #33: test-element_access2_default ........ Passed 0.02 sec
Start 34: test-element_access2_all
34/70 Test #34: test-element_access2_all ............ Passed 0.03 sec
Start 35: test-inspection_default
35/70 Test #35: test-inspection_default ............. Passed 8.58 sec
Start 36: test-inspection_all
36/70 Test #36: test-inspection_all ................. Passed 8.51 sec
Start 37: test-iterator_wrapper_default
37/70 Test #37: test-iterator_wrapper_default ....... Passed 0.01 sec
Start 38: test-iterator_wrapper_all
38/70 Test #38: test-iterator_wrapper_all ........... Passed 0.01 sec
Start 39: test-iterators1_default
39/70 Test #39: test-iterators1_default ............. Passed 0.03 sec
Start 40: test-iterators1_all
40/70 Test #40: test-iterators1_all ................. Passed 0.02 sec
Start 41: test-iterators2_default
41/70 Test #41: test-iterators2_default ............. Passed 0.07 sec
Start 42: test-iterators2_all
42/70 Test #42: test-iterators2_all ................. Passed 0.07 sec
Start 43: test-json_patch_default
43/70 Test #43: test-json_patch_default ............. Passed 0.02 sec
Start 44: test-json_patch_all
44/70 Test #44: test-json_patch_all ................. Passed 0.02 sec
Start 45: test-json_pointer_default
45/70 Test #45: test-json_pointer_default ........... Passed 0.01 sec
Start 46: test-json_pointer_all
46/70 Test #46: test-json_pointer_all ............... Passed 0.01 sec
Start 47: test-meta_default
47/70 Test #47: test-meta_default ................... Passed 0.00 sec
Start 48: test-meta_all
48/70 Test #48: test-meta_all ....................... Passed 0.00 sec
Start 49: test-modifiers_default
49/70 Test #49: test-modifiers_default .............. Passed 0.02 sec
Start 50: test-modifiers_all
50/70 Test #50: test-modifiers_all .................. Passed 0.02 sec
Start 51: test-msgpack_default
51/70 Test #51: test-msgpack_default ................ Passed 3.60 sec
Start 52: test-msgpack_all
52/70 Test #52: test-msgpack_all .................... Passed 46.60 sec
Start 53: test-noexcept_default
53/70 Test #53: test-noexcept_default ............... Passed 0.00 sec
Start 54: test-noexcept_all
54/70 Test #54: test-noexcept_all ................... Passed 0.00 sec
Start 55: test-pointer_access_default
55/70 Test #55: test-pointer_access_default ......... Passed 0.01 sec
Start 56: test-pointer_access_all
56/70 Test #56: test-pointer_access_all ............. Passed 0.01 sec
Start 57: test-readme_default
57/70 Test #57: test-readme_default ................. Passed 0.00 sec
Start 58: test-readme_all
58/70 Test #58: test-readme_all ..................... Passed 0.01 sec
Start 59: test-reference_access_default
59/70 Test #59: test-reference_access_default ....... Passed 0.01 sec
Start 60: test-reference_access_all
60/70 Test #60: test-reference_access_all ........... Passed 0.01 sec
Start 61: test-regression_default
61/70 Test #61: test-regression_default .............***Failed 8.60 sec
Start 62: test-regression_all
62/70 Test #62: test-regression_all .................***Failed 8.48 sec
Start 63: test-serialization_default
63/70 Test #63: test-serialization_default .......... Passed 0.00 sec
Start 64: test-serialization_all
64/70 Test #64: test-serialization_all .............. Passed 0.00 sec
Start 65: test-testsuites_default
65/70 Test #65: test-testsuites_default ............. Passed 0.17 sec
Start 66: test-testsuites_all
66/70 Test #66: test-testsuites_all ................. Passed 0.10 sec
Start 67: test-udt_default
67/70 Test #67: test-udt_default .................... Passed 0.01 sec
Start 68: test-udt_all
68/70 Test #68: test-udt_all ........................ Passed 0.01 sec
Start 69: test-unicode_default
69/70 Test #69: test-unicode_default ................ Passed 0.00 sec
Start 70: test-unicode_all
70/70 Test #70: test-unicode_all .................... Passed 396.11 sec
97% tests passed, 2 tests failed out of 70
Label Time Summary:
all = 507.38 secproc (35 tests)
default = 25.40 secproc (35 tests)
Total Test time (real) = 532.83 sec
The following tests FAILED:
61 - test-regression_default (Failed)
62 - test-regression_all (Failed)
Errors while running CTest
$ mkdir build
$ cd build
$ cmake ..
$ cmake --build .
$ ctest
That all tests would return success.
All but the two regression tests passed.
$ g++ --version
g++ (GCC) 6.2.0
Copyright (C) 2016 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
$ uname -a
Linux maczorin6 3.13.0-107-generic #154~precise1-Ubuntu SMP Tue Dec 20 10:36:28 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
developbranch?I downloaded a ZIP file from the GitHub site called "json-develop.zip".
Yes.
The text was updated successfully, but these errors were encountered: