openssl/test/recipes
Matt Caswell 8c6c5077b2 Add a test to call the BoringSSL test suite
This adds a test to the OpenSSL test suite to invoke the BoringSSL test
suite.

It assumes you have already compiled the ossl_shim (see previous commit).
It also assumes that you have an environment variable BORING_RUNNER_DIR
set up to point to the ssl/test/runner directory of a checkout of BoringSSL.

This has only been tested with a very old version of BoringSSL (from commit
f277add6c) - since that was the last known checkout where the shim compiles
successfully. Even with that version of BoringSSL this test will fail. There
are lots of Boring tests that are failing for various reasons. Some might
be due to bugs in OpenSSL, some might be due to features that BoringSSL has
that OpenSSL doesn't, some are due to assumptions about the way BoringSSL
behaves that are not true for OpenSSL etc.

To get the verbose BoringSSL test output, run like this:

VERBOSE=1 BORING_RUNNER_DIR=/path/to/boring/ssl/test/runner make \
TESTS="test_external" test

Reviewed-by: Richard Levitte <levitte@openssl.org>
2016-11-04 10:38:54 +00:00
..
01-test_abort.t tests: Shut the shell up unless verbose 2016-06-06 10:03:01 +02:00
01-test_sanity.t Platform sanity test 2016-07-08 15:56:55 -04:00
01-test_symbol_presence.t Correct detection of group end in map file when testing symbol presence 2016-09-06 00:48:13 +02:00
02-test_ordinals.t Platform sanity test 2016-07-08 15:56:55 -04:00
03-test_internal.t Finally, add a test recipe for the internal tests 2016-11-03 13:15:40 +01:00
05-test_bf.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_cast.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_des.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_hmac.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_idea.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_md2.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_md4.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_md5.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_mdc2.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_rand.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_rc2.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_rc4.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_rc5.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_rmd.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_sha1.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_sha256.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_sha512.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
05-test_wp.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
10-test_bn.t Have some more test recipes clean up after themselves 2016-06-04 09:43:26 +02:00
10-test_exp.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
15-test_dh.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
15-test_dsa.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
15-test_ec.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
15-test_ecdh.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
15-test_ecdsa.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
15-test_rsa.t RT2676: Reject RSA eponent if even or 1 2016-08-22 11:25:12 -04:00
20-test_enc.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
20-test_passwd.t Don't use DES when disabled. 2016-10-02 11:19:29 +01:00
25-test_crl.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
25-test_d2i.t spelling fixes, just comments and readme. 2016-08-05 19:07:30 -04:00
25-test_pkcs7.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
25-test_req.t Make 25-test_gen.t and 25-test_req.t into one 2016-06-04 09:43:26 +02:00
25-test_sid.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
25-test_verify.t Extend mkcert.sh to support nameConstraints generation and more complex 2016-07-11 23:30:04 +01:00
25-test_x509.t Add some accessor API's 2016-06-08 11:37:06 -04:00
30-test_afalg.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
30-test_engine.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
30-test_evp.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
30-test_evp_extra.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
30-test_pbelu.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
40-test_rehash.t perl: use the 'if' module to conditionally load File::Glob 2016-05-30 11:55:46 +02:00
70-test_asyncio.t Test recipes: remove duplicate OpenSSL::Test usage 2016-11-02 18:14:04 +01:00
70-test_bad_dtls.t Add basic test for Cisco DTLS1_BAD_VER and record replay handling 2016-08-04 20:56:24 +01:00
70-test_clienthello.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
70-test_packet.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
70-test_sslcbcpadding.t Enable TLSProxy to talk TLS1.3 2016-11-02 13:28:21 +00:00
70-test_sslcertstatus.t Skip the TLSProxy tests if environmental problems are an issue 2016-06-16 16:32:14 +01:00
70-test_sslextension.t Skip the TLSProxy tests if environmental problems are an issue 2016-06-16 16:32:14 +01:00
70-test_sslrecords.t Add a test for unrecognised record types 2016-11-02 23:22:48 +00:00
70-test_sslsessiontick.t Skip the TLSProxy tests if environmental problems are an issue 2016-06-16 16:32:14 +01:00
70-test_sslskewith0p.t Skip the TLSProxy tests if environmental problems are an issue 2016-06-16 16:32:14 +01:00
70-test_sslvertol.t Skip the TLSProxy tests if environmental problems are an issue 2016-06-16 16:32:14 +01:00
70-test_tlsextms.t Skip the TLSProxy tests if environmental problems are an issue 2016-06-16 16:32:14 +01:00
70-test_verify_extra.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
70-test_wpacket.t Add tests for the WPACKET implementation 2016-09-13 09:41:21 +01:00
80-test_ca.t Fix copy-paste test labels 2016-10-13 13:40:19 +02:00
80-test_cipherlist.t Add final(?) set of copyrights. 2016-06-01 11:27:25 -04:00
80-test_cms.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
80-test_ct.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
80-test_dane.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
80-test_dtls.t Test recipes: remove duplicate OpenSSL::Test usage 2016-11-02 18:14:04 +01:00
80-test_dtls_mtu.t Add test cases for DTLS_get_data_mtu() 2016-11-02 14:00:11 +00:00
80-test_dtlsv1listen.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
80-test_ocsp.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
80-test_pkcs12.t Windows: UTF-8 opt-in for command-line arguments and console input. 2016-08-25 11:56:28 +01:00
80-test_ssl_new.t Update Configure to know about tls1_3 2016-11-02 13:08:21 +00:00
80-test_ssl_old.t Add the SSL_METHOD for TLSv1.3 and all other base changes required 2016-11-02 13:08:21 +00:00
80-test_ssl_test_ctx.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
80-test_tsa.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
80-test_x509aux.t Fix i2d_X509_AUX, update docs and add tests 2016-05-11 01:46:06 -04:00
90-test_async.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_bio_enc.t Add test/bio_enc_test.c. 2016-08-21 23:34:26 +02:00
90-test_bioprint.t Add a test for printing floating point format specifiers 2016-05-27 10:25:31 +01:00
90-test_constant_time.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_external.t Add a test to call the BoringSSL test suite 2016-11-04 10:38:54 +00:00
90-test_fuzz.t Move 05-test_fuzz.t to 90-test_fuzz.t 2016-09-01 21:05:34 +02:00
90-test_gmdiff.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_heartbeat.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_ige.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_memleak.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_overhead.t Add unit test for ssl_cipher_get_overhead() 2016-11-02 14:00:11 +00:00
90-test_p5_crpt2.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_secmem.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_shlibload.t Don't assume to know the shared library extension 2016-11-04 00:19:14 +01:00
90-test_srp.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_sslapi.t Test recipes: remove duplicate OpenSSL::Test usage 2016-11-02 18:14:04 +01:00
90-test_threads.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
90-test_v3name.t Unified copyright for test recipes 2016-04-22 07:58:47 -04:00
bc.pl Copyright consolidation: perl files 2016-04-20 09:45:40 -04:00
tconversion.pl Remove trailing whitespace from some files. 2016-10-10 23:36:21 +01:00