external-program | CL Test Grid

	quicklisp 2013-04-20	quicklisp 2013-03-12
(test-case external-program-tests.empty-env-should-erase-all fail)	cmu-snapshot-2013-03-a__20d_unicode_-linux-x86 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	cmu-snapshot-2013-03-a__20d_unicode_-linux-x86 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86
(test-case external-program-tests.environment-vars-should-override-existing fail)	abcl-1.0.1-svn-13750-13751-fasl38-macosx-java abcl-1.1.1-fasl39-linux-x86 acl-9.0a-win-x86 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x86 cmu-snapshot-2013-03-a__20d_unicode_-linux-x86 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	abcl-1.0.1-svn-13750-13751-fasl38-macosx-java abcl-1.0.1-svn-13750-13751-fasl38-macosx-java abcl-1.1.1-fasl39-linux-x86 acl-9.0a-win-x86 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x86 cmu-snapshot-2013-03-a__20d_unicode_-linux-x86 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86
(test-case external-program-tests.should-allow-spaces-in-args fail)	acl-9.0a-win-x86 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	acl-9.0a-win-x86 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86
(test-case external-program-tests.should-be-able-to-use-numbers-as-args fail)	acl-9.0a-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	acl-9.0a-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86
(test-case external-program-tests.should-be-able-to-use-pathname-as-program fail)	acl-9.0a-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	acl-9.0a-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86
(test-case external-program-tests.should-be-able-to-use-pathnames-as-args fail)	acl-9.0a-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	acl-9.0a-win-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86
(test-case external-program-tests.should-discover-programs-in-path fail)	acl-9.0a-win-x86 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	acl-9.0a-win-x86 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86
(test-case external-program-tests.should-have-access-to-shell-builtins fail)	acl-9.0a-win-x86 ccl-1.8-f95-linux-x86 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x86 ccl-1.8-f95-win-x86 ccl-1.9-f95-linux-x64 ccl-1.9-f95-linux-x86 ccl-1.9-f96-linux-x86 clisp-2.49-unix-x64 clisp-2.49-unix-x86 cmu-snapshot-2013-03-a__20d_unicode_-linux-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c ecl-12.12.1-unknown-linux-x86-bytecode ecl-12.12.1-unknown-linux-x86-lisp-to-c sbcl-1.0.57.0.debian-linux-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86 sbcl-1.1.1-linux-x86 sbcl-1.1.3-linux-x86	acl-9.0a-win-x86 ccl-1.8-f95-linux-x86 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x64 ccl-1.8-f95-win-x86 ccl-1.8-f95-win-x86 ccl-1.9-f95-linux-x64 ccl-1.9-f95-linux-x86 ccl-1.9-f96-linux-x86 clisp-2.49-unix-x64 clisp-2.49-unix-x86 cmu-snapshot-2013-03-a__20d_unicode_-linux-x86 ecl-12.12.1-ab933fa5-win-x86-bytecode ecl-12.12.1-ab933fa5-win-x86-lisp-to-c ecl-12.12.1-unknown-linux-x86-bytecode ecl-12.12.1-unknown-linux-x86-lisp-to-c sbcl-1.0.57.0.debian-linux-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64 sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86 sbcl-1.1.1-linux-x86 sbcl-1.1.5-linux-x86 sbcl-1.1.6-linux-x86

external-program results collected by cl-test-grid

Results on the last two Quicklisp distributions

Breakdown by testcases: for every failed testcase the lisp implmentations it fails on

	quicklisp 2013-04-20	quicklisp 2013-03-12
abcl-1.0.1-svn-13750-13751-fasl38-macosx-java	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL)
abcl-1.1.1-fasl39-linux-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL)
acl-9.0a-win-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-discover-programs-in-path FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-discover-programs-in-path FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ccl-1.8-f95-linux-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ccl-1.8-f95-macosx-x64		(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
ccl-1.8-f95-macosx-x86		(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
ccl-1.8-f95-win-x64	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ccl-1.8-f95-win-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ccl-1.9-f95-linux-x64	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ccl-1.9-f95-linux-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ccl-1.9-f96-linux-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ccl-1.9-f96-macosx-x64	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
ccl-1.9-f96-macosx-x86	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
clisp-2.49-unix-i386		(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
clisp-2.49-unix-x64	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
clisp-2.49-unix-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
clisp-2.49-unix-x86_64	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
clisp-2.49-win-x86	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
cmu-snapshot-2013-03-a__20d_unicode_-linux-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.empty-env-should-erase-all FAIL) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.empty-env-should-erase-all FAIL) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ecl-12.12.1-256126ac-macosx-x86-bytecode	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
ecl-12.12.1-256126ac-macosx-x86-lisp-to-c	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
ecl-12.12.1-ab933fa5-win-x86-bytecode	(LOAD external-program OK) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ecl-12.12.1-ab933fa5-win-x86-lisp-to-c	(LOAD external-program OK) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ecl-12.12.1-unknown-linux-x86-bytecode	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
ecl-12.12.1-unknown-linux-x86-lisp-to-c	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
sbcl-1.0.57.0.debian-linux-x64	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
sbcl-1.1.0.36.mswinmt.1201-284e340-win-x64	(LOAD external-program OK) (TEST-CASE external-program-tests.empty-env-should-erase-all FAIL) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-discover-programs-in-path FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.empty-env-should-erase-all FAIL) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-discover-programs-in-path FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
sbcl-1.1.0.36.mswinmt.1201-284e340-win-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.empty-env-should-erase-all FAIL) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-discover-programs-in-path FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.empty-env-should-erase-all FAIL) (TEST-CASE external-program-tests.environment-vars-should-override-existing FAIL) (TEST-CASE external-program-tests.should-allow-spaces-in-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-numbers-as-args FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathname-as-program FAIL) (TEST-CASE external-program-tests.should-be-able-to-use-pathnames-as-args FAIL) (TEST-CASE external-program-tests.should-discover-programs-in-path FAIL) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
sbcl-1.1.1-linux-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
sbcl-1.1.2.0-0df8914-macosx-x64	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)	(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
sbcl-1.1.3-linux-x86	(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
sbcl-1.1.5-linux-x86		(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)
sbcl-1.1.5.0-8f78db1-macosx-x64		(LOAD external-program OK) (WHOLE-TEST-SUITE OK)
sbcl-1.1.6-linux-x86		(LOAD external-program OK) (TEST-CASE external-program-tests.should-have-access-to-shell-builtins FAIL)