Stats for satsolver: spl

How to interpret the values

Each satsolver was run against each test case. Two cnf formulas were generated from each submitted generator to form the set of generators. For each run, a number of seconds were charged to the program based on the criteria described on the assignments webpage; this was the score for that run. If the program crashed or went into a loop, 150 seconds were charged. The two cnf formulas generated by a generator is denoted by generator_name:i where i is 0 for the first cnf and 1 for the second. The table below shows the time satsolver spl took for each formula and how many clauses it left unsatisfied; the formulas are sorted by the satsolver's score on it (which is different from its runtime). For each formula , we also list the name of the best solver, the time taken by the best solver (Best time) and the number of clauses left unsatisfied by him/her (Best unsat). A blank symbol denotes that spl took more than 150 seconds for that formula or terminated with an exception. Some important stats are summarized at the start. Click on the name of a formula to view details.

Summary

Satsolver:	spl
Rank:	5 / 118
Average Score:	2.62
Median Score:	0.19
Description:	Optimized WalkSat that keeps track of the best model it has seen so far. It keeps track of which clauses a literal is in, and also keeps track of the number of unsatisfied clauses total, to avoid re-computing every iteration.

	Generator	Best solver	Time taken	Best time	Unsat	Best unsat
1	bigwig:0	Andrew Werner	0.00	0.00	0	0
2	bigwig:1	KingBach	0.00	0.00	0	0
3	Ravi Tandon:0	KingBach	0.00	0.00	0	0
4	Bebe Shi:1	KingBach	0.00	0.00	0	0
5	Happy:1	KingBach	0.00	0.00	0	0
6	Bebe Shi:0	KingBach	0.00	0.00	0	0
7	Ravi Tandon:1	KingBach	0.00	0.00	0	0
8	K.L.:1	KingBach	0.00	0.00	0	0
9	Jonathan Kwok:1	KingBach	0.01	0.00	0	0
10	BMJ:1	burrito	0.01	0.00	0	0
11	BMJ:0	Elphaba	0.01	0.00	0	0
12	K.L.:0	haoyu	0.01	0.00	0	0
13	Blam:0	Elphaba	0.01	0.00	0	0
14	R. A. B.:1	cat	0.01	0.00	0	0
15	Blam:1	Elphaba	0.01	0.00	0	0
16	Joshua Zimmer:1	haoyu	0.01	0.00	0	0
17	Joshua Zimmer:0	haoyu	0.01	0.00	0	0
18	Happy:0	haoyu	0.01	0.00	0	0
19	Miranda:1	cat	0.01	0.00	0	0
20	Daffy Duck:1	haoyu	0.01	0.00	0	0
21	Jonathan Kwok:0	Elphaba	0.01	0.00	0	0
22	haoyu:1	Anon5	0.01	0.01	0	0
23	Miranda:0	cat	0.01	0.00	0	0
24	Daffy Duck:0	Andrew Werner	0.02	0.00	0	0
25	Tree Prophet:0	haoyu	0.02	0.00	0	0
26	Tree Prophet:1	haoyu	0.02	0.00	0	0
27	Solving For Clauses:1	haoyu	0.02	0.00	0	0
28	bchouGenerator:1	Jonathan Kwok	0.02	0.01	0	0
29	David Paulk:0	cat	0.03	0.00	0	0
30	David Paulk:1	Bar Shabtai	0.03	0.00	0	0
31	bchouGenerator:0	haoyu	0.03	0.00	0	0
32	Solving For Clauses:0	Glenn Fisher	0.03	0.00	0	0
33	R. A. B.:0	Nihar the Great	0.03	0.00	0	0
34	Gewang:0	Jonathan Kwok	0.03	0.00	0	0
35	The Kraken:1	haoyu	0.03	0.00	0	0
36	Quite Satisfied:0	haoyu	0.03	0.00	0	0
37	The Kraken:0	haoyu	0.03	0.00	0	0
38	Gewang:1	Jonathan Kwok	0.03	0.00	0	0
39	haoyu:0	KingBach	0.04	0.01	0	0
40	Jordan Ash:1	Bar Shabtai	0.04	0.01	0	0
41	Jameh:0	haoyu	0.06	0.01	0	0
42	Mickey Mouse:1	haoyu	0.06	0.01	0	0
43	Mickey Mouse:0	Bar Shabtai	0.06	0.01	0	0
44	Sunny:0	Green "The Bean" Choi	0.06	0.02	0	0
45	Qinlan Shen:0	Bar Shabtai	0.06	0.01	0	0
46	0108:1	haoyu	0.07	0.01	0	0
47	weezy:0	Bar Shabtai	0.07	0.01	0	0
48	Tiny Wings:1	haoyu	0.07	0.01	0	0
49	Jameh:1	haoyu	0.07	0.01	0	0
50	weezy:1	Bar Shabtai	0.07	0.01	0	0
51	vluu:0	Nihar the Great	0.08	0.01	0	0
52	vluu:1	Nihar the Great	0.08	0.02	0	0
53	Alex Fish:0	haoyu	0.08	0.01	0	0
54	Ytterbium:0	Andrew Grasso	0.08	0.02	0	0
55	Alex Fish:1	haoyu	0.08	0.02	0	0
56	AARON BURR, DROPPIN' HAMILTONS:1	haoyu	0.08	0.01	0	0
57	cmF5a3ly:1	Nihar the Great	0.09	0.00	0	0
58	Tiny Wings:0	haoyu	0.09	0.02	0	0
59	Anon_K_P:1	Aristotle	0.09	0.03	0	0
60	Scheduling Generator 203:0	jgs	0.09	0.01	0	0
61	cat:0	haoyu	0.09	0.03	0	0
62	cmF5a3ly:0	Nihar the Great	0.09	0.00	0	0
63	Tom T:1	Andrew Werner	0.09	0.02	0	0
64	Jordan Ash:0	EC	0.09	0.03	0	0
65	totallyOnFallBreak:0	Nikhilesh Sigatapu	0.09	0.01	0	0
66	The Whitman Whale:0	bigwig	0.09	0.04	0	0
67	The Whitman Whale:1	Andrew Grasso	0.09	0.03	0	0
68	DeeEmEm:1	haoyu	0.09	0.02	0	0
69	Anon_K_P:0	haoyu	0.10	0.02	0	0
70	totallyOnFallBreak:1	Nikhilesh Sigatapu	0.10	0.01	0	0
71	Sunny:1	jabreezy	0.10	0.01	0	0
72	cat:1	haoyu	0.10	0.03	0	0
73	Boomshanka:1	Bar Shabtai	0.10	0.01	0	0
74	AARON BURR, DROPPIN' HAMILTONS:0	haoyu	0.10	0.00	0	0
75	Tao:1	Aristotle	0.10	0.07	0	0
76	Samuel Jerome:0	haoyu	0.10	0.03	0	0
77	Scheduling Generator 203:1	Jameh	0.11	0.02	0	0
78	Tao:0	Bar Shabtai	0.11	0.02	0	0
79	Lisa Kim:0	Aristotle	0.11	0.07	0	0
80	Boomshanka:0	haoyu	0.11	0.01	0	0
81	Keji Xu:0	Nihar the Great	0.11	0.03	0	0
82	Keji Xu:1	Nihar the Great	0.12	0.04	0	0
83	Janie Gu:1	Jonathan Kwok	0.12	0.07	0	0
84	Ytterbium:1	Nihar the Great	0.12	0.02	0	0
85	Janie Gu:0	Glenn Fisher	0.12	0.07	0	0
86	Samuel Jerome:1	haoyu	0.12	0.03	0	0
87	George Okeowo:0	Andrew Grasso	0.12	0.01	0	0
88	Lisa Kim:1	Bar Shabtai	0.12	0.06	0	0
89	Matt Haake:0	haoyu	0.12	0.05	0	0
90	kt4124:1	haoyu	0.12	0.04	0	0
91	kt4124:0	haoyu	0.13	0.03	0	0
92	Nikhilesh Sigatapu:0	haoyu	0.13	0.03	0	0
93	David Lackey:0	Anon5	0.13	0.03	0	0
94	Glenn Fisher:0	Elphaba	0.13	0.02	0	0
95	Matt Haake:1	haoyu	0.13	0.05	0	0
96	Tom T:0	EC	0.14	0.02	0	0
97	Nikhilesh Sigatapu:1	haoyu	0.14	0.04	0	0
98	bfang:0	haoyu	0.14	0.04	0	0
99	George Okeowo:1	Andrew Grasso	0.14	0.01	0	0
100	bfang:1	haoyu	0.14	0.04	0	0
101	Mr. Blobby:0	Green "The Bean" Choi	0.15	0.14	0	0
102	Mercury:0	haoyu	0.15	0.05	0	0
103	EC:1	haoyu	0.15	0.03	0	0
104	David Lackey:1	Bar Shabtai	0.16	0.03	0	0
105	KingBach:1	haoyu	0.16	0.04	0	0
106	Ben Chen:0	Elphaba	0.16	0.07	0	0
107	Anon5:0	haoyu	0.17	0.05	0	0
108	Khoa:0	haoyu	0.17	0.09	0	0
109	Batman:1	haoyu	0.17	0.04	0	0
110	Khoa:1	Aristotle	0.18	0.09	0	0
111	Fanny:0	Aristotle	0.18	0.10	0	0
112	Yan Wu:1	haoyu	0.18	0.04	0	0
113	Walter Little:0	haoyu	0.19	0.04	0	0
114	Mercury:1	haoyu	0.19	0.05	0	0
115	Batman:0	haoyu	0.19	0.04	0	0
116	Sally Smith:0	haoyu	0.20	0.04	0	0
117	Sprt:1	haoyu	0.20	0.05	0	0
118	Linda:0	Andrew Grasso	0.20	0.01	0	0
119	Ben Chen:1	spl	0.20	0.20	0	0
120	KingBach:0	haoyu	0.20	0.06	0	0
121	Yan Wu:0	haoyu	0.21	0.05	0	0
122	Dr Roberto:0	Andrew Grasso	0.21	0.03	0	0
123	Valya Barboy:0	Aristotle	0.21	0.06	0	0
124	soccer:0	haoyu	0.21	0.04	0	0
125	soccer:1	haoyu	0.21	0.04	0	0
126	Fanny:1	Aristotle	0.22	0.12	0	0
127	Yacob Y.:0	haoyu	0.22	0.06	0	0
128	Mr. Blobby:1	dusty	0.22	0.12	0	0
129	Sabar Dasgupta:0	spl	0.23	0.23	0	0
130	snowflakes:1	haoyu	0.23	0.03	0	0
131	jabreezy:1	Mercury	0.24	0.10	0	0
132	Dr Roberto:1	Andrew Grasso	0.24	0.02	0	0
133	Sally Smith:1	haoyu	0.25	0.04	0	0
134	Sabar Dasgupta:1	Aaron Doll	0.26	0.17	0	0
135	Walter Little:1	haoyu	0.27	0.03	0	0
136	burrito:0	haoyu	0.28	0.09	0	0
137	Valya Barboy:1	Shaheed Chagani	0.28	0.18	0	0
138	Charliezsc:1	haoyu	0.29	0.07	0	0
139	DinnerPartyPlannerBM:1	Nihar the Great	0.29	0.06	0	0
140	Linda:1	Andrew Grasso	0.31	0.02	0	0
141	nupog:0	Aristotle	0.34	0.13	0	0
142	jabreezy:0	Mercury	0.34	0.09	0	0
143	Glenn Fisher:1	jabreezy	0.34	0.09	0	0
144	dfshasdsf12:0	haoyu	0.34	0.09	0	0
145	Mike Hunt:0	Aristotle	0.35	0.27	0	0
146	Aaron H:1	Aristotle	0.36	0.11	0	0
147	nupog:1	Aristotle	0.37	0.12	0	0
148	ebp:1	haoyu	0.38	0.04	0	0
149	ebp:0	haoyu	0.39	0.04	0	0
150	Lil Thug:0	Andrew Grasso	0.39	0.03	0	0
151	John Whelchel:0	haoyu	0.39	0.06	0	0
152	Anon5:1	Green "The Bean" Choi	0.39	0.07	0	0
153	Lil Thug:1	Andrew Grasso	0.41	0.03	0	0
154	Sprt:0	Aristotle	0.41	0.11	0	0
155	snowflakes:0	haoyu	0.45	0.03	0	0
156	Bob Dondero:1	Mickey Mouse	0.45	0.03	0	0
157	Bob Dondero:0	Andrew Grasso	0.45	0.02	0	0
158	Mike Hunt:1	Aristotle	0.46	0.29	0	0
159	BH:0	haoyu	0.46	0.07	0	0
160	Aaron H:0	Aristotle	0.47	0.11	0	0
161	Andrew Werner:1	haoyu	0.47	0.11	0	0
162	John Whelchel:1	haoyu	0.50	0.11	0	0
163	Andrew Werner:0	Aaron Doll	0.50	0.33	0	0
164	Andys:0	Aristotle	0.52	0.12	0	0
165	BH:1	haoyu	0.54	0.05	0	0
166	burrito:1	haoyu	0.54	0.10	0	0
167	Andys:1	Aristotle	0.55	0.13	0	0
168	CAPS LOCK:0	Aristotle	0.61	0.20	0	0
169	DinnerPartyPlannerBM:0	Aristotle	0.62	0.11	0	0
170	dfshasdsf12:1	Nihar the Great	0.65	0.11	0	0
171	Mike Honcho:0	Miranda	0.78	0.01	0	0
172	Bar Shabtai:1	haoyu	0.86	0.12	0	0
173	NA:1	Elphaba	0.87	0.04	0	0
174	Mike Honcho:1	Jessie Chen	0.93	0.01	0	0
175	CAPS LOCK:1	Aristotle	0.97	0.25	0	0
176	Brendan Wright:0	haoyu	1.04	0.10	0	0
177	AFC:1	Aristotle	1.08	0.16	0	0
178	Brendan Wright:1	Deric Cheng	1.08	0.10	0	0
179	jgs:1	haoyu	1.11	0.18	0	0
180	jgs:0	Aristotle	1.12	0.12	0	0
181	Absurdity:1	Aristotle	1.14	0.18	0	0
182	Shaheed Chagani:0	Aristotle	1.20	0.17	0	0
183	Shaheed Chagani:1	Aristotle	1.39	0.11	0	0
184	EC:0	haoyu	1.47	0.03	0	0
185	David H.:0	AFC	1.65	0.28	0	0
186	spl:1	haoyu	1.86	0.06	0	0
187	Nihar the Great:0	Aristotle	2.14	0.23	0	0
188	Nihar the Great:1	Aristotle	2.23	0.25	0	0
189	Elphaba:0	Aristotle	2.38	0.24	0	0
190	Elphaba:1	Aristotle	2.82	0.22	0	0
191	David H.:1	DeeEmEm	3.24	0.33	0	0
192	NA:0	haoyu	4.20	0.03	0	0
193	Absurdity:0	Aristotle	8.18	0.23	0	0
194	Jessie Chen:0	Joel Faron	15.00	0.13	1	1
195	Qinlan Shen:1	R. A. B.	15.00	9.00	1	1
196	Charliezsc:0	jgs	15.00	14.98	1	1
197	Quite Satisfied:1	Joel Faron	15.00	2.11	1	1
198	Jessie Chen:1	Joel Faron	15.00	0.12	1	1
199	Deric Cheng:1	jgs	15.00	14.98	1	1
200	Deric Cheng:0	jgs	15.00	14.99	1	1
201	DeeEmEm:0	CAPS LOCK	15.00	13.00	1	1
202	0108:0	jgs	15.00	14.98	1	1
203	T. Capote:0	haoyu	15.00	0.00	2	2
204	T. Capote:1	haoyu	15.00	0.00	2	2
205	SuperFan:0	jgs	15.00	14.98	4	4
206	SuperFan:1	jgs	15.00	14.98	4	4
207	Mark S. Fillmore:1	Supahaka	15.00	0.04	79	79
208	Mark S. Fillmore:0	Supahaka	15.00	0.01	116	116
209	CookieMonster:0	CookieMonster	15.00	0.82	1	0
210	CookieMonster:1	CookieMonster	15.00	1.10	1	0
211	AFC:0	CookieMonster	15.00	0.34	1	0
212	spl:0	Elphaba	15.00	0.09	2	0
213	Yacob Y.:1	Aristotle	15.00	15.00	3	1
214	Dusty:1	Shaheed Chagani	15.00	0.22	4	0
215	Bar Shabtai:0	Aaron Doll	15.00	15.01	5	1
216	Andrew Grasso:0	Aaron Doll	15.00	0.18	5	0
217	Dusty:0	CookieMonster	15.00	1.39	6	0
218	Andrew Grasso:1	Shaheed Chagani	15.00	0.15	7	0
219	Supahaka:0	Andrew Werner	15.00	15.00	36	35
220	Supahaka:1	Joel Faron	15.00	15.00	36	35
221	13a:0	Aaron Doll	15.00	15.00	43	21
222	13a:1	Aaron Doll	15.00	15.00	50	29
223	Aaron Doll:0	Aristotle	15.00	0.56	22290	0
224	Aristotle:0	Aristotle	15.00	15.00	660085	1
225	Aaron Doll:1	Aristotle	15.00	1.27	3	0
226	Aristotle:1	Aristotle	15.00	9.69	597410	0
227	Matt Goldsmith:1	Happy	15.01	0.03	455548	0
228	Matt Goldsmith:0	Nihar the Great	15.01	0.03	463239	0

SatSolvers Ranklist

Generators Ranklist