Stats for satsolver: Solving For Clauses

How to interpret the values

Each satsolver was run against each test case. Two cnf formulas were generated from each submitted generator to form the set of generators. For each run, a number of seconds were charged to the program based on the criteria described on the assignments webpage; this was the score for that run. If the program crashed or went into a loop, 150 seconds were charged. The two cnf formulas generated by a generator is denoted by generator_name:i where i is 0 for the first cnf and 1 for the second. The table below shows the time satsolver Solving For Clauses took for each formula and how many clauses it left unsatisfied; the formulas are sorted by the satsolver's score on it (which is different from its runtime). For each formula , we also list the name of the best solver, the time taken by the best solver (Best time) and the number of clauses left unsatisfied by him/her (Best unsat). A blank symbol denotes that Solving For Clauses took more than 150 seconds for that formula or terminated with an exception. Some important stats are summarized at the start. Click on the name of a formula to view details.

Summary

Satsolver:	Solving For Clauses
Rank:	48 / 118
Average Score:	7.42
Median Score:	4.92
Description:	On every iteration, the algorithm picks an unsatisfied clause and picks a symbol in the clause to flip. It chooses randomly between flipping by minimizing the number of unsatisfied clauses in the new state and picking the symbol randomly

	Generator	Best solver	Time taken	Best time	Unsat	Best unsat
1	Ravi Tandon:0	KingBach	0.00	0.00	0	0
2	bigwig:0	Andrew Werner	0.00	0.00	0	0
3	Happy:1	KingBach	0.00	0.00	0	0
4	bigwig:1	KingBach	0.00	0.00	0	0
5	Ravi Tandon:1	KingBach	0.00	0.00	0	0
6	Miranda:1	cat	0.00	0.00	0	0
7	Bebe Shi:0	KingBach	0.00	0.00	0	0
8	Miranda:0	cat	0.00	0.00	0	0
9	Jonathan Kwok:0	Elphaba	0.00	0.00	0	0
10	Solving For Clauses:0	Glenn Fisher	0.01	0.00	0	0
11	Bebe Shi:1	KingBach	0.01	0.00	0	0
12	K.L.:1	KingBach	0.01	0.00	0	0
13	Joshua Zimmer:0	haoyu	0.01	0.00	0	0
14	Joshua Zimmer:1	haoyu	0.01	0.00	0	0
15	R. A. B.:1	cat	0.01	0.00	0	0
16	Solving For Clauses:1	haoyu	0.01	0.00	0	0
17	Jonathan Kwok:1	KingBach	0.01	0.00	0	0
18	haoyu:1	Anon5	0.01	0.01	0	0
19	Happy:0	haoyu	0.01	0.00	0	0
20	Blam:1	Elphaba	0.01	0.00	0	0
21	David Paulk:0	cat	0.01	0.00	0	0
22	David Paulk:1	Bar Shabtai	0.02	0.00	0	0
23	K.L.:0	haoyu	0.02	0.00	0	0
24	Blam:0	Elphaba	0.02	0.00	0	0
25	bchouGenerator:0	haoyu	0.02	0.00	0	0
26	Gewang:1	Jonathan Kwok	0.02	0.00	0	0
27	haoyu:0	KingBach	0.02	0.01	0	0
28	Jordan Ash:1	Bar Shabtai	0.02	0.01	0	0
29	Gewang:0	Jonathan Kwok	0.02	0.00	0	0
30	The Kraken:1	haoyu	0.02	0.00	0	0
31	Tree Prophet:0	haoyu	0.02	0.00	0	0
32	BMJ:1	burrito	0.02	0.00	0	0
33	BMJ:0	Elphaba	0.02	0.00	0	0
34	Daffy Duck:1	haoyu	0.02	0.00	0	0
35	The Kraken:0	haoyu	0.02	0.00	0	0
36	Mike Honcho:1	Jessie Chen	0.02	0.01	0	0
37	cmF5a3ly:0	Nihar the Great	0.02	0.00	0	0
38	Mickey Mouse:1	haoyu	0.02	0.01	0	0
39	cmF5a3ly:1	Nihar the Great	0.02	0.00	0	0
40	bchouGenerator:1	Jonathan Kwok	0.02	0.01	0	0
41	Scheduling Generator 203:0	jgs	0.03	0.01	0	0
42	Qinlan Shen:0	Bar Shabtai	0.03	0.01	0	0
43	Tree Prophet:1	haoyu	0.03	0.00	0	0
44	Scheduling Generator 203:1	Jameh	0.03	0.02	0	0
45	Mickey Mouse:0	Bar Shabtai	0.03	0.01	0	0
46	Sunny:1	jabreezy	0.03	0.01	0	0
47	Daffy Duck:0	Andrew Werner	0.03	0.00	0	0
48	weezy:1	Bar Shabtai	0.03	0.01	0	0
49	Tom T:1	Andrew Werner	0.03	0.02	0	0
50	R. A. B.:0	Nihar the Great	0.03	0.00	0	0
51	vluu:1	Nihar the Great	0.04	0.02	0	0
52	weezy:0	Bar Shabtai	0.04	0.01	0	0
53	vluu:0	Nihar the Great	0.04	0.01	0	0
54	Ytterbium:0	Andrew Grasso	0.04	0.02	0	0
55	Jameh:0	haoyu	0.04	0.01	0	0
56	Quite Satisfied:0	haoyu	0.04	0.00	0	0
57	Bob Dondero:1	Mickey Mouse	0.04	0.03	0	0
58	totallyOnFallBreak:0	Nikhilesh Sigatapu	0.05	0.01	0	0
59	DeeEmEm:1	haoyu	0.06	0.02	0	0
60	totallyOnFallBreak:1	Nikhilesh Sigatapu	0.07	0.01	0	0
61	Jameh:1	haoyu	0.08	0.01	0	0
62	Tiny Wings:0	haoyu	0.08	0.02	0	0
63	Ytterbium:1	Nihar the Great	0.08	0.02	0	0
64	Boomshanka:1	Bar Shabtai	0.08	0.01	0	0
65	Mike Honcho:0	Miranda	0.09	0.01	0	0
66	Tiny Wings:1	haoyu	0.09	0.01	0	0
67	cat:1	haoyu	0.10	0.03	0	0
68	Linda:0	Andrew Grasso	0.10	0.01	0	0
69	Janie Gu:1	Jonathan Kwok	0.10	0.07	0	0
70	Tom T:0	EC	0.11	0.02	0	0
71	George Okeowo:1	Andrew Grasso	0.11	0.01	0	0
72	George Okeowo:0	Andrew Grasso	0.11	0.01	0	0
73	Boomshanka:0	haoyu	0.12	0.01	0	0
74	The Whitman Whale:0	bigwig	0.12	0.04	0	0
75	The Whitman Whale:1	Andrew Grasso	0.14	0.03	0	0
76	Dr Roberto:1	Andrew Grasso	0.15	0.02	0	0
77	Lisa Kim:1	Bar Shabtai	0.17	0.06	0	0
78	Bob Dondero:0	Andrew Grasso	0.18	0.02	0	0
79	Linda:1	Andrew Grasso	0.19	0.02	0	0
80	Janie Gu:0	Glenn Fisher	0.20	0.07	0	0
81	cat:0	haoyu	0.21	0.03	0	0
82	Lisa Kim:0	Aristotle	0.21	0.07	0	0
83	kt4124:0	haoyu	0.21	0.03	0	0
84	kt4124:1	haoyu	0.22	0.04	0	0
85	Keji Xu:1	Nihar the Great	0.22	0.04	0	0
86	Alex Fish:1	haoyu	0.23	0.02	0	0
87	Jordan Ash:0	EC	0.23	0.03	0	0
88	Sunny:0	Green "The Bean" Choi	0.23	0.02	0	0
89	Dr Roberto:0	Andrew Grasso	0.30	0.03	0	0
90	Sally Smith:0	haoyu	0.35	0.04	0	0
91	soccer:0	haoyu	0.44	0.04	0	0
92	Sprt:1	haoyu	0.47	0.05	0	0
93	Keji Xu:0	Nihar the Great	0.51	0.03	0	0
94	Alex Fish:0	haoyu	0.62	0.01	0	0
95	Batman:0	haoyu	0.66	0.04	0	0
96	Sally Smith:1	haoyu	0.70	0.04	0	0
97	Khoa:1	Aristotle	0.72	0.09	0	0
98	DinnerPartyPlannerBM:1	Nihar the Great	0.80	0.06	0	0
99	0108:1	haoyu	0.95	0.01	0	0
100	dfshasdsf12:0	haoyu	1.24	0.09	0	0
101	soccer:1	haoyu	1.29	0.04	0	0
102	Khoa:0	haoyu	1.56	0.09	0	0
103	Lil Thug:0	Andrew Grasso	1.63	0.03	0	0
104	Lil Thug:1	Andrew Grasso	1.71	0.03	0	0
105	bfang:1	haoyu	1.78	0.04	0	0
106	AARON BURR, DROPPIN' HAMILTONS:0	haoyu	1.92	0.00	0	0
107	Sprt:0	Aristotle	2.03	0.11	0	0
108	KingBach:1	haoyu	2.19	0.04	0	0
109	DinnerPartyPlannerBM:0	Aristotle	2.60	0.11	0	0
110	burrito:0	haoyu	2.60	0.09	0	0
111	dfshasdsf12:1	Nihar the Great	2.76	0.11	0	0
112	KingBach:0	haoyu	3.07	0.06	0	0
113	Tao:1	Aristotle	4.30	0.07	0	0
114	David Lackey:0	Anon5	4.92	0.03	0	0
115	Tao:0	Bar Shabtai	6.73	0.02	0	0
116	Batman:1	haoyu	7.07	0.04	0	0
117	CAPS LOCK:0	Aristotle	7.17	0.20	0	0
118	bfang:0	haoyu	7.51	0.04	0	0
119	burrito:1	haoyu	7.56	0.10	0	0
120	Andrew Werner:1	haoyu	8.60	0.11	0	0
121	Nikhilesh Sigatapu:0	haoyu	9.67	0.03	0	0
122	Bar Shabtai:1	haoyu	11.39	0.12	0	0
123	nupog:1	Aristotle	11.62	0.12	0	0
124	jabreezy:1	Mercury	11.94	0.10	0	0
125	nupog:0	Aristotle	12.19	0.13	0	0
126	AARON BURR, DROPPIN' HAMILTONS:1	haoyu	12.82	0.01	0	0
127	jabreezy:0	Mercury	13.72	0.09	0	0
128	Jessie Chen:0	Joel Faron	15.00	0.13	1	1
129	Qinlan Shen:1	R. A. B.	15.00	9.00	1	1
130	David Lackey:1	Bar Shabtai	15.00	0.03	1	0
131	Quite Satisfied:1	Joel Faron	15.00	2.11	1	1
132	Jessie Chen:1	Joel Faron	15.00	0.12	1	1
133	DeeEmEm:0	CAPS LOCK	15.00	13.00	1	1
134	0108:0	jgs	15.00	14.98	1	1
135	Charliezsc:1	haoyu	15.00	0.07	2	0
136	T. Capote:0	haoyu	15.00	0.00	2	2
137	John Whelchel:0	haoyu	15.00	0.06	2	0
138	Anon_K_P:1	Aristotle	15.00	0.03	2	0
139	T. Capote:1	haoyu	15.00	0.00	2	2
140	Samuel Jerome:0	haoyu	15.00	0.03	2	0
141	Samuel Jerome:1	haoyu	15.00	0.03	3	0
142	Charliezsc:0	jgs	15.00	14.98	3	1
143	Mercury:1	haoyu	15.00	0.05	3	0
144	Nikhilesh Sigatapu:1	haoyu	15.00	0.04	3	0
145	Aaron H:0	Aristotle	15.00	0.11	4	0
146	EC:1	haoyu	15.00	0.03	4	0
147	Valya Barboy:1	Shaheed Chagani	15.00	0.18	4	0
148	Anon5:1	Green "The Bean" Choi	15.00	0.07	5	0
149	John Whelchel:1	haoyu	15.00	0.11	5	0
150	Deric Cheng:1	jgs	15.00	14.98	5	1
151	EC:0	haoyu	15.00	0.03	5	0
152	Valya Barboy:0	Aristotle	15.00	0.06	5	0
153	Anon_K_P:0	haoyu	15.00	0.02	6	0
154	David H.:1	DeeEmEm	15.00	0.33	6	0
155	Sabar Dasgupta:0	spl	15.00	0.23	6	0
156	SuperFan:1	jgs	15.00	14.98	6	4
157	David H.:0	AFC	15.00	0.28	7	0
158	SuperFan:0	jgs	15.00	14.98	8	4
159	CookieMonster:1	CookieMonster	15.00	1.10	8	0
160	Anon5:0	haoyu	15.00	0.05	9	0
161	Sabar Dasgupta:1	Aaron Doll	15.00	0.17	10	0
162	Fanny:0	Aristotle	15.00	0.10	11	0
163	CookieMonster:0	CookieMonster	15.00	0.82	11	0
164	AFC:0	CookieMonster	15.00	0.34	11	0
165	Yacob Y.:0	haoyu	15.00	0.06	13	0
166	AFC:1	Aristotle	15.00	0.16	13	0
167	Fanny:1	Aristotle	15.00	0.12	13	0
168	ebp:1	haoyu	15.00	0.04	19	0
169	Glenn Fisher:0	Elphaba	15.00	0.02	20	0
170	Absurdity:1	Aristotle	15.00	0.18	22	0
171	Absurdity:0	Aristotle	15.00	0.23	23	0
172	ebp:0	haoyu	15.00	0.04	24	0
173	spl:1	haoyu	15.00	0.06	24	0
174	Andrew Grasso:0	Aaron Doll	15.00	0.18	25	0
175	jgs:0	Aristotle	15.00	0.12	26	0
176	Yan Wu:1	haoyu	15.00	0.04	26	0
177	spl:0	Elphaba	15.00	0.09	27	0
178	Andrew Grasso:1	Shaheed Chagani	15.00	0.15	27	0
179	Mr. Blobby:0	Green "The Bean" Choi	15.00	0.14	28	0
180	Mr. Blobby:1	dusty	15.00	0.12	29	0
181	Ben Chen:1	spl	15.00	0.20	29	0
182	Glenn Fisher:1	jabreezy	15.00	0.09	31	0
183	Dusty:0	CookieMonster	15.00	1.39	32	0
184	Yan Wu:0	haoyu	15.00	0.05	33	0
185	Dusty:1	Shaheed Chagani	15.00	0.22	33	0
186	Ben Chen:0	Elphaba	15.00	0.07	34	0
187	Walter Little:1	haoyu	15.00	0.03	34	0
188	Walter Little:0	haoyu	15.00	0.04	35	0
189	Supahaka:0	Andrew Werner	15.00	15.00	37	35
190	Supahaka:1	Joel Faron	15.00	15.00	37	35
191	NA:0	haoyu	15.00	0.03	59	0
192	Matt Haake:1	haoyu	15.00	0.05	61	0
193	Matt Haake:0	haoyu	15.00	0.05	62	0
194	NA:1	Elphaba	15.00	0.04	63	0
195	Mark S. Fillmore:1	Supahaka	15.00	0.04	79	79
196	snowflakes:0	haoyu	15.00	0.03	88	0
197	snowflakes:1	haoyu	15.00	0.03	95	0
198	Mark S. Fillmore:0	Supahaka	15.00	0.01	116	116
199	BH:1	haoyu	15.00	0.05	466	0
200	BH:0	haoyu	15.00	0.07	479	0
201	Mike Hunt:1	Aristotle	15.00	0.29	19	0
202	Shaheed Chagani:0	Aristotle	15.00	0.17	5	0
203	Aaron H:1	Aristotle	15.00	0.11	5	0
204	13a:1	Aaron Doll	15.00	15.00	9465	29
205	Brendan Wright:1	Deric Cheng	15.00	0.10	1	0
206	Mercury:0	haoyu	15.00	0.05	4	0
207	Elphaba:1	Aristotle	15.01	0.22	23	0
208	13a:0	Aaron Doll	15.01	15.00	9790	21
209	Aaron Doll:0	Aristotle	15.01	0.56	157137	0
210	Matt Goldsmith:0	Nihar the Great	15.01	0.03	512016	0
211	Andrew Werner:0	Aaron Doll	15.01	0.33	1	0
212	Nihar the Great:1	Aristotle	15.01	0.25	15525	0
213	Aaron Doll:1	Aristotle	15.01	1.27	253840	0
214	Matt Goldsmith:1	Happy	15.01	0.03	516910	0
215	Yacob Y.:1	Aristotle	15.01	15.00	24	1
216	Elphaba:0	Aristotle	15.01	0.24	20	0
217	Shaheed Chagani:1	Aristotle	15.01	0.11	5	0
218	jgs:1	haoyu	15.01	0.18	25	0
219	Nihar the Great:0	Aristotle	15.02	0.23	15513	0
220	Andys:1	Aristotle	15.02	0.13	21	0
221	Aristotle:1	Aristotle	15.02	9.69	702513	0
222	Brendan Wright:0	haoyu	15.02	0.10	1	0
223	Mike Hunt:0	Aristotle	15.02	0.27	17	0
224	Deric Cheng:0	jgs	15.03	14.99	5	1
225	Aristotle:0	Aristotle	15.03	15.00	705476	1
226	Andys:0	Aristotle	15.04	0.12	21	0
227	CAPS LOCK:1	Aristotle	15.04	0.25	2	0
228	Bar Shabtai:0	Aaron Doll	15.05	15.01	260484	1

SatSolvers Ranklist

Generators Ranklist