Stats for satsolver: Mercury

How to interpret the values

Each satsolver was run against each test case. Two cnf formulas were generated from each submitted generator to form the set of generators. For each run, a number of seconds were charged to the program based on the criteria described on the assignments webpage; this was the score for that run. If the program crashed or went into a loop, 150 seconds were charged. The two cnf formulas generated by a generator is denoted by generator_name:i where i is 0 for the first cnf and 1 for the second. The table below shows the time satsolver Mercury took for each formula and how many clauses it left unsatisfied; the formulas are sorted by the satsolver's score on it (which is different from its runtime). For each formula , we also list the name of the best solver, the time taken by the best solver (Best time) and the number of clauses left unsatisfied by him/her (Best unsat). A blank symbol denotes that Mercury took more than 150 seconds for that formula or terminated with an exception. Some important stats are summarized at the start. Click on the name of a formula to view details.

Summary

Satsolver:	Mercury
Rank:	91 / 118
Average Score:	15.35
Median Score:	0.47
Description:	Variant of WalkSat where breakcounts are only approximated by the number of clauses where a symbol is true, vs the number of clauses where that symbol is false. Indexing and added datastructures allow fast choice of random unsatisfied clause, symbol assignment propagation, and choice of next symbol. Runtime dominated by branching cost of major while loop.

	Generator	Best solver	Time taken	Best time	Unsat	Best unsat
1	bigwig:0	Andrew Werner	0.00	0.00	0	0
2	Happy:1	KingBach	0.00	0.00	0	0
3	bigwig:1	KingBach	0.00	0.00	0	0
4	Bebe Shi:0	KingBach	0.00	0.00	0	0
5	Ravi Tandon:0	KingBach	0.00	0.00	0	0
6	Bebe Shi:1	KingBach	0.00	0.00	0	0
7	K.L.:1	KingBach	0.00	0.00	0	0
8	BMJ:0	Elphaba	0.00	0.00	0	0
9	K.L.:0	haoyu	0.00	0.00	0	0
10	Ravi Tandon:1	KingBach	0.00	0.00	0	0
11	R. A. B.:1	cat	0.00	0.00	0	0
12	BMJ:1	burrito	0.00	0.00	0	0
13	Jonathan Kwok:0	Elphaba	0.00	0.00	0	0
14	Blam:0	Elphaba	0.00	0.00	0	0
15	Blam:1	Elphaba	0.01	0.00	0	0
16	Jonathan Kwok:1	KingBach	0.01	0.00	0	0
17	Joshua Zimmer:0	haoyu	0.01	0.00	0	0
18	Tree Prophet:0	haoyu	0.01	0.00	0	0
19	Miranda:1	cat	0.01	0.00	0	0
20	Joshua Zimmer:1	haoyu	0.01	0.00	0	0
21	Miranda:0	cat	0.01	0.00	0	0
22	Tree Prophet:1	haoyu	0.01	0.00	0	0
23	Daffy Duck:1	haoyu	0.01	0.00	0	0
24	Happy:0	haoyu	0.01	0.00	0	0
25	David Paulk:0	cat	0.01	0.00	0	0
26	haoyu:1	Anon5	0.01	0.01	0	0
27	R. A. B.:0	Nihar the Great	0.01	0.00	0	0
28	bchouGenerator:0	haoyu	0.01	0.00	0	0
29	Daffy Duck:0	Andrew Werner	0.01	0.00	0	0
30	The Kraken:1	haoyu	0.01	0.00	0	0
31	haoyu:0	KingBach	0.01	0.01	0	0
32	The Kraken:0	haoyu	0.01	0.00	0	0
33	David Paulk:1	Bar Shabtai	0.01	0.00	0	0
34	Solving For Clauses:0	Glenn Fisher	0.02	0.00	0	0
35	Gewang:1	Jonathan Kwok	0.02	0.00	0	0
36	Jordan Ash:1	Bar Shabtai	0.02	0.01	0	0
37	Gewang:0	Jonathan Kwok	0.02	0.00	0	0
38	Quite Satisfied:0	haoyu	0.02	0.00	0	0
39	Solving For Clauses:1	haoyu	0.02	0.00	0	0
40	Jameh:0	haoyu	0.02	0.01	0	0
41	Sunny:1	jabreezy	0.03	0.01	0	0
42	Mickey Mouse:1	haoyu	0.03	0.01	0	0
43	Sunny:0	Green "The Bean" Choi	0.03	0.02	0	0
44	Mickey Mouse:0	Bar Shabtai	0.03	0.01	0	0
45	bchouGenerator:1	Jonathan Kwok	0.03	0.01	0	0
46	Jameh:1	haoyu	0.03	0.01	0	0
47	Qinlan Shen:0	Bar Shabtai	0.04	0.01	0	0
48	DeeEmEm:1	haoyu	0.04	0.02	0	0
49	vluu:0	Nihar the Great	0.04	0.01	0	0
50	vluu:1	Nihar the Great	0.04	0.02	0	0
51	Ytterbium:0	Andrew Grasso	0.04	0.02	0	0
52	Tiny Wings:0	haoyu	0.04	0.02	0	0
53	The Whitman Whale:1	Andrew Grasso	0.05	0.03	0	0
54	The Whitman Whale:0	bigwig	0.05	0.04	0	0
55	weezy:1	Bar Shabtai	0.05	0.01	0	0
56	weezy:0	Bar Shabtai	0.05	0.01	0	0
57	Tiny Wings:1	haoyu	0.05	0.01	0	0
58	cat:1	haoyu	0.06	0.03	0	0
59	kt4124:0	haoyu	0.06	0.03	0	0
60	cat:0	haoyu	0.06	0.03	0	0
61	0108:1	haoyu	0.06	0.01	0	0
62	kt4124:1	haoyu	0.07	0.04	0	0
63	Lisa Kim:1	Bar Shabtai	0.07	0.06	0	0
64	Ytterbium:1	Nihar the Great	0.07	0.02	0	0
65	Boomshanka:1	Bar Shabtai	0.08	0.01	0	0
66	George Okeowo:1	Andrew Grasso	0.08	0.01	0	0
67	Lisa Kim:0	Aristotle	0.09	0.07	0	0
68	George Okeowo:0	Andrew Grasso	0.09	0.01	0	0
69	jabreezy:0	Mercury	0.09	0.09	0	0
70	Keji Xu:1	Nihar the Great	0.09	0.04	0	0
71	jabreezy:1	Mercury	0.10	0.10	0	0
72	cmF5a3ly:1	Nihar the Great	0.10	0.00	0	0
73	cmF5a3ly:0	Nihar the Great	0.10	0.00	0	0
74	Jordan Ash:0	EC	0.10	0.03	0	0
75	Alex Fish:1	haoyu	0.11	0.02	0	0
76	Boomshanka:0	haoyu	0.11	0.01	0	0
77	Khoa:1	Aristotle	0.12	0.09	0	0
78	Janie Gu:0	Glenn Fisher	0.12	0.07	0	0
79	Sally Smith:0	haoyu	0.12	0.04	0	0
80	Janie Gu:1	Jonathan Kwok	0.12	0.07	0	0
81	Khoa:0	haoyu	0.12	0.09	0	0
82	Keji Xu:0	Nihar the Great	0.14	0.03	0	0
83	Sprt:1	haoyu	0.14	0.05	0	0
84	Batman:0	haoyu	0.15	0.04	0	0
85	totallyOnFallBreak:0	Nikhilesh Sigatapu	0.17	0.01	0	0
86	KingBach:1	haoyu	0.17	0.04	0	0
87	bfang:0	haoyu	0.17	0.04	0	0
88	Sally Smith:1	haoyu	0.17	0.04	0	0
89	Alex Fish:0	haoyu	0.18	0.01	0	0
90	KingBach:0	haoyu	0.19	0.06	0	0
91	ebp:1	haoyu	0.19	0.04	0	0
92	totallyOnFallBreak:1	Nikhilesh Sigatapu	0.20	0.01	0	0
93	Batman:1	haoyu	0.21	0.04	0	0
94	ebp:0	haoyu	0.23	0.04	0	0
95	bfang:1	haoyu	0.24	0.04	0	0
96	soccer:1	haoyu	0.24	0.04	0	0
97	soccer:0	haoyu	0.25	0.04	0	0
98	DinnerPartyPlannerBM:1	Nihar the Great	0.27	0.06	0	0
99	Scheduling Generator 203:0	jgs	0.28	0.01	0	0
100	Sprt:0	Aristotle	0.36	0.11	0	0
101	Nikhilesh Sigatapu:0	haoyu	0.37	0.03	0	0
102	nupog:0	Aristotle	0.40	0.13	0	0
103	Andrew Werner:0	Aaron Doll	0.41	0.33	0	0
104	nupog:1	Aristotle	0.41	0.12	0	0
105	Andrew Werner:1	haoyu	0.45	0.11	0	0
106	DinnerPartyPlannerBM:0	Aristotle	0.46	0.11	0	0
107	burrito:0	haoyu	0.47	0.09	0	0
108	Lil Thug:1	Andrew Grasso	0.58	0.03	0	0
109	Lil Thug:0	Andrew Grasso	0.62	0.03	0	0
110	Samuel Jerome:0	haoyu	0.66	0.03	0	0
111	dfshasdsf12:0	haoyu	0.75	0.09	0	0
112	Bar Shabtai:1	haoyu	0.85	0.12	0	0
113	Tom T:0	EC	0.92	0.02	0	0
114	Tom T:1	Andrew Werner	0.93	0.02	0	0
115	burrito:1	haoyu	0.96	0.10	0	0
116	Aaron H:0	Aristotle	1.23	0.11	0	0
117	Tao:1	Aristotle	1.27	0.07	0	0
118	Scheduling Generator 203:1	Jameh	1.28	0.02	0	0
119	Shaheed Chagani:0	Aristotle	1.29	0.17	0	0
120	dfshasdsf12:1	Nihar the Great	1.49	0.11	0	0
121	David Lackey:1	Bar Shabtai	1.59	0.03	0	0
122	John Whelchel:0	haoyu	2.02	0.06	0	0
123	David Lackey:0	Anon5	2.81	0.03	0	0
124	Samuel Jerome:1	haoyu	2.88	0.03	0	0
125	Elphaba:1	Aristotle	2.93	0.22	0	0
126	Elphaba:0	Aristotle	3.19	0.24	0	0
127	Shaheed Chagani:1	Aristotle	4.38	0.11	0	0
128	Aaron H:1	Aristotle	4.54	0.11	0	0
129	Tao:0	Bar Shabtai	7.60	0.02	0	0
130	Linda:0	Andrew Grasso	7.86	0.01	0	0
131	Mercury:1	haoyu	8.29	0.05	0	0
132	Nikhilesh Sigatapu:1	haoyu	8.94	0.04	0	0
133	CAPS LOCK:0	Aristotle	9.70	0.20	0	0
134	AARON BURR, DROPPIN' HAMILTONS:1	haoyu	10.78	0.01	0	0
135	Qinlan Shen:1	R. A. B.	15.00	9.00	1	1
136	Mark S. Fillmore:1	Supahaka	15.00	0.04	79	79
137	Mark S. Fillmore:0	Supahaka	15.00	0.01	116	116
138	DeeEmEm:0	CAPS LOCK	15.00	13.00	1	1
139	T. Capote:0	haoyu	15.00	0.00	2	2
140	Valya Barboy:0	Aristotle	15.00	0.06	2	0
141	Anon5:0	haoyu	15.00	0.05	6	0
142	SuperFan:0	jgs	15.00	14.98	6	4
143	spl:1	haoyu	15.00	0.06	8	0
144	spl:0	Elphaba	15.00	0.09	9	0
145	AFC:0	CookieMonster	15.00	0.34	10	0
146	Mr. Blobby:0	Green "The Bean" Choi	15.00	0.14	23	0
147	Dusty:1	Shaheed Chagani	15.00	0.22	23	0
148	Andrew Grasso:0	Aaron Doll	15.00	0.18	23	0
149	Andrew Grasso:1	Shaheed Chagani	15.00	0.15	24	0
150	Supahaka:0	Andrew Werner	15.00	15.00	36	35
151	NA:0	haoyu	15.00	0.03	37	0
152	Quite Satisfied:1	Joel Faron	15.00	2.11	1	1
153	T. Capote:1	haoyu	15.00	0.00	2	2
154	EC:0	haoyu	15.00	0.03	3	0
155	SuperFan:1	jgs	15.00	14.98	4	4
156	Glenn Fisher:0	Elphaba	15.00	0.02	6	0
157	Absurdity:0	Aristotle	15.00	0.23	18	0
158	Supahaka:1	Joel Faron	15.00	15.00	36	35
159	Matt Haake:0	haoyu	15.00	0.05	47	0
160	AARON BURR, DROPPIN' HAMILTONS:0	haoyu	15.00	0.00	1	0
161	Jessie Chen:0	Joel Faron	15.00	0.13	1	1
162	Jessie Chen:1	Joel Faron	15.00	0.12	1	1
163	Valya Barboy:1	Shaheed Chagani	15.00	0.18	3	0
164	Glenn Fisher:1	jabreezy	15.00	0.09	20	0
165	Dusty:0	CookieMonster	15.00	1.39	25	0
166	Walter Little:1	haoyu	15.00	0.03	25	0
167	CookieMonster:0	CookieMonster	15.00	0.82	1	0
168	0108:0	jgs	15.00	14.98	1	1
169	CookieMonster:1	CookieMonster	15.00	1.10	1	0
170	David H.:0	AFC	15.00	0.28	5	0
171	Mr. Blobby:1	dusty	15.00	0.12	23	0
172	NA:1	Elphaba	15.00	0.04	40	0
173	Charliezsc:1	haoyu	15.00	0.07	1	0
174	Sabar Dasgupta:0	spl	15.00	0.23	3	0
175	Matt Haake:1	haoyu	15.00	0.05	51	0
176	Walter Little:0	haoyu	15.01	0.04	27	0
177	snowflakes:0	haoyu	15.01	0.03	65	0
178	Sabar Dasgupta:1	Aaron Doll	15.01	0.17	4	0
179	Absurdity:1	Aristotle	15.01	0.18	18	0
180	AFC:1	Aristotle	15.01	0.16	9	0
181	snowflakes:1	haoyu	15.01	0.03	69	0
182	Anon_K_P:1	Aristotle	15.01	0.03	1	0
183	Anon5:1	Green "The Bean" Choi	15.01	0.07	4	0
184	David H.:1	DeeEmEm	15.01	0.33	4	0
185	Ben Chen:1	spl	15.01	0.20	26	0
186	BH:1	haoyu	15.01	0.05	311	0
187	Anon_K_P:0	haoyu	15.01	0.02	2	0
188	EC:1	haoyu	15.01	0.03	3	0
189	Mercury:0	haoyu	15.01	0.05	1	0
190	Charliezsc:0	jgs	15.01	14.98	2	1
191	Ben Chen:0	Elphaba	15.01	0.07	26	0
192	John Whelchel:1	haoyu	15.01	0.11	2	0
193	jgs:0	Aristotle	15.01	0.12	13	0
194	Yacob Y.:0	haoyu	15.02	0.06	8	0
195	Mike Hunt:0	Aristotle	15.02	0.27	11	0
196	Yan Wu:1	haoyu	15.02	0.04	23	0
197	Yacob Y.:1	Aristotle	15.02	15.00	21	1
198	BH:0	haoyu	15.02	0.07	317	0
199	Mike Hunt:1	Aristotle	15.02	0.29	8	0
200	13a:0	Aaron Doll	15.02	15.00	91	21
201	13a:1	Aaron Doll	15.02	15.00	91	29
202	Yan Wu:0	haoyu	15.03	0.05	28	0
203	jgs:1	haoyu	15.03	0.18	11	0
204	Fanny:1	Aristotle	15.03	0.12	3	0
205	Andys:1	Aristotle	15.04	0.13	15	0
206	Andys:0	Aristotle	15.05	0.12	16	0
207	Fanny:0	Aristotle	15.05	0.10	1	0
208	Deric Cheng:0	jgs	15.06	14.99	3	1
209	Deric Cheng:1	jgs	15.08	14.98	3	1
210	Dr Roberto:1	Andrew Grasso	20.59	0.02	0	0
211	CAPS LOCK:1	Aristotle	25.31	0.25	0	0
212	Linda:1	Andrew Grasso	27.83	0.02	0	0
213	Dr Roberto:0	Andrew Grasso	30.04	0.03	0	0
214	Brendan Wright:1	Deric Cheng	69.78	0.10	0	0
215	Matt Goldsmith:0	Nihar the Great	-	0.03	-	0
216	Aristotle:1	Aristotle	-	9.69	-	0
217	Mike Honcho:0	Miranda	-	0.01	-	0
218	Aaron Doll:0	Aristotle	-	0.56	-	0
219	Brendan Wright:0	haoyu	-	0.10	-	0
220	Bob Dondero:1	Mickey Mouse	-	0.03	-	0
221	Aaron Doll:1	Aristotle	-	1.27	-	0
222	Nihar the Great:0	Aristotle	-	0.23	-	0
223	Bob Dondero:0	Andrew Grasso	-	0.02	-	0
224	Bar Shabtai:0	Aaron Doll	-	15.01	-	1
225	Aristotle:0	Aristotle	-	15.00	-	1
226	Nihar the Great:1	Aristotle	-	0.25	-	0
227	Mike Honcho:1	Jessie Chen	-	0.01	-	0
228	Matt Goldsmith:1	Happy	-	0.03	-	0

SatSolvers Ranklist

Generators Ranklist