Stats for satsolver: Bebe Shi

How to interpret the values

Each satsolver was run against each test case. Two cnf formulas were generated from each submitted generator to form the set of generators. For each run, a number of seconds were charged to the program based on the criteria described on the assignments webpage; this was the score for that run. If the program crashed or went into a loop, 150 seconds were charged. The two cnf formulas generated by a generator is denoted by generator_name:i where i is 0 for the first cnf and 1 for the second. The table below shows the time satsolver Bebe Shi took for each formula and how many clauses it left unsatisfied; the formulas are sorted by the satsolver's score on it (which is different from its runtime). For each formula , we also list the name of the best solver, the time taken by the best solver (Best time) and the number of clauses left unsatisfied by him/her (Best unsat). A blank symbol denotes that Bebe Shi took more than 150 seconds for that formula or terminated with an exception. Some important stats are summarized at the start. Click on the name of a formula to view details.

Summary

Satsolver:	Bebe Shi
Rank:	97 / 118
Average Score:	17.52
Median Score:	15.01
Description:	WalkSAT but returns the best model found.

	Generator	Best solver	Time taken	Best time	Unsat	Best unsat
1	bigwig:0	Andrew Werner	0.00	0.00	0	0
2	Bebe Shi:1	KingBach	0.01	0.00	0	0
3	Jonathan Kwok:1	KingBach	0.01	0.00	0	0
4	Ravi Tandon:0	KingBach	0.01	0.00	0	0
5	K.L.:1	KingBach	0.01	0.00	0	0
6	Bebe Shi:0	KingBach	0.01	0.00	0	0
7	Ravi Tandon:1	KingBach	0.01	0.00	0	0
8	bigwig:1	KingBach	0.01	0.00	0	0
9	Jonathan Kwok:0	Elphaba	0.01	0.00	0	0
10	Solving For Clauses:0	Glenn Fisher	0.01	0.00	0	0
11	BMJ:1	burrito	0.01	0.00	0	0
12	Happy:1	KingBach	0.02	0.00	0	0
13	Mike Honcho:0	Miranda	0.02	0.01	0	0
14	Joshua Zimmer:0	haoyu	0.02	0.00	0	0
15	Miranda:1	cat	0.02	0.00	0	0
16	Miranda:0	cat	0.02	0.00	0	0
17	R. A. B.:1	cat	0.02	0.00	0	0
18	Solving For Clauses:1	haoyu	0.03	0.00	0	0
19	Mike Honcho:1	Jessie Chen	0.03	0.01	0	0
20	Daffy Duck:1	haoyu	0.03	0.00	0	0
21	Joshua Zimmer:1	haoyu	0.03	0.00	0	0
22	bchouGenerator:0	haoyu	0.03	0.00	0	0
23	Daffy Duck:0	Andrew Werner	0.03	0.00	0	0
24	bchouGenerator:1	Jonathan Kwok	0.04	0.01	0	0
25	K.L.:0	haoyu	0.04	0.00	0	0
26	BMJ:0	Elphaba	0.08	0.00	0	0
27	Happy:0	haoyu	0.17	0.00	0	0
28	Tom T:0	EC	0.25	0.02	0	0
29	Tom T:1	Andrew Werner	0.26	0.02	0	0
30	David Paulk:0	cat	0.27	0.00	0	0
31	Dr Roberto:0	Andrew Grasso	0.50	0.03	0	0
32	Boomshanka:0	haoyu	0.63	0.01	0	0
33	David Lackey:1	Bar Shabtai	0.76	0.03	0	0
34	Bob Dondero:1	Mickey Mouse	0.91	0.03	0	0
35	Mickey Mouse:0	Bar Shabtai	0.98	0.01	0	0
36	David Lackey:0	Anon5	1.12	0.03	0	0
37	Mickey Mouse:1	haoyu	1.26	0.01	0	0
38	cmF5a3ly:0	Nihar the Great	1.32	0.00	0	0
39	Bob Dondero:0	Andrew Grasso	1.33	0.02	0	0
40	weezy:0	Bar Shabtai	1.46	0.01	0	0
41	cmF5a3ly:1	Nihar the Great	1.71	0.00	0	0
42	Tiny Wings:0	haoyu	2.05	0.02	0	0
43	Quite Satisfied:0	haoyu	3.02	0.00	0	0
44	Linda:0	Andrew Grasso	3.87	0.01	0	0
45	Scheduling Generator 203:1	Jameh	4.07	0.02	0	0
46	Boomshanka:1	Bar Shabtai	6.06	0.01	0	0
47	Jameh:0	haoyu	7.97	0.01	0	0
48	cat:0	haoyu	9.48	0.03	0	0
49	cat:1	haoyu	9.49	0.03	0	0
50	Ytterbium:0	Andrew Grasso	10.45	0.02	0	0
51	vluu:0	Nihar the Great	12.60	0.01	0	0
52	vluu:1	Nihar the Great	12.74	0.02	0	0
53	Linda:1	Andrew Grasso	13.18	0.02	0	0
54	David Paulk:1	Bar Shabtai	15.00	0.00	1	0
55	Gewang:1	Jonathan Kwok	15.00	0.00	1	0
56	Quite Satisfied:1	Joel Faron	15.00	2.11	1	1
57	Jessie Chen:1	Joel Faron	15.00	0.12	1	1
58	Scheduling Generator 203:0	jgs	15.00	0.01	1	0
59	Jordan Ash:1	Bar Shabtai	15.00	0.01	1	0
60	Gewang:0	Jonathan Kwok	15.00	0.00	1	0
61	haoyu:1	Anon5	15.00	0.01	1	0
62	Jordan Ash:0	EC	15.00	0.03	1	0
63	Qinlan Shen:0	Bar Shabtai	15.00	0.01	1	0
64	Jessie Chen:0	Joel Faron	15.00	0.13	2	1
65	Tiny Wings:1	haoyu	15.00	0.01	2	0
66	haoyu:0	KingBach	15.00	0.01	2	0
67	T. Capote:0	haoyu	15.00	0.00	2	2
68	T. Capote:1	haoyu	15.00	0.00	2	2
69	The Kraken:0	haoyu	15.00	0.00	2	0
70	AARON BURR, DROPPIN' HAMILTONS:0	haoyu	15.00	0.00	3	0
71	The Kraken:1	haoyu	15.00	0.00	3	0
72	Blam:1	Elphaba	15.00	0.00	3	0
73	Tree Prophet:0	haoyu	15.00	0.00	3	0
74	Qinlan Shen:1	R. A. B.	15.00	9.00	3	1
75	Alex Fish:1	haoyu	15.00	0.02	3	0
76	0108:1	haoyu	15.00	0.01	3	0
77	AARON BURR, DROPPIN' HAMILTONS:1	haoyu	15.00	0.01	4	0
78	0108:0	jgs	15.00	14.98	4	1
79	Blam:0	Elphaba	15.00	0.00	5	0
80	Tree Prophet:1	haoyu	15.00	0.00	6	0
81	DeeEmEm:1	haoyu	15.00	0.02	7	0
82	DeeEmEm:0	CAPS LOCK	15.00	13.00	7	1
83	Sunny:1	jabreezy	15.00	0.01	9	0
84	SuperFan:1	jgs	15.00	14.98	12	4
85	R. A. B.:0	Nihar the Great	15.00	0.00	15	0
86	Sunny:0	Green "The Bean" Choi	15.00	0.02	16	0
87	Supahaka:1	Joel Faron	15.00	15.00	46	35
88	Anon5:1	Green "The Bean" Choi	15.00	0.07	4	0
89	AFC:1	Aristotle	15.00	0.16	8	0
90	SuperFan:0	jgs	15.00	14.98	18	4
91	Aaron H:1	Aristotle	15.00	0.11	28347	0
92	Alex Fish:0	haoyu	15.00	0.01	1	0
93	weezy:1	Bar Shabtai	15.00	0.01	1	0
94	Tao:1	Aristotle	15.00	0.07	2	0
95	The Whitman Whale:0	bigwig	15.00	0.04	2	0
96	Dusty:0	CookieMonster	15.00	1.39	31	0
97	David H.:1	DeeEmEm	15.00	0.33	6	0
98	David H.:0	AFC	15.01	0.28	3	0
99	Keji Xu:0	Nihar the Great	15.01	0.03	5	0
100	Jameh:1	haoyu	15.01	0.01	228	0
101	Anon_K_P:0	haoyu	15.01	0.02	2	0
102	Valya Barboy:0	Aristotle	15.01	0.06	7	0
103	Fanny:1	Aristotle	15.01	0.12	1	0
104	Anon_K_P:1	Aristotle	15.01	0.03	5	0
105	Mark S. Fillmore:1	Supahaka	15.01	0.04	443	79
106	Tao:0	Bar Shabtai	15.01	0.02	2	0
107	Yan Wu:1	haoyu	15.01	0.04	22	0
108	Dusty:1	Shaheed Chagani	15.01	0.22	26	0
109	Matt Haake:1	haoyu	15.01	0.05	46	0
110	Anon5:0	haoyu	15.01	0.05	7	0
111	Supahaka:0	Andrew Werner	15.01	15.00	48	35
112	Lisa Kim:1	Bar Shabtai	15.01	0.06	1302	0
113	Valya Barboy:1	Shaheed Chagani	15.01	0.18	7	0
114	Andrew Grasso:0	Aaron Doll	15.01	0.18	22	0
115	Keji Xu:1	Nihar the Great	15.01	0.04	4	0
116	Andrew Grasso:1	Shaheed Chagani	15.01	0.15	25	0
117	snowflakes:1	haoyu	15.01	0.03	306	0
118	Dr Roberto:1	Andrew Grasso	15.02	0.02	1	0
119	Absurdity:1	Aristotle	15.02	0.18	9506	0
120	Nikhilesh Sigatapu:0	haoyu	15.02	0.03	6	0
121	Lisa Kim:0	Aristotle	15.02	0.07	1804	0
122	soccer:0	haoyu	15.02	0.04	4863	0
123	Samuel Jerome:0	haoyu	15.02	0.03	4	0
124	Samuel Jerome:1	haoyu	15.02	0.03	4	0
125	Janie Gu:1	Jonathan Kwok	15.02	0.07	7	0
126	The Whitman Whale:1	Andrew Grasso	15.02	0.03	3	0
127	Brendan Wright:1	Deric Cheng	15.02	0.10	4	0
128	Glenn Fisher:1	jabreezy	15.02	0.09	218	0
129	Ben Chen:1	spl	15.02	0.20	2292	0
130	EC:0	haoyu	15.03	0.03	9	0
131	Sprt:0	Aristotle	15.03	0.11	27098	0
132	Nikhilesh Sigatapu:1	haoyu	15.03	0.04	3	0
133	Janie Gu:0	Glenn Fisher	15.03	0.07	9	0
134	NA:1	Elphaba	15.03	0.04	107	0
135	kt4124:0	haoyu	15.03	0.03	340	0
136	Matt Haake:0	haoyu	15.03	0.05	40	0
137	Glenn Fisher:0	Elphaba	15.04	0.02	227	0
138	snowflakes:0	haoyu	15.04	0.03	366	0
139	EC:1	haoyu	15.04	0.03	6	0
140	Mr. Blobby:1	dusty	15.04	0.12	425	0
141	Ytterbium:1	Nihar the Great	15.04	0.02	509	0
142	Fanny:0	Aristotle	15.04	0.10	14	0
143	kt4124:1	haoyu	15.05	0.04	361	0
144	NA:0	haoyu	15.05	0.03	92	0
145	Yan Wu:0	haoyu	15.05	0.05	27	0
146	AFC:0	CookieMonster	15.05	0.34	183	0
147	KingBach:0	haoyu	15.05	0.06	10138	0
148	Mr. Blobby:0	Green "The Bean" Choi	15.06	0.14	636	0
149	CookieMonster:1	CookieMonster	15.06	1.10	342	0
150	CookieMonster:0	CookieMonster	15.06	0.82	343	0
151	Walter Little:0	haoyu	15.07	0.04	1713	0
152	Sally Smith:1	haoyu	15.07	0.04	640	0
153	Batman:1	haoyu	15.08	0.04	7264	0
154	ebp:0	haoyu	15.08	0.04	7655	0
155	Mike Hunt:1	Aristotle	15.08	0.29	22559	0
156	Mark S. Fillmore:0	Supahaka	15.09	0.01	1222	116
157	jabreezy:1	Mercury	15.10	0.10	4590	0
158	Charliezsc:1	haoyu	15.10	0.07	14128	0
159	Ben Chen:0	Elphaba	15.12	0.07	1590	0
160	Walter Little:1	haoyu	15.12	0.03	1929	0
161	spl:0	Elphaba	15.13	0.09	3305	0
162	Sally Smith:0	haoyu	15.13	0.04	557	0
163	totallyOnFallBreak:0	Nikhilesh Sigatapu	15.14	0.01	798	0
164	jabreezy:0	Mercury	15.14	0.09	4689	0
165	Mercury:0	haoyu	15.16	0.05	2991	0
166	KingBach:1	haoyu	15.19	0.04	8852	0
167	Andys:0	Aristotle	15.19	0.12	32839	0
168	soccer:1	haoyu	15.20	0.04	6117	0
169	bfang:1	haoyu	15.21	0.04	4128	0
170	Brendan Wright:0	haoyu	15.23	0.10	6	0
171	Batman:0	haoyu	15.24	0.04	6860	0
172	Mercury:1	haoyu	15.25	0.05	3997	0
173	Yacob Y.:0	haoyu	15.26	0.06	8430	0
174	spl:1	haoyu	15.27	0.06	2927	0
175	bfang:0	haoyu	15.27	0.04	4123	0
176	George Okeowo:0	Andrew Grasso	15.27	0.01	2248	0
177	CAPS LOCK:0	Aristotle	15.32	0.20	50817	0
178	Khoa:0	haoyu	15.36	0.09	7476	0
179	Charliezsc:0	jgs	15.37	14.98	10685	1
180	Yacob Y.:1	Aristotle	15.38	15.00	9871	1
181	Khoa:1	Aristotle	15.40	0.09	7744	0
182	Sabar Dasgupta:0	spl	15.42	0.23	13311	0
183	George Okeowo:1	Andrew Grasso	15.42	0.01	2561	0
184	John Whelchel:1	haoyu	15.51	0.11	30692	0
185	Absurdity:0	Aristotle	15.52	0.23	9634	0
186	Sprt:1	haoyu	15.56	0.05	11009	0
187	ebp:1	haoyu	15.67	0.04	7829	0
188	Andrew Werner:0	Aaron Doll	15.74	0.33	31077	0
189	dfshasdsf12:1	Nihar the Great	15.89	0.11	30786	0
190	Sabar Dasgupta:1	Aaron Doll	15.94	0.17	13051	0
191	John Whelchel:0	haoyu	15.99	0.06	31503	0
192	Andys:1	Aristotle	16.10	0.13	28800	0
193	dfshasdsf12:0	haoyu	16.37	0.09	21320	0
194	burrito:0	haoyu	16.43	0.09	22923	0
195	Lil Thug:0	Andrew Grasso	16.51	0.03	29549	0
196	BH:1	haoyu	16.52	0.05	20395	0
197	DinnerPartyPlannerBM:1	Nihar the Great	16.62	0.06	24348	0
198	totallyOnFallBreak:1	Nikhilesh Sigatapu	16.74	0.01	811	0
199	Andrew Werner:1	haoyu	16.84	0.11	29274	0
200	BH:0	haoyu	16.89	0.07	20978	0
201	burrito:1	haoyu	17.03	0.10	44826	0
202	Mike Hunt:0	Aristotle	17.25	0.27	23093	0
203	Aaron H:0	Aristotle	17.45	0.11	26325	0
204	jgs:0	Aristotle	17.64	0.12	57823	0
205	Lil Thug:1	Andrew Grasso	17.67	0.03	31403	0
206	nupog:0	Aristotle	18.10	0.13	5098	0
207	nupog:1	Aristotle	18.78	0.12	4939	0
208	Deric Cheng:0	jgs	20.16	14.99	52984	1
209	DinnerPartyPlannerBM:0	Aristotle	20.19	0.11	43482	0
210	Shaheed Chagani:0	Aristotle	20.49	0.17	37534	0
211	Deric Cheng:1	jgs	21.46	14.98	61074	1
212	Bar Shabtai:1	haoyu	21.59	0.12	51703	0
213	jgs:1	haoyu	22.97	0.18	53896	0
214	Elphaba:0	Aristotle	24.74	0.24	106569	0
215	CAPS LOCK:1	Aristotle	27.06	0.25	78452	0
216	Elphaba:1	Aristotle	27.14	0.22	102736	0
217	Shaheed Chagani:1	Aristotle	29.17	0.11	34129	0
218	13a:0	Aaron Doll	43.55	15.00	123329	21
219	13a:1	Aaron Doll	45.19	15.00	125553	29
220	Nihar the Great:0	Aristotle	87.30	0.23	86245	0
221	Nihar the Great:1	Aristotle	102.49	0.25	116227	0
222	Aaron Doll:0	Aristotle	127.01	0.56	294139	0
223	Aaron Doll:1	Aristotle	138.01	1.27	330979	0
224	Matt Goldsmith:0	Nihar the Great	-	0.03	-	0
225	Aristotle:1	Aristotle	-	9.69	-	0
226	Bar Shabtai:0	Aaron Doll	-	15.01	-	1
227	Aristotle:0	Aristotle	-	15.00	-	1
228	Matt Goldsmith:1	Happy	-	0.03	-	0

SatSolvers Ranklist

Generators Ranklist