SatSolvers Ranklist Generators Ranklist

Stats for satsolver: Matt Goldsmith

How to interpret the values

Each satsolver was run against each test case. Two cnf formulas were generated from each submitted generator to form the set of generators. For each run, a number of seconds were charged to the program based on the criteria described on the assignments webpage; this was the score for that run. If the program crashed or went into a loop, 150 seconds were charged. The two cnf formulas generated by a generator is denoted by generator_name:i where i is 0 for the first cnf and 1 for the second. The table below shows the time satsolver Matt Goldsmith took for each formula and how many clauses it left unsatisfied; the formulas are sorted by the satsolver's score on it (which is different from its runtime). For each formula , we also list the name of the best solver, the time taken by the best solver (Best time) and the number of clauses left unsatisfied by him/her (Best unsat). A blank symbol denotes that Matt Goldsmith took more than 150 seconds for that formula or terminated with an exception. Some important stats are summarized at the start. Click on the name of a formula to view details.

Summary

Satsolver: Matt Goldsmith
Rank: 40 / 118
Average Score: 6.56
Median Score: 0.29
Description: I used WalkSAT with a couple optimizations. I kept a list of unsatisfied clauses to speed up getting a random one and getting the number of unsatisfied clauses. In the algorithm, there is also a key-map object of symbols to clauses to reduce the time it takes to update the unsatisfied clause list after changing a symbol.
Generator Best solver Time taken Best time Unsat Best unsat
1bigwig:0 Andrew Werner 0.00 0.00 0 0
2bigwig:1 KingBach 0.00 0.00 0 0
3Bebe Shi:1 KingBach 0.00 0.00 0 0
4Bebe Shi:0 KingBach 0.00 0.00 0 0
5Ravi Tandon:1 KingBach 0.00 0.00 0 0
6R. A. B.:1 cat 0.00 0.00 0 0
7Ravi Tandon:0 KingBach 0.01 0.00 0 0
8BMJ:1 burrito 0.01 0.00 0 0
9K.L.:1 KingBach 0.01 0.00 0 0
10Joshua Zimmer:0 haoyu 0.01 0.00 0 0
11Miranda:1 cat 0.01 0.00 0 0
12Joshua Zimmer:1 haoyu 0.01 0.00 0 0
13Miranda:0 cat 0.01 0.00 0 0
14Tree Prophet:0 haoyu 0.01 0.00 0 0
15Happy:1 KingBach 0.01 0.00 0 0
16Daffy Duck:1 haoyu 0.01 0.00 0 0
17K.L.:0 haoyu 0.01 0.00 0 0
18David Paulk:1 Bar Shabtai 0.01 0.00 0 0
19David Paulk:0 cat 0.01 0.00 0 0
20Blam:0 Elphaba 0.01 0.00 0 0
21Jonathan Kwok:1 KingBach 0.01 0.00 0 0
22The Kraken:0 haoyu 0.02 0.00 0 0
23The Kraken:1 haoyu 0.02 0.00 0 0
24Quite Satisfied:0 haoyu 0.02 0.00 0 0
25Jameh:0 haoyu 0.02 0.01 0 0
26Gewang:1 Jonathan Kwok 0.02 0.00 0 0
27bchouGenerator:0 haoyu 0.03 0.00 0 0
28Solving For Clauses:0 Glenn Fisher 0.03 0.00 0 0
29Gewang:0 Jonathan Kwok 0.03 0.00 0 0
30Solving For Clauses:1 haoyu 0.03 0.00 0 0
31Jonathan Kwok:0 Elphaba 0.03 0.00 0 0
32Qinlan Shen:0 Bar Shabtai 0.04 0.01 0 0
33Jameh:1 haoyu 0.04 0.01 0 0
34AARON BURR, DROPPIN' HAMILTONS:1 haoyu 0.04 0.01 0 0
350108:1 haoyu 0.05 0.01 0 0
36Happy:0 haoyu 0.05 0.00 0 0
37George Okeowo:0 Andrew Grasso 0.05 0.01 0 0
38George Okeowo:1 Andrew Grasso 0.05 0.01 0 0
39vluu:0 Nihar the Great 0.06 0.01 0 0
40vluu:1 Nihar the Great 0.06 0.02 0 0
41cmF5a3ly:0 Nihar the Great 0.06 0.00 0 0
42cat:0 haoyu 0.06 0.03 0 0
43Mickey Mouse:0 Bar Shabtai 0.06 0.01 0 0
44Mickey Mouse:1 haoyu 0.06 0.01 0 0
45Alex Fish:0 haoyu 0.06 0.01 0 0
46Jordan Ash:1 Bar Shabtai 0.06 0.01 0 0
47weezy:0 Bar Shabtai 0.06 0.01 0 0
48weezy:1 Bar Shabtai 0.07 0.01 0 0
49kt4124:0 haoyu 0.07 0.03 0 0
50Nikhilesh Sigatapu:1 haoyu 0.07 0.04 0 0
51totallyOnFallBreak:0 Nikhilesh Sigatapu 0.07 0.01 0 0
52cat:1 haoyu 0.07 0.03 0 0
53Tree Prophet:1 haoyu 0.07 0.00 0 0
54Blam:1 Elphaba 0.07 0.00 0 0
55Boomshanka:0 haoyu 0.07 0.01 0 0
56Tiny Wings:0 haoyu 0.07 0.02 0 0
57Ytterbium:0 Andrew Grasso 0.07 0.02 0 0
58Anon5:1 Green "The Bean" Choi 0.07 0.07 0 0
59Alex Fish:1 haoyu 0.07 0.02 0 0
60Tiny Wings:1 haoyu 0.08 0.01 0 0
61cmF5a3ly:1 Nihar the Great 0.08 0.00 0 0
62R. A. B.:0 Nihar the Great 0.08 0.00 0 0
63Boomshanka:1 Bar Shabtai 0.08 0.01 0 0
64bchouGenerator:1 Jonathan Kwok 0.08 0.01 0 0
65totallyOnFallBreak:1 Nikhilesh Sigatapu 0.08 0.01 0 0
66kt4124:1 haoyu 0.09 0.04 0 0
67Sunny:0 Green "The Bean" Choi 0.09 0.02 0 0
68haoyu:1 Anon5 0.09 0.01 0 0
69Ytterbium:1 Nihar the Great 0.10 0.02 0 0
70Nikhilesh Sigatapu:0 haoyu 0.10 0.03 0 0
71haoyu:0 KingBach 0.10 0.01 0 0
72Jordan Ash:0 EC 0.10 0.03 0 0
73AARON BURR, DROPPIN' HAMILTONS:0 haoyu 0.10 0.00 0 0
74Keji Xu:1 Nihar the Great 0.10 0.04 0 0
75Mercury:1 haoyu 0.10 0.05 0 0
76Keji Xu:0 Nihar the Great 0.10 0.03 0 0
77The Whitman Whale:0 bigwig 0.10 0.04 0 0
78Lisa Kim:0 Aristotle 0.10 0.07 0 0
79Scheduling Generator 203:0 jgs 0.11 0.01 0 0
80Sprt:1 haoyu 0.11 0.05 0 0
81The Whitman Whale:1 Andrew Grasso 0.11 0.03 0 0
82bfang:0 haoyu 0.12 0.04 0 0
83BMJ:0 Elphaba 0.12 0.00 0 0
84Daffy Duck:0 Andrew Werner 0.13 0.00 0 0
85KingBach:0 haoyu 0.13 0.06 0 0
86Sunny:1 jabreezy 0.13 0.01 0 0
87Lisa Kim:1 Bar Shabtai 0.13 0.06 0 0
88Mercury:0 haoyu 0.14 0.05 0 0
89Janie Gu:1 Jonathan Kwok 0.14 0.07 0 0
90DinnerPartyPlannerBM:1 Nihar the Great 0.15 0.06 0 0
91Khoa:1 Aristotle 0.15 0.09 0 0
92Samuel Jerome:0 haoyu 0.15 0.03 0 0
93KingBach:1 haoyu 0.15 0.04 0 0
94Sprt:0 Aristotle 0.16 0.11 0 0
95Anon_K_P:0 haoyu 0.16 0.02 0 0
96Janie Gu:0 Glenn Fisher 0.16 0.07 0 0
97Khoa:0 haoyu 0.17 0.09 0 0
98Sally Smith:1 haoyu 0.17 0.04 0 0
99Yacob Y.:0 haoyu 0.18 0.06 0 0
100bfang:1 haoyu 0.18 0.04 0 0
101Aaron H:0 Aristotle 0.19 0.11 0 0
102Sally Smith:0 haoyu 0.20 0.04 0 0
103BH:0 haoyu 0.20 0.07 0 0
104Aaron H:1 Aristotle 0.21 0.11 0 0
105Anon_K_P:1 Aristotle 0.22 0.03 0 0
106Lil Thug:1 Andrew Grasso 0.23 0.03 0 0
107burrito:0 haoyu 0.24 0.09 0 0
108BH:1 haoyu 0.24 0.05 0 0
109Mr. Blobby:0 Green "The Bean" Choi 0.26 0.14 0 0
110Batman:0 haoyu 0.26 0.04 0 0
111EC:1 haoyu 0.26 0.03 0 0
112EC:0 haoyu 0.28 0.03 0 0
113ebp:1 haoyu 0.29 0.04 0 0
114Walter Little:1 haoyu 0.30 0.03 0 0
115DinnerPartyPlannerBM:0 Aristotle 0.30 0.11 0 0
116Matt Haake:1 haoyu 0.31 0.05 0 0
117dfshasdsf12:0 haoyu 0.31 0.09 0 0
118Samuel Jerome:1 haoyu 0.31 0.03 0 0
119Tom T:1 Andrew Werner 0.31 0.02 0 0
120Scheduling Generator 203:1 Jameh 0.32 0.02 0 0
121ebp:0 haoyu 0.32 0.04 0 0
122Tom T:0 EC 0.32 0.02 0 0
123Glenn Fisher:0 Elphaba 0.34 0.02 0 0
124NA:0 haoyu 0.35 0.03 0 0
125Lil Thug:0 Andrew Grasso 0.35 0.03 0 0
126David Lackey:1 Bar Shabtai 0.35 0.03 0 0
127Andrew Werner:1 haoyu 0.37 0.11 0 0
128nupog:0 Aristotle 0.38 0.13 0 0
129John Whelchel:0 haoyu 0.39 0.06 0 0
130David Lackey:0 Anon5 0.39 0.03 0 0
131nupog:1 Aristotle 0.39 0.12 0 0
132Fanny:1 Aristotle 0.40 0.12 0 0
133soccer:0 haoyu 0.40 0.04 0 0
134Shaheed Chagani:1 Aristotle 0.42 0.11 0 0
135Tao:1 Aristotle 0.43 0.07 0 0
136Matt Haake:0 haoyu 0.44 0.05 0 0
137John Whelchel:1 haoyu 0.45 0.11 0 0
138jgs:1 haoyu 0.46 0.18 0 0
139burrito:1 haoyu 0.46 0.10 0 0
140jgs:0 Aristotle 0.46 0.12 0 0
141dfshasdsf12:1 Nihar the Great 0.47 0.11 0 0
142Andrew Grasso:1 Shaheed Chagani 0.47 0.15 0 0
143Batman:1 haoyu 0.47 0.04 0 0
144Charliezsc:1 haoyu 0.49 0.07 0 0
145DeeEmEm:1 haoyu 0.50 0.02 0 0
146Ben Chen:0 Elphaba 0.52 0.07 0 0
147Andrew Werner:0 Aaron Doll 0.53 0.33 0 0
148Shaheed Chagani:0 Aristotle 0.69 0.17 0 0
149snowflakes:1 haoyu 0.69 0.03 0 0
150Tao:0 Bar Shabtai 0.72 0.02 0 0
151Ben Chen:1 spl 0.79 0.20 0 0
152Elphaba:0 Aristotle 0.88 0.24 0 0
153jabreezy:0 Mercury 0.89 0.09 0 0
154jabreezy:1 Mercury 0.90 0.10 0 0
155soccer:1 haoyu 0.91 0.04 0 0
156Anon5:0 haoyu 0.99 0.05 0 0
157David H.:0 AFC 1.09 0.28 0 0
158NA:1 Elphaba 1.16 0.04 0 0
159David H.:1 DeeEmEm 1.16 0.33 0 0
160Mr. Blobby:1 dusty 1.19 0.12 0 0
161Walter Little:0 haoyu 1.27 0.04 0 0
162Elphaba:1 Aristotle 1.29 0.22 0 0
163Linda:0 Andrew Grasso 1.45 0.01 0 0
164Valya Barboy:1 Shaheed Chagani 1.64 0.18 0 0
165Mike Hunt:1 Aristotle 1.72 0.29 0 0
166Fanny:0 Aristotle 3.05 0.10 0 0
167Mike Hunt:0 Aristotle 3.24 0.27 0 0
168snowflakes:0 haoyu 3.47 0.03 0 0
169Glenn Fisher:1 jabreezy 3.48 0.09 0 0
170Dr Roberto:1 Andrew Grasso 4.25 0.02 0 0
171Linda:1 Andrew Grasso 4.57 0.02 0 0
172Valya Barboy:0 Aristotle 4.83 0.06 0 0
173Andrew Grasso:0 Aaron Doll 5.56 0.18 0 0
174CAPS LOCK:0 Aristotle 5.82 0.20 0 0
175Aaron Doll:0 Aristotle 5.91 0.56 0 0
176Dr Roberto:0 Andrew Grasso 6.03 0.03 0 0
177Matt Goldsmith:0 Nihar the Great 9.17 0.03 0 0
178Matt Goldsmith:1 Happy 10.34 0.03 0 0
179T. Capote:0 haoyu 15.00 0.00 2 2
180T. Capote:1 haoyu 15.00 0.00 2 2
181Mark S. Fillmore:1 Supahaka 15.00 0.04 79 79
182Mark S. Fillmore:0 Supahaka 15.00 0.01 116 116
183Bar Shabtai:1 haoyu 15.00 0.12 1 0
184CookieMonster:0 CookieMonster 15.00 0.82 1 0
185Jessie Chen:0 Joel Faron 15.00 0.13 2 1
186Jessie Chen:1 Joel Faron 15.00 0.12 2 1
187Deric Cheng:1 jgs 15.00 14.98 2 1
188Deric Cheng:0 jgs 15.00 14.99 2 1
189Brendan Wright:1 Deric Cheng 15.00 0.10 2 0
190Qinlan Shen:1 R. A. B. 15.00 9.00 3 1
191Charliezsc:0 jgs 15.00 14.98 3 1
192DeeEmEm:0 CAPS LOCK 15.00 13.00 3 1
193CookieMonster:1 CookieMonster 15.00 1.10 3 0
1940108:0 jgs 15.00 14.98 4 1
195Quite Satisfied:1 Joel Faron 15.00 2.11 5 1
196AFC:1 Aristotle 15.00 0.16 6 0
197Aristotle:0 Aristotle 15.00 15.00 7 1
198Dusty:1 Shaheed Chagani 15.00 0.22 10 0
199SuperFan:0 jgs 15.00 14.98 11 4
200SuperFan:1 jgs 15.00 14.98 11 4
201AFC:0 CookieMonster 15.00 0.34 13 0
202Absurdity:1 Aristotle 15.00 0.18 14 0
203Yacob Y.:1 Aristotle 15.00 15.00 15 1
204Aaron Doll:1 Aristotle 15.00 1.27 16 0
205Absurdity:0 Aristotle 15.00 0.23 17 0
206Sabar Dasgupta:0 spl 15.00 0.23 20 0
207spl:0 Elphaba 15.00 0.09 20 0
208Dusty:0 CookieMonster 15.00 1.39 22 0
209Sabar Dasgupta:1 Aaron Doll 15.00 0.17 22 0
210spl:1 haoyu 15.00 0.06 25 0
211Andys:0 Aristotle 15.00 0.12 40 0
212Yan Wu:0 haoyu 15.00 0.05 40 0
213Supahaka:0 Andrew Werner 15.00 15.00 46 35
214Andys:1 Aristotle 15.00 0.13 48 0
215Supahaka:1 Joel Faron 15.00 15.00 48 35
216Yan Wu:1 haoyu 15.00 0.04 70 0
21713a:0 Aaron Doll 15.00 15.00 82 21
21813a:1 Aaron Doll 15.00 15.00 88 29
219Aristotle:1 Aristotle 15.00 9.69 6 0
220CAPS LOCK:1 Aristotle 15.01 0.25 113573 0
221Bar Shabtai:0 Aaron Doll 15.06 15.01 1277213 1
222Brendan Wright:0 haoyu 40.80 0.10 40 0
223Nihar the Great:0 Aristotle 65.31 0.23 1000 0
224Nihar the Great:1 Aristotle 76.48 0.25 1000 0
225Bob Dondero:0 Andrew Grasso 117.83 0.02 10 0
226Bob Dondero:1 Mickey Mouse 137.28 0.03 10 0
227Mike Honcho:0 Miranda - 0.01 - 0
228Mike Honcho:1 Jessie Chen - 0.01 - 0


SatSolvers Ranklist Generators Ranklist