COS435
Spring 2008
Problem Set 3, Problem 2: Google
versus Yahoo
Results
|
Q1 |
|
Q2 |
|
Q3 |
|
Q4 |
|
Q5 |
|
|
Google |
Yahoo |
Google |
Yahoo |
Google |
Yahoo |
Google |
Yahoo |
Google |
Yahoo |
Student 1
|
1 |
1 |
1 |
0.7 |
0.9 |
0.75 |
0.971 |
0.825 |
0.76 |
0.64 |
Student 2
|
0.4 |
0.2 |
0.3 |
0.3 |
0.21 |
0.32 |
0.58 |
0.42 |
0.4 |
0.6 |
| Student 3 |
0.6 |
0.6 |
0.5 |
0.6 |
0.3 |
0.45 |
0.644 |
0.602 |
0.5 |
0.75 |
| Student 4 |
0.4 |
0.4 |
0.4 |
0.5 |
0.45 |
0.55 |
0.5037 |
0.6499 |
0.7692 |
0.8462 |
| Student 5 |
0.2 |
0.2 |
0.2 |
0.2 |
0.4 |
0.1 |
0.169 |
0.06 |
0.9 |
0.2 |
| Student 6 |
0.8 |
0.6 |
0.5 |
0.5 |
0.5 |
0.45 |
0.595 |
0.524 |
0.588 |
0.529 |
| Student 7 |
0.4 |
0.4 |
0.3 |
0.4 |
0.25 |
0.3 |
0.52 |
0.5 |
0.5 |
0.6 |
| Student 8 |
0.8 |
0.6 |
0.6 |
0.7 |
0.55 |
0.5 |
0.729 |
0.741 |
0.4 |
0.333 |
| Student 9 |
0.8 |
0.4 |
0.8 |
0.2 |
0.65 |
0.3 |
0.78 |
0.4 |
0.81 |
0.38 |
| Averages |
0.6 |
0.488889 |
0.511111 |
0.455556 |
0.467778 |
0.413333 |
0.610189 |
0.524656 |
0.625244 |
0.542022 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Legend:
Q1: Precision at rank 5
Q2: Precision at rank 10
Q3: Precision at rank 20
Q4: Average over the precisions at each point that a relevant
document appears in the first 20
Q5: Precision at rank 30 (None of the results yielded 100%
recall by rank 30.)
Comment: the Q4 number
(average over the precisions at each point
that a relevant
document appears in the first 20) is only informative in conjunction
with the Q3 number (precision at rank 20) because otherwise one cannot
distinguish very few relevant results but highly ranked from more
relevant results but with more mediocre rankings. Also the Q4
numbers for Student 5 are outliers and may have been transcribed
incorrectly.
