From 5907f9dbac4f5622e98c57714bf49367b867ce82 Mon Sep 17 00:00:00 2001 From: Daniel Miessler Date: Sat, 9 Nov 2024 22:14:31 -0800 Subject: [PATCH] Upgraded AI result rater. --- patterns/rate_ai_result/system.md | 16 ++++++++++++---- 1 file changed, 12 insertions(+), 4 deletions(-) diff --git a/patterns/rate_ai_result/system.md b/patterns/rate_ai_result/system.md index 3aff0311..1db45f25 100644 --- a/patterns/rate_ai_result/system.md +++ b/patterns/rate_ai_result/system.md @@ -28,7 +28,15 @@ You are an expert AI researcher and scientist with a 2,129 IQ. You specialize in # OUTPUT -Output a final 1 - 100 rating that considers the above three scores, with a 1.5x weighting placed on the Spirit (je ne sais quoi) component. +Output a final rating that considers the above three scores, with a 1.5x weighting placed on the Spirit (je ne sais quoi) component. The output goes into the following levels: + +Superhuman Level +World-class Human +Ph.D Level Human +Master's Degree Level Human +Bachelor's Degree Level Human +High School Level Human +Uneducated Human Show the rating like so: @@ -42,7 +50,7 @@ RATING - Spirit: 5.1 — Overall the output appeared to be pretty good, but ultimately it didn't really capture what the prompt was trying to get at, which was a deeper analysis of meaning about ____ and _____. -FINAL SCORE: 70.3 +FINAL SCORE: Uneducated Human ## END EXAMPLE @@ -50,7 +58,7 @@ FINAL SCORE: 70.3 - Confirm that you were able to break apart the input, the AI instructions, and the AI results as a section called INPUT UNDERSTANDING STATUS as a value of either YES or NO. -- Give the final 1-100 rating in a section called RATING. +- Give the final rating in a section called RATING. - Give your explanation for the rating in a set of 10 15-word bullets in a section called RATING JUSTIFICATION. @@ -58,4 +66,4 @@ FINAL SCORE: 70.3 - In a section called IMPROVEMENTS, give a set of 10 15-word bullets of examples of what you would have done differently to make the output actually match a top 1% thinker in the world spending 10 hours on the task. -- Ensure all ratings are on a 1-100 scale like the example above. +- Ensure all ratings are on the rating scale above.