Artificial Intelligence

1770 readers

4 users here now

Welcome to the AI Community!

Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

Be kind and respectful.
Share high-quality contributions.
Stay on-topic.
Enhance accessibility.
Verify information.
Encourage meaningful discussions.

You can access the AI Wiki at the following link: AI Wiki

Let's create a thriving AI community together!

founded 2 years ago

MODERATORS

ikidd@lemmy.world

Rethinking how we measure AI intelligence (blog.google)

submitted 2 days ago by PlanterTree@discuss.tchncs.de to c/ai_@lemmy.world

1 comments fedilink hide all child comments

Let the AIs play games against each other. The resulting leader board is more precise than benchmarks?

you are viewing a single comment's thread
view the rest of the comments

[–] PlanterTree@discuss.tchncs.de 2 points 2 days ago* (last edited 2 days ago)

The funny thing: Afaik the LLMs are terrible at chess vs purpose trained chess AI. https://dynomight.net/more-chess/

Often suggests illegal chess moves.

You are a chess grandmaster. You will be given a partially completed game. After seeing it, you should choose the next move. Use standard algebraic notation, e.g. "e4" or "Rdf8" or "R1a3". NEVER give a turn number. NEVER explain your choice.