AI Coding

54 readers

6 users here now

A community to discuss AI assisted coding.

founded 2 weeks ago

MODERATORS

codeinabox@programming.dev

Evaluating AGENTS.md: Are Repository-Level Context Files Helpful for Coding Agents? (arxiv.org)

submitted 3 days ago by codeinabox@programming.dev to c/aicoding@programming.dev

1 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] codeinabox@programming.dev 1 points 3 days ago

The conclusion aligns with my own belief, which is that it's better to create a minimal context by hand than get agents to create it:

We find that all context files consistently increase the number of steps required to complete tasks. LLM-generated context files have a marginal negative effect on task success rates, while developer-written ones provide a marginal performance gain.

When I have got Claude to create a context, it's been overly verbose, and that also costs tokens.