this post was submitted on 15 Aug 2023
86 points (89.8% liked)

Technology

70711 readers
3437 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

ChatGPT Isn't as Good at Coding as We Thought::undefined

top 37 comments
sorted by: hot top controversial new old
[–] drkt@feddit.dk 50 points 2 years ago (1 children)

Who are 'we'? Surely not anyone who's ever used it?

[–] daikiki@lemmy.world 34 points 2 years ago* (last edited 2 years ago) (5 children)

I've experimented a bit with chatGPT, asking it to create some fairly simple code snippets to interact with a new API I was messing with, and it straight up confabulated methods for the API based on extant methods from similar APIs. It was all very convincing, but if there's no way of knowing that it's just making things up, it's literally worse than useless.

[–] sheogorath@lemmy.world 9 points 2 years ago

ChatGPT has been helpful in being an interactive rubber duck. I used it to help myself breakdown the technical problems that I need to solve and it helps to cut down time taken to complete a difficult ticket that usually take a couple of days of work to a couple of hours.

[–] fluxion@lemmy.world 5 points 2 years ago

"just good enough to be dangerous"

[–] tbonebrad@lemmy.world 4 points 2 years ago* (last edited 2 years ago)

I’ve had similar experiences with it telling me to call functions of third party libs that don’t exists. When you tell it “That function X does not exist” it says “I’m sorry, your right fucking X doesn’t not exist on library A. here is another example using function Y” then function Y doesn’t exist either.

I have found it useful in a limited scope, but I have found co-pilot to be much more of a daily time saver.

[–] abhibeckert@lemmy.world -5 points 2 years ago* (last edited 2 years ago)

So? Those mistakes will come up in testing, and you can easily fix them (either yourself, or ask it to do it for you, whichever is faster).

I regularly ask ChatGPT to write code against classes/functions that didn't exist until earlier today when I wrote those APIs. Obviously the model doesn't know those APIs... but it doesn't matter, you can just paste the function list or whole class definitions in and now it does know they're there and will use them.

[–] JoBo@feddit.uk 22 points 2 years ago (1 children)

As who thought? There have been examples of wonky code being posted since the day it went live.

[–] Jagger2097@lemmy.world 4 points 2 years ago* (last edited 2 years ago)

That wonky code went into thousands of wonky scripts that barely work. People got promoted and the next fool gets to debug in ChatGPT5 or whatever

[–] shotgun_crab@lemmy.world 19 points 2 years ago* (last edited 2 years ago) (1 children)

I always thought of chat gpt as a "companion tool" that isn't meant to write good code by itself, but to help experienced programmers write good code (just like search engines and documentation)

[–] ratz@chatsubo.hiteklolife.net 6 points 2 years ago

Have you used it for this lately?

I want to believe it used to be okay for this, but just yesterday I uses it to generate some pretty basic bash and I'm honestly not convinced it saved me any time after I cleaned it all up and actually made it functional

[–] turkalino@lemmy.yachts 17 points 2 years ago (2 children)

I asked it to write a bash script which simply read a couple inputs using readline and then ran a couple commands inside an if/else

It declared a variable that it never used. I pointed out the mistake and asked to remove the line. It simply renamed the variable.

I’d trust an unpaid intern more

[–] fluxion@lemmy.world 7 points 2 years ago

Hah hah... What a dummy!

discreetly pushes his unused variables under desk with his foot

[–] Ib_dI@lemm.ee 2 points 2 years ago

An unused variable!?

/clutches_pearls

[–] Alexstarfire@lemmy.world 14 points 2 years ago

I thought it was terrible. Is it worse than that?

[–] Cyo@lemmy.world 9 points 2 years ago

It can be useful for basic coding or to answer questions like 'Is there any way to do X thing in Javascript?' I were talking about it with some classmates , they said the same. There was one program I was doing on my own with Js & Html (I'm still learning) and for relying to much on GPT without much knowledge I ended up "walking on circles" for 6 Hours without any progress. It is good for giving some information and sometimes finding a bug, but never, never use it as if it were capable of doing everything. It's a tool, not a programmer.

[–] ricecooker@lemmy.world 6 points 2 years ago

I used it extensively to help me code my PHP for an art portfolio site. Briefly thought about using 11ty but needed to put something up quick after being laid off and I knew PHP.

For the most part it was good. It was really good at creating simple functions for me. My issue came when I asked it to build me a JS lightbox in Bootstrap. i wanted it to look a certain way so I had to edit my prompt multiple times because it would edit the code and "forget" my previous modification. Ended up using someone else's JS code.

It was incredibly frustrating. It's powerful, but still limited.

[–] mintiefresh@lemmy.ca 6 points 2 years ago (1 children)

So so good for regex though.

[–] MKBandit@lemmy.world 3 points 2 years ago

And SQL queries

[–] alphacyberranger@lemmy.world 5 points 2 years ago

It's like a rookie programmer or an intern at best. There has been times it has been really helpful though.

[–] _e____b@lemmy.world 5 points 2 years ago

I don't know how others are using chatGPT for coding, but I found I get the best results when starting small and iterate over the results few times. Like:

  1. write a function to make a GET request;
  2. write a function to handle this example JSON;
  3. write a function that combines the first two;
  4. etc etc

I use it mostly for Typescript, Bash and Clojure and results vary from good to OK (Clojure). The whole process is way faster if you use a tool like sGPT.

[–] tonytins@pawb.social 4 points 2 years ago

Shouldn't ChatGPT's code be used as a template, anyway?

[–] mom@discuss.tchncs.de 3 points 2 years ago

I would say is really capable at HELPING a human with coding tasks, but I found it to be kind of limited and sort of dumb. For example I was able to creare in Flask a “Ticket Management System” Web-App just for fun, but I had to do 90% of the work, and I had to be very specific along every step to make sure the output would do what I wanted and I had to provide very technical details that a beginner won’t really know. I think in the future we will have more capable tools that will create better apps without too much human interaction.

Whoever thought it was good at coding? That's not what it's designed for. It might get lucky and spit out somewhat functional code sometimes based on the prompt, but it never constructed any of that itself. Not truly. It's conceptually Googling what it thinks it needs, copying and pasting together an answer that seems like it might be right, and going "Here, I made this". It might be functional, it might be pure garbage. It's a gamble.

You're better off just writing your own code from the beginning. It's likely going to be more efficient anyways, and you'll properly understand what it does.

[–] 1984@lemmy.today 0 points 2 years ago

It's fine. I've been using it for all sorts of languages. Some issues with rust though, but that's because I'm a newbie and I can't fix the errors chatgpt is producing.

Python, go, terraform.. All great.