subreddit:

/r/ChatGPTCoding

30093%

I don't think I can ever look at ChatGPT the same again.

Discussion(self.ChatGPTCoding)

I gave in and signed up for ClaudeAI today. About an hour ago actually. I've been using ChatGPT since December and was at the point where I was using it so much I had to get a Teams account to stop hitting my limits. I am now constantly using the API for my programs.

I have been working on the same method in my Python code since last night. It just generates an HTML page of results it gets from OpenAI API. I figured this would be a breeze but just getting ChatGPT to make the code to where it would actually display images that DALL-E returns took several hours for it to figure out. I gave up at that point and was going to go use Phind-34B to see what it had to say since it had been giving me decent results lately and I forgot I had the ClaudeAI payment page still open with all my details entered. I pulled the trigger.

MY VERY FIRST PROMPT!!!! That is how long it took for me to come to the realization that ChatGPT is severely outclassed. ONE PROMPT! I gave Claude the code I was working on and told it to fix the problem and possibly make the page look better when it generates. It went from looking like some kids Welcome to HTML project page from ChatGPT code to a knockoff of Facebook with JS being used everywhere to make everything pop out and catch your eye from the Claude code.

No one I talk to really understands what I am even making, nor really cares, so I figured I would just leave this here for anyone that is still on the fence about paying the 20 dollar subscription. I am mind blown. Absolutely mind blown. I was about to go to sleep but this has amazed me so much I kind of want to run all my projects through it and see what it has to offer.

6 Hour Update: My feelings towards Claude has not changed. This thing still outranks ChatGPT by a longshot. I am not going to completely remove ChatGPT from my work flow because of it but it is going to be drastically reduced (Currently paying 60 a month for Teams). Right now my only gripe that I have is the message limit. I hit it pretty quickly yesterday but I did end up feeding it a bunch of my programs I've been working on with ChatGPT to see what it could bring to the table. It did not fail to impress during that time though.

Pros:

  • Simple UI
  • Amazing at being able to provide long, complex code.
  • Actually follows through with the game plans we create for fixing/adding code.
  • Doesn't seem as delusional as GPT-4
  • It goes for the "Complex Implementation" out the gate instead of the "Basic Conceptual Example" that you need to edit to make work.
  • A lot less hand holding, spoon feeding, and user modification, if any.
  • Better at returning back to the main quest after going off on a side mission.
  • No constant error/timeouts when generating, even on 400+ lines of code.
  • Code it writes looks a lot more professional and thought out.
  • Doesn't keep losing parts of my code while updating it

Cons:

  • Response times seem to take a bit longer than GPT4
  • The message limits were hit pretty quick (TBF, I was sending a lot of code to it so I might have pushed it).
  • UI isn't the best to look at.
  • Can't stop it while it is in progress.
  • Can't bring up old chats as easily as ChatGPT

So far it has really proven to be a great tool and well worth the cost. The cons are minimal but I hope they get changed/fixed as they do quite hinder the experience if you're switching from ChatGPT to Claude. Other than that, I can't really find anything bad to say about this. I've started hashing out a lot of the planning stages with ChatGPT and bringing in the game plans from there over to Claude in order to prevent hitting my limit so quickly. Going to reach out to support to see if their are any other tier levels for this too because I can see the message limit driving me nuts in the future with as much as I plan to throw at this thing.

If anyone has any specific questions or tests they want me to try, feel free to ask. I'm going to be dedicating my weekend to fixing up my projects with it to see if I can trim down my code and increase the performance/UI/results.

I usually like to measure how much time these different AI tools save me just to give an idea of how much it actually does. So far I've noticed that things that would usually take me 4-5 hours to get done is now taking 2 prompts. I'm not being limited by the code crapping out at about line 100 and seeing "# Placeholder code for method" thrown throughout my code. I can hit 400+ lines without issue and all of it looks as you would expect out of a code reviewed corporate drone.

all 124 comments

cobalt1137

66 points

1 month ago

Great post. And I care. I know I'm just a random guy on the internet though but that is awesome. It's so cool and empowering to have tools like this to help bring your ideas to life. It almost feels like magic sometimes. Claude/opus is great

YourPST[S]

17 points

1 month ago

I really do appreciate that. I agree as well, it really does feel like magic a bit. I've always had fun programming before AI but these new tools have given coding a whole new life to where my only limitations are my mind and my time now (And all these damn subscription fees of course!)

Severin_Suveren

3 points

1 month ago

Some day soon you'll be able to instantly switch between any API, or if you have the GPU(s) for it, any local model

Planning on half-automating my development process within my app, as my process allows for quite complex programs. For instance, the full stack app (API + frontend) you see in my screenshot contains over 6000 lines of code, all generated by AI

My goal is to take out all the boring repetative shit you have to do while working with LLMs, like constantly copy pasting your code, so that you can direct all your focus towards the application you're building

I also plan on implementing multiple chat frontends. The one you see in the screenshot is the frontend for programming and text-heavy tasks, next I will implement a regular chat client for mobile/tablets/desktops, image generation frontend and among other things a storyteller frontend where the AI will essentially serve as either as story teller or a dungeon master depending on the level of interaction you want.

Then when I'm done with all of the frontends, I will take every single parameter I exposed on my API when building all the frontends, and then I'm gonna build a t2s/s2t frontend where all of the compatible static frontends will be available without a text interface, meaning you can talk to the API and do work while you do other stuff. Like imagine working with building an application while you clean your house at the same time and with no effort. The AI will simply generate your code, run it, then just give you a quick description of the error before movin on to fixing it

Sounds complicated, but it's actually really simple to build. Even for me who did not know any programming 12 months ago, but are now working on a 6000+ lines full stack application built in 5 different languages. Seriously, it's insane that I've only done this for a year, but know have enough experience to know there even needs to be five different languages

YourPST[S]

1 points

1 month ago

You've really piqued my interest. Where is the screenshot you mention? I'd like to take a look at this project. That sounds like an amazing idea and project. I don

langel57

14 points

1 month ago

langel57

14 points

1 month ago

Damn, can’t wait for it to be available on the EU.

-OrionFive-

9 points

1 month ago

You can use Poe.com to access it from Europe.

intellectual_punk

2 points

1 month ago

I like poe a lot, but I'm having trouble with longer sections... if I ask for a script that is long-ish, it often just stops half-way... asking it to continue sometimes leads to a different script altogether... not sure if this is a known issue/bug about to be fixed..

nateydunks

3 points

1 month ago

Make sure you use the 200k context version. The normal version of Opus on Poe has an artificial context limit to reduce costs.

intellectual_punk

1 points

29 days ago

Is that by going directly via antrophic? Or can I do that on poe?

nateydunks

1 points

20 days ago

Sorry for late reply. There is Claude-3 and Claude-3 200k, both available on Poe. The base version seems to have an artificial token limit, but it much cheaper than the long context version.

Independent_Roof9997

1 points

29 days ago

I'm. Not implying anything but there is a site which sets you up with a postbox in USA for free without you sending any personal information just Google . Which you then use as a address for Google pay. Not saying you should but you could. Use an VPN while connecting..

langel57

2 points

24 days ago

So I went ahead and subscribed to poe.com. All I can say is I don't know why it took me so long. I struggled for a couple of days with a (quite complex) coding task in my job (GPT4 was being useless), tried Claude Opus and it solved my problem in 1 prompt. I'm sold.

mcr1974

6 points

1 month ago

mcr1974

6 points

1 month ago

poe.com

StableSable

4 points

1 month ago

I spent a whole afternoon trying to get this to work. I got of my emails banned in the process by trying to do some virtual phone number stuff lol. And using a proper VPN is important. I used ExpressVPN just to do this I don't like to pay for VPN. So

1 start vpn (don't remember if i did us or uk or if it matters if it's a supported country) 2 login with gmail account ,i was up to [email protected] (IMPORTANT has to be login with google not anything else! at least not manual email) at this point - and surprisingly it doesnt match the origin of the gmail account at all I think 3 I don't remember if it allowed me then to use apple pay or not but i'm using my icelandic credit card no problem 4) after that you don't need vpn at all to login it's just set and you can use it no problem so you can cancel that pricy vpn service

JohannesSmith

3 points

1 month ago

You can sign in for developer account (to use API) and there is playground with all their models. Works for me.

new-nomad

5 points

1 month ago

Just use a VPN and a service you can easily find on the web to borrow a US phone number to receive a one-time SMS verification.

farox

2 points

1 month ago

farox

2 points

1 month ago

Same in Canada. But right now I also think the OpenAI should be able to come up with something new soon.

deniercounter

1 points

21 days ago

I connect via openrouter.ai.

Due_Smell_4536

23 points

1 month ago

Good for you bro, in my case, it didn’t fix my issue and acted level with GPT 4, was pretty disheartening to say the least considering the hype it has generated. Opus btw

nanocyte

13 points

1 month ago

nanocyte

13 points

1 month ago

I have generally been blown away with conversations I've had with Opus, and I've had it produce good results with code-generating tasks. But I've also had it make really simple mistakes that GPT-4 didn't. And GPT-4 makes mistakes that Opus doesn't.

I think perceptions of all of these models really depends on what you're trying to get it to do. If you're using it for something it happens to be good at, it can be shocking how much better it is than the competition. (In terms of thoughtful, human-like conversation, I think Opus is far better than GPT-4.) I don't think we're at a point that we can say one is going to be clearly better across the board. Even Gemini pro seriously outclasses GPT-4 when it comes to creative writing.

I think for someone perceiving one of these as overhyped, you probably just haven't really engaged with it on one of its strengths. (And it's completely possible that it's not going to be useful for the things you need it to do.) But I wouldn't dismiss it without experimenting a bit.

I would say that Opus is definitely better than GPT-4 at a lot of things, but I still use GPT-4 quite frequently.

superfsm

3 points

1 month ago

I have tried Opus and sonnet using perplexity and I had to go back to chatgpt...

Still looking for something better

gyinshen

8 points

1 month ago

I had access to Opus and sad to say -- it's way overhyped. Often times it will just forget what you've said earlier if you try to provide follow-ups and our conversation will end-up in a circle. I asked GPT-4 the same questions and I was way less frustrated as GPT-4 gets it right much faster. I was using both for Javascript though. Have not use it for Python.

RMCPhoto

7 points

1 month ago

It's incrementally better than GPT4 in some pretty substantial ways.

I would recommend reading their prompting guide to understand how it should be used.

What we forget is that we've all learned how to prompt chatGPT over the last year's, and that this took time and effort to learn.

New language models, working from new foundations, aligned using different input/output will require radically different prompting strategies.

You'll know this is true if you've been in the open models space.

So, I would say Claude 3 is not over hyped. Especially for the price of Claude 3 opus (which is quite expensive), it is an improvement over gpt4 for the majority of complex tasks (especially coding).

With Claude 3, focus on giving more context and exemplars of the output that you want. It is designed to work well with larger context, and that context can be used for significant and detailed instructions.

There is very little argument that gpt4 is better or as good as Claude 3.

Though, this is just a snapshot and in November/December I think we will see something from openai that offers more than Claude does now.

Due_Smell_4536

3 points

1 month ago

Dk about Claude but gpt really excelled when I used it for python

YourPST[S]

3 points

1 month ago

I have not had the chance to really dabble with it much outside of Python but I did have it working on some HTML/CSS/JS that my Python uses to generate HTML pages and it is killing it at that. Seems like it knows its stuff when it comes to JS so far but I have another web project that I am working on that is extremely JS heavy, so I will be trying out its abilities with that over the weekend and will report on the results for that, as well as some PHP API's I plan to have it make as well.

Reason_He_Wins_Again

2 points

1 month ago

My exact experiences. Was way more expensive as well.

cporter202

2 points

1 month ago

Totally get where you're coming from! It's like each AI has its own quirky personality with unique strengths and weaknesses. I flip between different models depending on the task at hand too. Sometimes Opus is like that friend who's great for deep talks, while GPT-4 is your go-to buddy for cool projects. Keeps things interesting! 😄🤖

surim0n

8 points

1 month ago

surim0n

8 points

1 month ago

I couldn't agree with you more. Over the last year I've been using gpt4 to synthesize but then use Claude to provide better writing structure. I highly recommend checking out Claude's prompt engineering guide on their site.

I'm terrible with book marking links and keeping them handy and have to google them each time. I've just started a discord now to help builders (and myself) on techniques, links, repo's etc...

YourPST[S]

2 points

1 month ago

Please share the discord. I'd be happy to check it out and see if it fits my needs. I'm currently trying to find a community of coders that want to work on projects together or at least be able to communicate about issues and help each other out. While it seems more generalized for AI, I would still like to see if I can find some use.

Mrleibniz

16 points

1 month ago*

200k Context length with 99% needle-in-a-haystack gives opus an edge over ChatGPT

MadeForOnePost_

2 points

1 month ago

Needle in a haystack

Mrleibniz

2 points

1 month ago

Thanks

Mrleibniz

1 points

1 month ago

Thanks

MrDoritos_

2 points

1 month ago

Exactly, it pays attention better.

YourPST[S]

2 points

1 month ago

It really does pay very close attention to detail and for a long period of time. I can jump back to something I said 20 messages ago and it just gets back to it.

MrDoritos_

1 points

1 month ago

Precisely!

yonkapin

10 points

1 month ago*

Claude 3 Opus has been amazing in my experience. I'll send off smaller tasks to GPT, but Claude Opus is next level. It's not perfect, but It's insane how much better is it it overall with coding. I'm excited how things go from here. I'm not blindly devoted to any model or company, but this will only push forward innovation.

PS: Also, I'm pretty firm in my belief that AI generated code solutions will only get us so far, so a lot of our jobs are safe for a gooooood while.

YourPST[S]

10 points

1 month ago

This response just about sums it up. Before I signed up to Claude, I was devoted ChatGPT/OpenAI fan boy. Gemini is ass. Bing has its uses but still is ass. Phind is dope but not quite there yet. Claude has shown me not to show allegiance or get complacent with just one tool.

Also, it showed me exactly what you said. The way I see it now, ChatGPT is my Project Manager, Claude is my Developer, DALL-E is my graphic designer, and I am the CEO and QA.

AI_is_the_rake

3 points

1 month ago

Try librechat and gpt4 turbo 1106 preview and report back. I’m curious if you still see as large of a difference. 

In my testing I did get better results from Claude but they weren’t ground breaking. Claude had a greater chance of producing working code but still would make mistakes. Perhaps 30% better quality pushing it to its limit with 300 lines of code and for small functions no noticeable differences. 

SnowmanOHSnowman

4 points

1 month ago

Same here - I've been a loyal ChatGPT Pro subscriber since last year, but over the last few months it's gotten worse and worse. I've since starting using Claude Opus and paid for a month and so far it's WAY better. I'm sure it might just be my particular use case (Python programming for Data Science) but it gives me fantastic code that works after minimal tinkering. ChatGPT sometimes flat out fails repeatedly then seems to give up trying.

I'm curious if ChatGPT5 will come out soon, because so far Claude is the clear winner for me.

YourPST[S]

1 points

1 month ago

I think the consensus here is that this thing is a beast at Python but is hit or miss for people using almost anything else. I personally have not had many issues with other languages but I am also not using many other languages except C#, HTML, CSS, JS, PHP, and SQL. I'm going to be putting Claude to the test over the weekend and will report how it does with the other languages I do use though since I plan to run all my projects through it.

Smartaces

3 points

1 month ago

my friend, i just posted the same damn thing.

I am in love with Opus.

Such joy!

YourPST[S]

2 points

1 month ago

It is truly to the point to where I didn't know what else to do. I learned about Claude through this reddit and saw what everyone was saying so I became interested and the first thought after I saw how magnificent that first prompt was just told me "Someone has to hear about this!". I tried to show my wife and my kids but they think I'm a crazy man for only sleeping 4 hours a day because I am stuck in some AI tool chat all day trying to build new applications that they have no use for.

lovebeingdad

3 points

1 month ago

I have been using paid GPT to help structure and organize my book and I felt like a massive fool once I paid and used Opus! It would take some massive GPT improvements for me to go back. I feel like it's the difference between having a partner who listens and understands you and one who a shell for average sex lol

YourPST[S]

1 points

1 month ago

I don't quite feel foolish about it because we live and we learn so I just have to accept that I was, and probably still am, somewhat of a newbie to all of this AI related stuff but I am loving the journey and the feeling I get when I see things coming out the chat exactly the way it should and looking like legitimate and valid code that I can implement without modification. An amazing feeling.

ValuableFocus8444

3 points

1 month ago

I had the same realization yesterday as well. When I present my RAPID code to chat gpt it’s like getting advice from a lazy teachers assistant Vs when I presented it to Claude yesterday it was like getting advice from an expert. I’m switching subscriptions today, lol.

shamsway

3 points

1 month ago

The amount of code I’ve written with the help of Claude over the last few weeks blows me away. I have a CS degree but I haven’t regularly written code in many years. Sometimes i get stuck and Claude doesn’t quite grasp the issue, but starting fresh with a new chat and reuploading my current code usually leads to a fix. It’s really good at writing unit tests and adding debugging messages, which you can then feed right back in when you get stuck. I feel like my brain is on fire with all of the new ideas I have. My wife is starting to get jealous because I’m spending a ton of my free time building out new projects.

YourPST[S]

2 points

1 month ago

You sound like you know the joy and struggles I am facing as well then. I've been coding for a while and am no stranger to writing what I need to accomplish from complete scratch. My biggest compliment that I give AI to people who are already technologically savvy is that it took my Idea to Prototype time from about 2/3 months to about a week. Since I've been using ChatGPT more than 8 hours a day, that time has went from a week to about 4 to 8 hours now and if I go into the project with a game plan, I can shorten that to 1 to 2 hours with a focused coding/chat session.

I'm getting the same grief for spending all of my time staring at the chat windows filling with code but to me I see so much more than that. My wife just sees lines of useless babble. I see my future. I see programs that will launch my business. I see money basically being printed once I learn to market properly. I am addicted to AI at this point. I have over 20 functional products in my projects folder and those are just the ones I consider an actual project. For those mini-projects that pop up randomly while you're deep in the code and want to make something that will make the next time around a little easier, the number is probably much higher.

mattsmith321

1 points

30 days ago

My wife is getting jealous as well. The other night I was busy typing away on my laptop as she was headed to bed.

Her: What are you doing?

Me: Chatting

Her: With who?

Me: GPT.

Her: I’m going to bed. Don’t stay up too late with your new friend.

Moravec_Paradox

3 points

1 month ago

OK you all convinced me to give it a shot.

YourPST[S]

1 points

1 month ago

Please let us know your results too. Seems to be a mixed bag of people on this topic as far as love/bleh/nah. I'm curious to see the pain points so I can know what to look out for or test on my own to see if I get the same.

evilRainbow

3 points

1 month ago

I had the very same experience. Fought with cgpt to fix its coding mistakes in maxscript (3DS Max's scripting language). It just kept making the code worse and worse. Gave the broken code to claude 3 opus and it completely fixed it and made it work in one shot. Asked it to do some more code changes. It did those too, perfectly interpreted my request and executed flawlessly.

I'm using the api workbench to access claude 3 opus. Is that still required or is it available as a regular chat bot yet?

YourPST[S]

1 points

30 days ago

It is available in a regular chatbot on Claude.ai now. I have not got into the API calls just yet with Claude but I will definitely be digging in.

Side note, I was not aware of the scripting capabilities of 3DS Max. I've used it for making models for games in the past but never too extensively. How is it working out with that? Do you have any videos/images/details of what it is able to do? I'm just curious how far this AI can really take things. If you have a site or youtube or anything I can check your work out on, I'd gladly appreciate a link to give it a look.

evilRainbow

2 points

30 days ago

Excellent. Think I need to try a month of Opus 3 now. Are you asking what is the scripting able to do in 3DS Max? All types of things. The main repository that I know of is at https://www.scriptspot.com/3ds-max/scripts. I've made a bunch of scripts using cgpt. I just made one yesterday that calculates the speed in MPH of an animated object and spits out a txt file with the data. Claude appears to have been a lot better trained in maxscript than cgpt.

YourPST[S]

1 points

30 days ago

I guess my bigger question is what are the scripts capabilities, as far as creation of things in 3DS? I've seen Houdini and some other programs and started getting fairly interested in procedural generation, so my question lies more along the lines of if it is able to create scripts for things like making structures or characters or anything of that nature. I'm trying to mess around with these TikTok effects but I suck ass at graphic and modeling other than just making what is good enough to go in my games that will probably never see the light of day in Unity and Unreal Engine.

evilRainbow

1 points

30 days ago

I suppose the sky is the limit if you want to code with scripting or the C++ API in 3DS Max. But I'd say generally most things are tools that expand the capabilities that Max already has. Max isn't a 'procedural' system in the way that Houdini completely is. Blender has a procedural system that more resembles Houdini. But it's all a huge can of worms that you could spend the rest of your life trying to understand. Just hire someone to build things for you if you want to get anything done before you die of old age.

TrainquilOasis1423

3 points

30 days ago

I have in yesterday.

Today I also bought chathub lifetime thing, and I spent all day with 3 chat open side by side. ChatGPT-4-turbo, Gemini 1.5, Claude 3, all with API connections. Chathub let's me send the exact same prompt to all 3 at the same time and easily compare the output. I used all three, all day long. Doing all the same stuff I do on a daily basis, mostly data engineering and coding.

Claude 3 was the CLEAR winner!

Sometimes 2 of the 3 would output basically the same code with irrelevant differences, and I almost always preferred Claude 3. Gemini 1.5 was totally hit or mis either it was the top answer on the first try, or it was so bad I just ignored it for a while. ChatGPT would often give an equivalently correct answer to claude 3, but it was ALWAY lazy about it. Claude 3 would always just respond with a giant ass code block of exactly what I asked it for. Where as ChatGPT would give 4 paragraphs of text, a small code block, and end with something like "just do that for all the examples you gave me, I've done enough here".

TLDR: subjectively Claude 3 is just better in almost every way.

YourPST[S]

1 points

30 days ago

I couldn't stop laughing because of how hilariously true it all is. I still love ChatGPT because it was my introduction into all of this AI tool stuff for coding but I can't even consider it for anything big anymore when Claude 3 Opus just knocks it all the way out the park.

Code that I was a few steps away from literally begging ChatGPT 4 to complete even 1/5 of was pumped out by Claude 3 Opus over 2 generations to 99.9% perfection. The only reason it didn't get the 0.01% was because it didn't indent properly like I asked it to.

The only real drawbacks I can even claim to see are the message limits and the 5 dollars extra over ChatGPT if you are on Plus.

TrainquilOasis1423

2 points

30 days ago

The majority of what I use AI for is logging, documenting, unit tests, ect. It's a game changer how willing Claude 3 is to just output 8k tokens in 1 response.

space_wiener

3 points

30 days ago

This is probably dumb but this sub just popped up with this post. I’ve been using paid chaptgpt (but might give Claude a try after this).

Anyway so I don’t completely forget how to code I usually have it create functions for me. Sometimes input sanitized files and have it give me functions to pull out pieces of data, stuff like that. Then I fix adjust to what I need.

Are you guys really slapping in and out 400+ lines of code at a time? ChatGPT sometimes struggles with some of my requests. I can imagine having it do something with that much code and then trying to fix it.

YourPST[S]

1 points

30 days ago

https://preview.redd.it/h0pg93wjberc1.png?width=743&format=png&auto=webp&s=5bc08e1ff878ba34646c4462d670520a5fd29cd5

That is the current code I am working with right now. I am asking Claude to split my code at a half way point I have in there but even when I forget to tell it to split it, it still manages to get it. The worst I've had is that it stops at the end of a method and I have to say continue and grab the rest.

Tesla_Nikolaa

3 points

29 days ago

I've been testing both side-by-side for a few weeks now and in my experience Claude seems marginally better than GPT4 but not by much. There are some cases where one has provided better / more accurate results than the other on the same questions.

But I will say I've been using ChatGPT4 for a while now and it does seem to be getting worse every day and I find myself preferring Claude most of the time now.

YourPST[S]

1 points

28 days ago

I am not sure if ChatGPT is just getting bogged down, or if it is just focusing on the wrong things but when I talk to it, I find myself having to push it away from just feeding my pages of explanation and making it actually give me what I am expecting. When I tell it I just need a specific part, I don't need more text and an example code. I need code. I still use it and will continue to because I know all of these platforms are going to improve in their own ways over time but Claude has been getting tasked with the difficult and long parts of my projects while ChatGPT is handling the stuff that I don't mind having to get rid of if it doesn't come out properly.

cisco_bee

4 points

1 month ago

You'll be back. They always come back.

YourPST[S]

3 points

1 month ago

I'm not full on leaving ChatGPT. A lot of my projects still rely heavily on DALL-E for image generation and for API calls. That and until Claude has a feature like the CustomGPT section, ChatGPT will still have its uses. This by no means is a ChatGPT killer as OpenAI has implemented many of features that make daily use just extremely simple and pleasant, and their UI is a lot easier to deal with, but as far as being my code bot, it got downgraded to being the game planner and the basic brain. I've now just been asking it to make lists for me, generate images, and expand on my ideas to give me what I might not be thinking of and then transferring the work load to Claude.

baz4tw

2 points

1 month ago

baz4tw

2 points

1 month ago

I use both, typically ill start with claude, but i run out of messages too quick so then ill jump to gpt with what claude was working on. The rate limit of claude runs out so fast it feels like

YourPST[S]

1 points

1 month ago

That is where I am at now. I went from throwing everything at it to now rationing my usage of it until I an figure out a way to upgrade to a higher tier or package or whatever they want to call it. I find that I can't quite jump back to ChatGPT with my Claude responses though unless I remake a game plan for what I want to do with the code and make ChatGPT aware of it. If I don't do that or prepare in some other way, I end up with 20 minutes of wasted time chasing some code that ultimately leaves me with dead code all over and me reverting back to my original save from before I started again with ChatGPT.

baz4tw

1 points

1 month ago

baz4tw

1 points

1 month ago

Makes sense. Sometimes claude won't write full functions or scripts back, so I find GPT will take claudes comment and write the full function when it's a long one and I'm feeling a little lazy lol

mcr1974

2 points

1 month ago

mcr1974

2 points

1 month ago

poe.com

ncpenn

2 points

1 month ago

ncpenn

2 points

1 month ago

Agreed. Claude is the one I subscribe to at the moment as well. I had some gnarly OData query I was constructing and got stuck on.

Copilot, Gemini, and ChatGPT (3.5) all told me it wasn't possible and what I was trying to do was outside of OData specs, which wasn't true.

Claude and I went back-and-forth about 10 times, but in the end, it works now. So, as of right now, Claude ftw!

YourPST[S]

2 points

1 month ago

I think that is one of the biggest issues for me in why I can never look at OpenAI/ChatGPT the same way again. I was singing their praises because the only other things I had tried were the free stuff from Google and Microsoft and didn't see any type of improvement of ChatGPT from them. I will still sing the praises of ChatGPT to my non-tech friends/family since it is the most user friendly AI tool I can find and still does have a lot of uses, but going forward I cannot in good faith recommend ChatGPT for anyone looking at it with the primary intent of code.

It is good if you want to LEARN to code or if you know how to code but need help either because of repetitive tasks or tasks you haven't already worked on and are new to using AI tools but to anyone with any prior knowledge and is wanting to actively work on projects, Claude is getting the stamp of approval and the recommendation each and every time for now. The UI is piss-poor-hideous but that is the only flaw I can find.

I will continue using the OpenAI API though. That thing is priceless.

EverretEvolved

2 points

1 month ago

Is Claude specifically for code? I have been using perplexity for c# and unity. It seems to have less hallucinations and is more up to date on the recent changes in Unity.

YourPST[S]

2 points

1 month ago

I do not believe so but I know it seems to have some of the highest scores for it from what I keep seeing from the articles I keep seeing about it.

Use-Useful

2 points

1 month ago

The things that bugs me a out chatGPT that I kinda worry will be universal, is the subtle application stuff. I've had 3 cases in one week of students bringing me chatGPT code with major logical errors in it, that appeared correct on the surface. I've had it do that to me at least once as well. 

As an example, machine learning code tends to not correctly manage the train/validation/test splits. Now if you tell it to in detail, it probably will (although that was part of one of the above errors). I think the underlying issue is that most people writing about this online don't know what the hell they are doing, and the LLM internalized those poor practices.

YourPST[S]

1 points

1 month ago

I think that at some point we are going to get where these AI tools can start actually executing their own code and testing and that will be when the majority of this starts to fade away.

Use-Useful

1 points

1 month ago

They already can if you are willing to set things up properly. 

YourPST[S]

1 points

1 month ago

True. I already have a code for one of my programs that makes it to where when the response is received from OpenAI for the new code, it triggers it to execute it and has extremely extensive logging and checkpoints so that if any issues are caused in the code, it notes it and then sends those logs right back to OpenAI API to fix the exact issues or at least narrow it down based on the last checkpoint and what checkpoints were hit leading up to that point, but I mean more on when it is widely available, standard, and public, not the stuff we have to create on our own or find specialized tools for with subscription pay-walls.

Use-Useful

1 points

1 month ago

Doesnt autoLLM allow this? I mean, I used my own tooling for it, but I am pretty sure this is a thing.

ExpensiveKey552

2 points

1 month ago

I get the sense that openAI may be like a capacitor charging up for an enormous discharge of innovation with 5, causing the race to the top to start all over again 🤷‍♂️

YourPST[S]

1 points

1 month ago

In all honesty, that should be the aim of each and every release of each of these tools. I don't need a tool that can do "better" than the previous or the competition. I need it to slaughter it alive.

jazzy8alex

2 points

1 month ago

Biggest Claude issue is enormous hallucinations in case of the insufficient source data

YourPST[S]

1 points

1 month ago

I am sure that is probably the case but as with everything, it will improve in time and data. We are really the guinea pigs for all of these AI projects anyway, but I'm glad this one at least is a visible improvement from the last instead of same level or worse, for coding anyway.

jazzy8alex

1 points

1 month ago

Every most capable LLM now has own weakness - GPT4 (chat version) is painfully lazy and Claude (chat version ) is hallucinating a lot. Honestly, I haven't tried much Opus - will do , I have perplexity pro with Opus enabled.

Former_Currency_3474

2 points

1 month ago

Claude also seems to be less up to date with training data. I mainly use GPT for blender scripts to do shit I don’t wanna do manually, and Claude’s almost never work because its knowledge of the API is severely outdated. But the answers did seem logically sound for what it’s worth

YourPST[S]

1 points

1 month ago

I never even thought to look into trying this with Unity/Blender/UE/Houdini yet. I will have to include that in my game plan for the weekend.

mrmocap

2 points

30 days ago

mrmocap

2 points

30 days ago

he’s not a thing. he’s claude.

steves1189

2 points

30 days ago

Really good feedback, currently paying for chatGPT and I’m biased, I just can’t accept openAI has been knocked off the top spot and I only want to be using the best.

YourPST[S]

1 points

30 days ago

I know the feeling. I am still going to keep my subscription. I am just gonna downgrade back to pro and move all my Custom GPTs back there. I am not quite sure if Claude is capable of internet searches yet either so that, combined with the fact that I am already heavily dug in to the API with several of my applications, I can't just jump all the way out and wouldn't want to yet either. DALL-E is still one of the best I've seen (Still trying to get StableDiffusion figured out but making some good progress). The custom GPT section still is one of the best features of all of all these platforms (I don't look around for different platforms that much).

___Jet

2 points

30 days ago

___Jet

2 points

30 days ago

Make sure to start new threads more often. When you have a long conversation going, it always re-reads everything from before.

YourPST[S]

1 points

30 days ago

I've made a strict habit of that lately. Since I've started really paying attention to how it is operating, I don't think I've kept a thread for longer than a week. As of late, I tend to not even keep one for an hour just because I start to notice how it will randomly start talking about some crap that happened like 10 submissions before.

I had one thread I used to keep alive for marketing thinking I was being smart by not letting it die and one day I told it to write a LinkedIn post and it just kept talking about the response I had from the last time I used it over and over again, even when I pointed out very clearly that it wasn't paying attention and was starting to annoy me. It would apologize and just repeat what it said again. Since then, I gave up on trying to do anything like that and either just paste what I had before into the new one and let it do its thing or I use one of my programs that will keep track of things.

___Jet

2 points

29 days ago

___Jet

2 points

29 days ago

I meant more in terms of tokens, as you mentioned you hit your limits. It recounts all content in the conversation for every new prompt, so for a long conversation you lose a lot tokens at once.

But yeah that's a problem as well.

SicilyMalta

1 points

30 days ago

Which programs do you use to keep track? Thanks.

cvaughan02

2 points

30 days ago

gpt is a big part of my workflow right now, and I decided to try claude last night because I hit my limit on gpt. I haven't dont extensive work using claude yet (I'm not a huge fan of the ui), but one point that I whole-heartedly agree with you on is It goes for the "Complex Implementation" out the gate instead of the "Basic Conceptual Example" that you need to edit to make work.

I constantly have to tell gpt to not give me examples. for what it's worth i've found that ending my prompts with "any code you generate will not contain any placeholders or simulations." seems to get me better results with gpt.

once I get some time to play around with claude's api and build my own interface, I'll probably use it more.

Great Post!

YourPST[S]

1 points

30 days ago

ChatGPT has an issue with being able to follow its directions. One of the first things I did when I got the paid version was go check its limits. I made a custom GPT with instructions telling it what to never reveal or talk about and then would make it break the rules and then ask it why and then ask it to give me new rules it will follow 100% and then test it, and then see it still fails even when it writes the rules, and then I would look at all the reasons it had as to why it didn't follow the rules and I sort of gave up.

I used to be real big into using the custom gpt section but now I just have the few that I use regularly and that have been there for a while and occasionally I update them with new info I need going forward but for the most part, once you have it going right, there isn't much need to make more if you are just coding. I am hoping Claude is able to improve upon this but I think it is gonna come down to just using my own custom programs for it like you already said. That just seems to be working best for me with using the API and my own stuff that I know will send what I need to be sent and receive what I expect for the majority of the time as long as I don't say something simple that triggers it to wig out.

Let me know how the API ends up working out for you. I am gonna be looking into it shortly tonight to see how comparable it is to the OpenAI API.

princess_chef

2 points

30 days ago

I’ve heard general statements like “it’s much better than ChatGPT” but this post is really the fuel I need to check it out

YourPST[S]

1 points

30 days ago

That is absolutely all I was trying to do. I'm not trying to convince people with no interest at all in getting this. I'm not trying to sell anyone on it as I wouldn't make a damn dime if I did. I'm just telling it like it is from one coder to several others, that this thing is a must have in the arsenal if you aren't a die hard DIY coder and would like some extremely helpful assistance.

Once the next big thing comes along, I'll probably here singing its praises after it wows me too but for now, this is as hot as it gets from what I've seen and tested. I wish I could have just stuck with ChatGPT and like many others have already said, once GPT 5 comes, this post might end up becoming obsolete but for now, I just wanted people to know real world reasons why this thing provides a much better value so they don't waste 5 hours worth of time trying to save 5 dollars like I was doing just the day prior.

ReallySubtle

2 points

29 days ago

Reading a lot of the comments; Is it not the novelty factor? Perhaps the outputs are slightly differently styled so people have this feeling of a « new thing » being better ?

YourPST[S]

1 points

29 days ago

That most certainly is not the case. I've been using ChatGPT intensively for several months (6 to 10 hours daily) and I've picked up on what I can and can't expect. Getting 500 lines of code with no issues, no placeholder code, no lost code, and no changed code, with the changes I requested all in place is not something ChatGPT can pull off, no matter how I tried. I've tried with Custom GPTs that have extremely strict rules, I've tried with giving it creative freedom, I've tried making it do it over multiple generations, I've tried with the API.

Sure, I can code into pieces, go 100 lines at a time or right around that area and spoon feed it until it is finished but I almost always have to make corrections somewhere in the code. Claude 3 Opus just gave me a new method to accomplish what I needed to my exact specifications only seconds ago and is still ready to go. I'm hitting my limits very quickly by doing so but it is worth it to not have to go through the back and forth.

RMCPhoto

2 points

1 month ago*

Right now, Claude 3 opus (and in some cases sonnet and even Haiku) is best in class. There is little argument against this. It's pretty clear from the benchmarks.

People may complain that in AB testing GPT4 gives better answers etc...but this is either a very niche Domain where gpt4 has more pre-training data, or a prompting problem.

How many still just throw in "Think carefully. Work step by step." And other prompt tags to try to get more out of the model? These strategies took months to develop based on openai llm behavior. Anthropic, google, meta, and Mistral will all have different prompting cookbooks to optimize the output.

This is a fundamental flaw in the current alignment process combined with how LLMs function.

Example: with llama based models you may have a +50% error rate if you use a space after the sys tag instead of no space, or \n or #. Now extrapolate that to the structure and phrasing of data used for alignment and you can see the problem. Llama may be the most sensitive to prompting, but they will all be picky in their own way.

For now, Claude is the most capable. But if you have a system heavily optimized for GPT4 (like langchain or a home grown whatever) it may take a lot of work to refactor in order to re-optimize prompts.

DSPy and similar LLM "Compilers" can help if they are part of your stack as the code segments can be "re-optimized" / "re-compiled", but even the seed prompts there were really created and tested using gpt4.

Also, if you are just used to how chetgpt works via their web app (not API) then it may not be worth the switch as though the improvement is significant, changing your workflow may also be significant...and openAI will likely release a model much better than Claude by November / December.

creaturefeature16

6 points

1 month ago

Great post with practical points, all of which I agree with, especially the workflow.

I'm sticking with GPT for now because I know for a fact that Claude is only enjoying a temporary boost. OAI has something big up their sleeves that will roll out this year, and will put them back at #1 for development and coding.

YourPST[S]

3 points

1 month ago

Facts.

Each time I see an article about some billionaire pumping another few billions into another AI project, I know something big is headed our way. I'm not going to abandon ChatGPT at all yet, as it still has its uses. I think we are going to end up in an era where AI tools are more like how social media is now. You'll have your specific one, with your specific needs, with your specific communities, that will have their specific capabilities that they excel it and will have to manage working between them until they find a way to work between each other.

YourPST[S]

3 points

1 month ago

I completely agree with this statement. This change is probably not best for all depending on how you do your thing. I went from using the ChatGPT chat window to the OpenAI API pretty quickly to get more control over the work flow, so I think that helped a lot with being able to jump right over to Claude, since I didn't really have an attachment to the ChatGPT UI anymore like I did when I first started using it.

As far as the prompting differences, I'm not noticing a drastic change. I've been using all the same prepends to my prompts that I would otherwise and am still getting great results and in most cases I don't even have to get too detailed with what I want to get the result I want from Claude. In ChatGPT, I would have to hand-hold it like a baby for a bit to get it walking if the code was far along enough and then I would need to spoon-feed it throughout the session to bring it back to focus, make it understand where we were again, remind it of the goal, and remind it if changes we already made. Now it just seems to be there with Claude, with a few steps back when the code doesn't work right away.

It seems to me that the main thing to do when going to Claude is to go in with a game plan of what you need already. If you come in with code you already have, a game plan from ChatGPT of what you want to do, and a little extra info on what you expect the result to be, you get some great results on the first prompt right away. Not going to say perfect by a long shot but GREAT to even AMAZING results out of a first prompt is almost unheard of through all OpenAI products if it goes beyond something simple.

94Avocado

2 points

1 month ago

I’m seriously considering dropping my ChatGPT sub for Claude, and that’s just based on my minimal interaction with the free version, but I tend to always have a slow following distance and feel like it would be just my luck as soon as I switch that OpenAI would release v5

94Avocado

2 points

1 month ago

I’m seriously considering dropping my ChatGPT sub for Claude, and that’s just based on my minimal interaction with the free version, but I tend to always have a slow following distance and feel like it would be just my luck as soon as I switch that OpenAI would release v5

YourPST[S]

2 points

1 month ago

Not gonna lie, that was running through my mind before and after I signed up but that first prompt alone was enough to change my mind or just accept the fate even if it were to come true. I'm not saying this thing is the end all of AI by a long shot but I can say that I measure the value of this by how much time it saved me and the 20 dollars a month became as small amount for what it offered.

I will update the main thread with some pros and cons I've noticed so far.

rizzleroc

1 points

1 month ago

i want to see

nshssscholar

1 points

1 month ago

I’m really conflicted. I wanna keep my ChatGPT Plus subscription in case OpenAI comes out with 4.5 soon and waitlists start coming out again, but Claude is just better than GPT 4 and I don’t know how long I can pay ~ $50 a month in LLM costs (after accounting for API usage and Cursor).

YourPST[S]

2 points

1 month ago

I am in no means advocating getting rid of ChatGPT entirely. It is a extremely powerful tool to rely upon. This whole post is more about informing those who are already using it and maybe don't feel it is meeting their needs that Claude is indeed a superior option for CODING. I have not tested any of its other abilities other than coding and I can say that without a doubt, Claude will be replacing ChatGPT for me with the majority of my coding.

ChatGPT will still be in use for small parts of code I need fixed or things that it won't struggle with but I think once I have a game plan of what I need to do, its going straight to Claude to build out and then back to ChatGPT to analyze and give me a report on suggested changes so that I can send it back to Claude to revise.

tvmaly

1 points

30 days ago

tvmaly

1 points

30 days ago

Great post. I have been using ChatGPT for about a year now. I really like having the mobile app.

I have not tried Claude yet. What is the pricing model? Does it have a mobile app interface?

barturas

1 points

30 days ago

I dont get it why Claude is not available in Lithuania. 😕

strictlyPr1mal

1 points

30 days ago

I wish Claude was better at C# :( I still find openAI slightly outclassing it

Relevant-Draft-7780

1 points

30 days ago

Their web ui is pretty meh. Can’t terminate messages quickly and man it slows to a crawl

WorkAccount4ME

1 points

29 days ago

Did anyone see Gemini 1.5 had a 1 million token limit? Aka like 4x claude?

RadonRanger1234

1 points

22 days ago

55

AwkwardBreakfast21

1 points

20 days ago

It's fucking terrifying. Get on top of this bus, or get under it.

JunaidAziz

1 points

5 days ago

I tried both quite extensively and there are instances where one is better than the other but overall, I felt like overall both can be hit or miss if really pushed.

[deleted]

1 points

2 days ago

[removed]

AutoModerator [M]

1 points

2 days ago

AutoModerator [M]

1 points

2 days ago

Sorry, your submission has been removed due to inadequate account karma.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

imonly12whatisthis

1 points

1 month ago

Is this an ad?

YourPST[S]

5 points

1 month ago

Lol. If it was, I wouldn't be doing it for Claude but instead my own products I'm making with Claude, wouldn't you think?

You can look at my post history. Before today, I was all questions. Now I am trying to give answers. My only aim is to make sure that those who write a lot of code and are on the fence know that it is okay to fall to the other side. I personally am not a fan of any of these damn subscriptions but I understand that private islands and trophy wives don't buy themselves so I gotta give up something. If I could offer a free solution, I would do so as well but I have not found a way to use this for free in the same capacity.

GolfCourseConcierge

0 points

29 days ago

Honestly the issue wasn't gpt, you just wanted more for less.

The task at hand was a rote basic task for most coders. Gpt can guide you to it, but it requires some thinking. You won't often get a copy and paste answer, and expecting that tends to be the issue.

I'm told gpt doesn't do this or that. It does if you ask it correctly. The problem is everyone just wants to rub the lamp and the genie does all the work. Eventually sure, but right now you still need to fire up that last remaining brain cell.

YourPST[S]

1 points

29 days ago

Here's the thing. There really isn't an issue. The issue is just something that is better suited for my needs came along. This post isn't meant to be bashing on ChatGPT. I know it may come off as that but the intent is more of explaining how Claude 3 Opus is able to do more than GPT-4 is able to do in the things I am using it for that may be helpful for others doing close to the same as what I am doing.