ngl code-llama has been better

even claude-2 sometimes

gpt-4 is not as good as it used to be

janitor for /zk and some more stuff here linktr.ee/randomishwalk

when you say it is not as good as it used to be, what do you mean specifically? for example the code doesn't compile now, the logic behind the code is wrong, or something else?

Blockworks Research. @_RyanRConnor on twitter/X. 

is there any number of lines of code that you reasonably trust GPT to generate still? i.e. before code is omitted or the answer/logic goes off the rails

IMO, sadly, ChatGPT is getting worse at coding across all dimensions. Code is wrong, code is incomplete, answers have gotten lazier (code omitted), etc