shd42

shd42

OpenAI GPT-3 - Let's have that talk

Hello everyone,

Elon musk funded OpenAI came out with the third version of it’s “Generative Pretrained transformer”, in short, GPT-3. I’ve seen quite a bit of discussion on the subject. Focusing mostly on the coding part, it looks like the thing came come up with at the very least some simple apps (think todo list), just by feeding it thought / ideas.

Considering that i have myself been using at least one strong contender in the no-code movement on a weekly basis (namely, Webflow), but with a knowledge in terms of pure machine learning / AI system rather limited, i’m often left wondering what those changes actually means.

What you folks think about this ? Is it a realistic threat to our jobs in the near future ? Or just an added tool to our toolbox ?

Most Liked

dimitarvp

dimitarvp

It’s absolutely inevitable for a lot of CRUD apps to become automatically generated at one point. The truth that continually gets denied due to somebody’s ego is that many apps aren’t that different from each other at their core – and the distinguishing features are like 1% to 10% at best.

Machine learning analysis of N repositories that are skeleton CRUD apps and then commanding it to create one while allowing for switching on/off certain aspects isn’t much different compared to what mix phx.new and its flags do. :smiley:

Several examples of app generators I bookmarked some weeks ago:

I am sure that much more exist (and if you know them, please post links, I’d like to collect a lot of them!).

I also started becoming a fan of no-code app making (thanks for Webflow link!) and I believe it’s high time the programming area to get a huge pruning of cruft. We should all laser-focus on bringing real business value and start automating various aspects of project creation and management because they really are almost identical. (I seriously am not a fan of all of the tooling and automation minutiae in apps; stuff like bringing up a regular CI/CD integration, docs generation, syncing with rarely-changing external DBs like timezones or RFCs, code coverage etc. should come baked in with the option of customizing them before putting in production.)

For 18.5y of career I’ve only seen 2, maybe 3, projects that required a different approach – and now that I am thinking about it it’s probably still possible to automate those as well because their format is mostly the same but with different priorities.

I am skeptical about what can ML bring to the table. I’d even think normal humans will beat it in its endeavor to automate app creation.

al2o3cr

al2o3cr

TBH I doubt it - the impressive results we’ve seen so far with tools like GPT-3 and image synthesis tend to be things that we’re good at extracting meaning from despite the inclusion of weirdly incorrect details.

For instance, you can person camera tv man woman understand sentences even with the inclusion of stray words. Here’s a whole site about spotting anomalies in StyleGAN output Which Face Is Real?

You don’t want EITHER thing happening if you’re doing business logic: an invoice system that multiplies all the numbers together instead of adding them is not at all useful.

shd42

shd42

I completely agree with you on this. At the very least, the foundation of a large amount of applications start with half of it’s codebase needing similar things.

I do think it’s a bit more complex than that, but i get your point. The system capacity to understand what you ask with natural language, and translate it to something tangible remains impressive when it’s not an actual generator, but instead an “understanding” (big quotes here, Skynet isn’t there (yet :winking_face_with_tongue:)) of the intent and meaning of what you’re asking, through what the system can find in it’s “brain” (so internet, basically).

Will it not, at some point, be able to “understand” the principles of what you’re asking it to do, with the information available, and avoid those common pitfalls though ? And with that ability, would come ever more complex problems easier to deal with ?

That’s always something i’m wondering. Everytime i see something come up about some new AI, seems to almost always be oriented to the same stuff that, in your particular example, could be correlated for example to what a DSLR (a camera) does when it’s tracking faces. Would you say then that while improvements are made, it will mostly remain to some specific areas of expertise, while other will remain (forever?) out of reach ?

Last Post!

al2o3cr

al2o3cr

This is a good read about how GPT-3 represents numbers, which TBH makes it amazing that it can do arithmetic with any skill:

https://nostalgebraist.tumblr.com/post/620663843893493761/bpe-blues

Where Next?

Popular in Discussions Top

sergio
There’s a new TIOBE index report that came out that shows Elixir is still not in the top 50 used languages. It also goes on to call Elix...
New
AstonJ
I’ve just started the Phoenix part of the utterly brilliant online course by @pragdave. On generating the Phoenix app he uses the --no-ec...
New
und0ck3d
Hello everyone! A few days ago I’ve created a topic here about how people were creating CMSs with Elixir and Phoenix. I’ve been studying...
New
chulkilee
Here are the list of HTTP client libraries/wrappers, and some thoughts on HTTP client in general. I’d like to hear from others how they w...
New
slashdotdash
Phoenix Live View is now publicly available on GitHub. Here’s Chris McCord’s tweet announcing making it public.
New
tomekowal
Hey guys! I want to create a toy project that shows a chart of temperature over time and updates every 5 seconds. I feel LiveView is per...
New
Fl4m3Ph03n1x
Background A few days ago I was listening to The future of Elixir from Elixir Talks, with Dave Thomas (@pragdave ) and Brian Mitchell. I...
New

Other popular topics Top

KronicDeth
Elixir plugin for JetBrain’s IntelliJ Platform (including Rubymine) This is a plugin that adds support for Elixir to JetBrains IntelliJ...
289 36654 110
New
vonH
In asking this question I am more interested about the expressiveness of the language itself and less concerned about the availability of...
New
greenz1
I have a phoenix application from which a user can download multiple(5-6) files of size 1MB. I couldn’t find anything related to sending ...
New
sorentwo
Hello! tl;dr Announcing Oban, an Ecto based job processing library with a focus on reliability and historical observability. After spen...
985 44532 311
New
shijith.k
I am trying to start a new phoenix project with elixir 1.9, but mix phx.new does not work. It says that ** (Mix) The task "phx.new" could...
New
romenigld
I am trying to run a deploy with docker and I successfully runned with this command: docker build -t romenigld/blog-prod . but when I t...
New

We're in Beta

About us Mission Statement