My Notes on the hype around GPT -3

There’s a lot of hype going on around capabilities of Artificial Intelligence with the release of GPT-3 model by a company called OpenAI which was founded by Elon Musk & Sam Altman.

OpenAI CEO Sam Altman made the point earlier on Twitter: “The GPT-3 hype is way too much….AI is going to change the world, but GPT-3 is just a very early glimpse.”

For now, OpenAI wants outside developers to help it explore what GPT-3 can do, but it plans to turn the tool into a commercial product later this year, offering businesses a paid-for subscription to the AI via the cloud.

This post is about collection of articles about GPT-3 model for my own reference. Hopefully it will help you as well.

GPT-3 Is Amazing—And Overhyped

In this article, the author believes that a large model that is trained on half trillion words will definitely have the capacity to master the linguistic patterns contained in the text. But GPT-3 possesses no internal representation of what these words actually mean. It has no semantically-grounded model of the world or of the topics on which it discourses. It cannot be said to understand its inputs and outputs in any meaningful way.

Full Article : https://www.forbes.com/sites/robtoews/2020/07/19/gpt-3-is-amazingand-overhyped/#53c17a6d1b1c

OpenAI’s latest AI text generator GPT-3 amazes early adopters

“GPT-3 is so good at what it does that it can deceive people on almost topic it’s given, even if that topic happens to be writing about itself.”

“GPT-3 appears to blow away the capabilities of its predecessor, thanks in part to the more than 175 billion learning parameters it possesses, which enable it to perform pretty much any task it’s assigned.”

Full Article : https://siliconangle.com/2020/07/19/openais-latest-ai-text-generator-gpt-3-amazes-early-adopters/

OpenAI’s new language generator GPT-3 is shockingly good—and completely mindless

In this article by MIT’s Technology Review, author believes that the Large models like GPT-3 can generate human like text but it is far from being true intelligence.

“Yet despite its new tricks, GPT-3 is still prone to spewing hateful sexist and racist language. Fine-tuning the model helped limit this kind of output in GPT-2.”

“But GPT-3’s human-like output and striking versatility are the results of excellent engineering, not genuine smarts. For one thing, the AI still makes ridiculous howlers that reveal a total lack of common sense. But even its successes have a lack of depth to them, reading more like cut-and-paste jobs than original compositions.”

Full Article : https://www.technologyreview.com/2020/07/20/1005454/openai-machine-learning-language-generator-gpt-3-nlp/

OpenAI’s GPT-3 may be the biggest thing since bitcoin

Well, this is the post written by GPT-3 itself.

Full Article : https://maraoz.com/2020/07/18/openai-gpt3/

Quick thoughts on GPT3

This post is by Delian Asparouhov who has tried GPT-3 first hand.

“What’s incredible about the tool is you can feed it almost any context — a script about a gay couple in Italy, an interview between two tech luminaries, or even a political column about an election — and it is able to put together decently coherent arguments.”

Full Article : https://delian.substack.com/p/quick-thoughts-on-gpt3

What is the OpenAI GPT-3?

Full Article : https://www.analyticssteps.com/blogs/what-openai-gpt-3

Collection of GPT-3 results

Full Article : https://www.lesswrong.com/posts/6Hee7w2paEzHsD6mn/collection-of-gpt-3-results

OpenAI API

This article is by OpenAI itself; it talks about the GPT-3 model, API and other FAQs.

“Open AI is releasing an API for accessing new AI models developed by OpenAI. Unlike most AI systems which are designed for one use-case, the API today provides a general-purpose “text in, text out” interface, allowing users to try it on virtually any English language task.”

“The field’s pace of progress means that there are frequently surprising new applications of AI, both positive and negative. API access will be terminated for obviously harmful use-cases, such as harassment, spam, radicalization, or astroturfing.”

Why did OpenAI decide to release a commercial product?

“Ultimately, what we care about most is ensuring artificial general intelligence benefits everyone. We see developing commercial products as one of the ways to make sure we have enough funding to succeed.”

Why did OpenAI choose to release an API instead of open-sourcing the models?

There are three main reasons we did this. First, commercializing the technology helps us pay for our ongoing AI research, safety, and policy efforts.

Second, many of the models underlying the API are very large, taking a lot of expertise to develop and deploy and making them very expensive to run. This makes it hard for anyone except larger companies to benefit from the underlying technology.

Third, the API model allows us to more easily respond to misuse of the technology.

Full Article : https://openai.com/blog/openai-api/