- The Copilot
- Posts
- GPT-4's Secrets Are Out!
GPT-4's Secrets Are Out!
PLUS voice cloning startup that powered Emmy nominated documentary has a big funding day
Hello 👋
This is The Copilot - we are the AI newsletter that founders, funders, and everyone in between reads.
The Copilot’s goal is to get you, high-quality, substance-over-hype information that is backed by data!
It is Thursday, July 13, and we have six fascinating topics to cover.
💸 AI Money Flow - Venture Funding Insights
🤫 Weekly Highlights - GPT4 secrets revealed
✅ Question of The Week
🤯 The Impact Number
💰 Product Idea Worth Thinking About
🌶️ The Social Buzz
💸 AI Money Trail - Venture Funding Insights
July 6 - July 12
The voice cloning startup - Resemble.ai - whose software was used for the Emmy nominated documentary - Andy Warhol Diaries receives $8M in funding. (Generate your voice clone)
See the demo below. The whispering voice is 🔥
50+ deals received funding last week. Over 43% were Seed stage or earlier. The two largest deals - $138M (CloudMinds - Series C) and $86M (Qianshai Yeshi - Series B) were both from China.
🧐 Weekly Highlights
GPT4’s secrets revealed.
Semianalysis unveiled the ins and outs of GPT-4's architecture, infrastructure, and costs in a post.
Yam Peleg spilled the beans on LinkedIn with a summary, only to retract it later due to copyright claims.
But hey, what's on the internet, stays on the internet. You can still see Yam's public post here, thanks to a quick-thinking copy-paster.
Or you can read the highlights below 👇GPT4 is 8 x 220B params = 1.76 Trillion params model.
GPT4 uses a Mixture of Expert model, which is 10x the size of GPT3.
The training data included 13T tokens from Common Crawl and Refined Web. Speculation suggests additional sources like Twitter, Reddit, YouTube, and a large collection of textbooks.
Training GPT-4 required a hefty $63 million, reflecting the combination of computational capacity and time required.
GPT4 also includes a vision encoder for autonomous bots to crawl and parse web pages, images, and videos. The architecture is similar to Flamingo.
A 128 GPU cluster is used for inference and answer your questions ;)
Shopify launches an AI assistant - Sidekick - for entrepreneurs (Read more)
NYC leads the charge in fair hiring: new anti-bias algorithm law enacted (Read more)
ChatGPT Plus' new Code Interpreter turns everyone into data wizards (See in action)
Anthropic releases Claude 2 - ChatGPT competitor that can digest novel-sized blocks of text. (Read more)
VC are using AI to fund founders. Connetic Ventures uses a top-of-funnel software - Wendal, to assess founders on 13 entrepreneurial skill. (Apply for funding)
✅ Question of The Week
Please vote to see the result in next week’s issue.