GPT-4's Secrets Are Out!

Hello 👋

This is The Copilot - we are the AI newsletter that founders, funders, and everyone in between reads.

The Copilot’s goal is to get you, high-quality, substance-over-hype information that is backed by data!

It is Thursday, July 13, and we have six fascinating topics to cover.

• 💸 AI Money Flow - Venture Funding Insights

• 🤫 Weekly Highlights - GPT4 secrets revealed

• ✅ Question of The Week

• 🤯 The Impact Number

• 💰 Product Idea Worth Thinking About

• 🌶️ The Social Buzz

💸 AI Money Trail - Venture Funding Insights
July 6 - July 12

• The voice cloning startup - Resemble.ai - whose software was used for the Emmy nominated documentary - Andy Warhol Diaries receives $8M in funding.  (Generate your voice clone)
  
  See the demo below. The whispering voice is 🔥

• 50+ deals received funding last week. Over 43% were Seed stage or earlier. The two largest deals - $138M (CloudMinds - Series C) and $86M (Qianshai Yeshi - Series B) were both from China.

🧐 Weekly Highlights

• GPT4’s secrets revealed.
  
  Semianalysis unveiled the ins and outs of GPT-4's architecture, infrastructure, and costs in a post.
  
  Yam Peleg spilled the beans on LinkedIn with a summary, only to retract it later due to copyright claims.
  
  But hey, what's on the internet, stays on the internet. You can still see Yam's public post here, thanks to a quick-thinking copy-paster.
  
  Or you can read the highlights below 👇
  

  • GPT4 is 8 x 220B params = 1.76 Trillion params model.

  • GPT4 uses a Mixture of Expert model, which is 10x the size of GPT3.

  • The training data included 13T tokens from Common Crawl and Refined Web. Speculation suggests additional sources like Twitter, Reddit, YouTube, and a large collection of textbooks.

  • Training GPT-4 required a hefty $63 million, reflecting the combination of computational capacity and time required.

  • GPT4 also includes a vision encoder for autonomous bots to crawl and parse web pages, images, and videos. The architecture is similar to Flamingo.

  • A 128 GPU cluster is used for inference and answer your questions ;)

• Shopify launches an AI assistant - Sidekick - for entrepreneurs (Read more)

• NYC leads the charge in fair hiring: new anti-bias algorithm law enacted (Read more)

• ChatGPT Plus' new Code Interpreter turns everyone into data wizards (See in action)

• Anthropic releases Claude 2 - ChatGPT competitor that can digest novel-sized blocks of text. (Read more)

• VC are using AI to fund founders. Connetic Ventures uses a top-of-funnel software - Wendal, to assess founders on 13 entrepreneurial skill. (Apply for funding)

✅ Question of The Week

Please vote to see the result in next week’s issue.

🗳️ Result From The Last Week’s Poll