GPT-4's Secrets Are Out!

Hello 👋

This is The Copilot - we are the AI newsletter that founders, funders, and everyone in between reads.

The Copilot’s goal is to get you, high-quality, substance-over-hype information that is backed by data!

It is Thursday, July 13, and we have six fascinating topics to cover.

• 💸 AI Money Flow - Venture Funding Insights

• 🤫 Weekly Highlights - GPT4 secrets revealed

• ✅ Question of The Week

• 🤯 The Impact Number

• 💰 Product Idea Worth Thinking About

• 🌶️ The Social Buzz

💸 AI Money Trail - Venture Funding Insights
July 6 - July 12

• The voice cloning startup - Resemble.ai - whose software was used for the Emmy nominated documentary - Andy Warhol Diaries receives $8M in funding.  (Generate your voice clone)
  
  See the demo below. The whispering voice is 🔥

• 50+ deals received funding last week. Over 43% were Seed stage or earlier. The two largest deals - $138M (CloudMinds - Series C) and $86M (Qianshai Yeshi - Series B) were both from China.

🧐 Weekly Highlights

• GPT4’s secrets revealed.
  
  Semianalysis unveiled the ins and outs of GPT-4's architecture, infrastructure, and costs in a post.
  
  Yam Peleg spilled the beans on LinkedIn with a summary, only to retract it later due to copyright claims.
  
  But hey, what's on the internet, stays on the internet. You can still see Yam's public post here, thanks to a quick-thinking copy-paster.
  
  Or you can read the highlights below 👇
  

  • GPT4 is 8 x 220B params = 1.76 Trillion params model.

  • GPT4 uses a Mixture of Expert model, which is 10x the size of GPT3.

  • The training data included 13T tokens from Common Crawl and Refined Web. Speculation suggests additional sources like Twitter, Reddit, YouTube, and a large collection of textbooks.

  • Training GPT-4 required a hefty $63 million, reflecting the combination of computational capacity and time required.

  • GPT4 also includes a vision encoder for autonomous bots to crawl and parse web pages, images, and videos. The architecture is similar to Flamingo.

  • A 128 GPU cluster is used for inference and answer your questions ;)

• Shopify launches an AI assistant - Sidekick - for entrepreneurs (Read more)

• NYC leads the charge in fair hiring: new anti-bias algorithm law enacted (Read more)

• ChatGPT Plus' new Code Interpreter turns everyone into data wizards (See in action)

• Anthropic releases Claude 2 - ChatGPT competitor that can digest novel-sized blocks of text. (Read more)

• VC are using AI to fund founders. Connetic Ventures uses a top-of-funnel software - Wendal, to assess founders on 13 entrepreneurial skill. (Apply for funding)

✅ Question of The Week

Please vote to see the result in next week’s issue.

🗳️ Result From The Last Week’s Poll

🤯 The Impact Numbers

110

110 AI-related lawsuits were reported in United States in 2022. This reflects a seven fold increase in lawsuits compared to 2016.

Most of these legal disputes stemmed from California, New York, and Illinois, with the primary legal issues revolving around civil law, intellectual property, and contractual disputes.

💰 A Product Idea Worth Thinking About - Synthesize My Podcasts

An AI podcast app called PodBrief.

PodBrief analyzes your latest subscribed podcast episodes and generates a concise summary, which is dispatched to your inbox daily.

With PodBrief, key moments of long-form podcasts like the Joe Rogan Experience or Lex Fridman are distilled into short, curated clips you can enjoy at your convenience.

Tailored to your listening habits, PodBrief learns what you love, serving you bitesize highlights from the episodes you enjoy the most. Say goodbye to sifting through hours of content, PodBrief brings you the essence of your podcasts, daily.

🌶️ The Social Buzz

That’s it for this week. See you again next week.

-Salil