GPT-4's Secrets Are Out!

PLUS voice cloning startup that powered Emmy nominated documentary has a big funding day

Hello 👋

This is The Copilot - we are the AI newsletter that founders, funders, and everyone in between reads.

The Copilot’s goal is to get you, high-quality, substance-over-hype information that is backed by data!

It is Thursday, July 13, and we have six fascinating topics to cover.

  • 💸 AI Money Flow - Venture Funding Insights

  • 🤫 Weekly Highlights - GPT4 secrets revealed

  • Question of The Week

  • 🤯 The Impact Number

  • 💰 Product Idea Worth Thinking About

  • 🌶️ The Social Buzz

💸 AI Money Trail - Venture Funding Insights
July 6 - July 12

  • The voice cloning startup - Resemble.ai - whose software was used for the Emmy nominated documentary - Andy Warhol Diaries receives $8M in funding.  (Generate your voice clone)

    See the demo below. The whispering voice is 🔥

  • 50+ deals received funding last week. Over 43% were Seed stage or earlier. The two largest deals - $138M (CloudMinds - Series C) and $86M (Qianshai Yeshi - Series B) were both from China.

🧐 Weekly Highlights

  • GPT4’s secrets revealed.

    Semianalysis unveiled the ins and outs of GPT-4's architecture, infrastructure, and costs in a post.

    Yam Peleg spilled the beans on LinkedIn with a summary, only to retract it later due to copyright claims.

    But hey, what's on the internet, stays on the internet. You can still see Yam's public post here, thanks to a quick-thinking copy-paster.

    Or you can read the highlights below 👇

    • GPT4 is 8 x 220B params = 1.76 Trillion params model.

    • GPT4 uses a Mixture of Expert model, which is 10x the size of GPT3.

    • The training data included 13T tokens from Common Crawl and Refined Web. Speculation suggests additional sources like Twitter, Reddit, YouTube, and a large collection of textbooks.

    • Training GPT-4 required a hefty $63 million, reflecting the combination of computational capacity and time required.

    • GPT4 also includes a vision encoder for autonomous bots to crawl and parse web pages, images, and videos. The architecture is similar to Flamingo.

    • A 128 GPU cluster is used for inference and answer your questions ;)

  • Shopify launches an AI assistant - Sidekick - for entrepreneurs (Read more)

  • NYC leads the charge in fair hiring: new anti-bias algorithm law enacted (Read more)

  • ChatGPT Plus' new Code Interpreter turns everyone into data wizards (See in action)

  • Anthropic releases Claude 2 - ChatGPT competitor that can digest novel-sized blocks of text. (Read more)

  • VC are using AI to fund founders. Connetic Ventures uses a top-of-funnel software - Wendal, to assess founders on 13 entrepreneurial skill. (Apply for funding)

Question of The Week

Please vote to see the result in next week’s issue.

🗳️ Result From The Last Week’s Poll

Subscribe to keep reading

This content is free, but you must be subscribed to The Copilot to continue reading.

Already a subscriber?Sign In.Not now