U.S. markets open in 3 hours 33 minutes
  • S&P Futures

    +58.50 (+1.17%)
  • Dow Futures

    +101.00 (+0.26%)
  • Nasdaq Futures

    +351.00 (+2.00%)
  • Russell 2000 Futures

    +9.60 (+0.48%)
  • Crude Oil

    +0.26 (+0.33%)
  • Gold

    +5.20 (+0.26%)
  • Silver

    +0.23 (+1.01%)

    +0.0038 (+0.35%)
  • 10-Yr Bond

    0.0000 (0.00%)
  • Vix

    -1.16 (-7.56%)

    +0.0042 (+0.33%)

    -0.1500 (-0.10%)
  • Bitcoin USD

    +302.45 (+0.59%)
  • CMC Crypto 200

    0.00 (0.00%)
  • FTSE 100

    +3.65 (+0.05%)
  • Nikkei 225

    +836.52 (+2.19%)

'So much faster than GPT-4': People are hyped for Google's AI model Gemini in its first 24 hours

A composite image of Demis Hassabis and Sundar Pichai.
The Google DeepMind boss Demis Hassabis and Alphabet CEO Sundar Pichai unveiled Gemini this week.Getty Images
  • The wait is finally over: Google has officially unveiled Gemini.

  • Google is presenting Gemini as its answer to GPT-4, the AI model that sits behind ChatGPT.

  • The model is provoking hype and excitement among developers already.

The wait for Gemini felt a bit like waiting for Godot this year.

OpenAI, a relatively small upstart company, seriously upstaged Google when it fatefully released ChatGPT in November 2022.

When would the tech giants, particularly Google, follow?

Now we know.

On Wednesday, Google CEO Sundar Pichai and the Google DeepMind boss Demis Hassabis introduced the world to Gemini, Google's new generative AI model, which it describes as its "most capable and general model yet."

Gemini, which comes in three different flavors named Ultra, Pro, and Nano, is a multimodal artificial-intelligence system, which means it processes not only text but code, audio, images, and video to respond to user prompts. It also integrates directly into mobile devices, a first for an AI model and a point of excitement for app makers.

It's such an important moment for Google that the cofounder Sergey Brin was hands-on "basically every day" with its development, as one Gemini developer put it.

It's early, but initial reactions suggest Gemini is putting in a good showing against GPT-4, the latest large language model powering ChatGPT.

First, some numbers that illustrate Gemini's performance chops.

Google says its most powerful Ultra model, rolling out next year, "exceeds current state-of-the-art results on 30 of the 32 widely-used academic benchmarks" to assess large language models.

TL;DR: Gemini probably is better than GPT-4. But a closer look at the details suggests the outperformance is only marginal.

On one benchmark, Gemini Ultra has a 74.4% success rate in Python coding tasks, for example, versus 67% for GPT-4. On another benchmark, Gemini Ultra has a reading comprehension score of 82.4 compared with GPT-4's 80.9.

A screenshot from Google's technical paper introducing Gemini

As marginal as this is, first impressions of Gemini still appear to be positive among users who are getting a taste of Gemini through Bard, Google's version of ChatGPT.

Mihir Patel, a research engineer at MosaicML, posted screenshots to X that compared responses from Gemini and GPT-4 to the question, "What is mamba in deep learning?"

Gemini's response was more detailed in his screenshots and linked to external research papers. ChatGPT was closer to a smart Wikipedia entry.

Patel's reaction: "Gemini is so good. SO much better and SO much faster than GPT-4."

Another demo showed Gemini accurately describing a developing picture of a duck swimming in water. That elicited several semi-jokey "Google is so back" responses on social media.

Developers will probably welcome Gemini as an interesting alternative to OpenAI's offering, too. Google told the Financial Times that because the Nano model was built to "run natively" on its Pixel phones, Android developers would have an easier time building AI apps.

The verdict is still out on just how successful Gemini will be and whether Google can pry users away from ChatGPT with it. Lots of users wanting to test Gemini may have to wait as the company continues to work on non-English-language versions of the models.

Gemini also still appears to be vulnerable to the hallucination issues that have plagued ChatGPT.

Pichai, Hassabis, and other Google execs will be familiar with the innovator's dilemma — the idea that big companies risk losing their market leadership if they don't stay nimble in product development. Early reactions to Gemini suggest there's life in the old search engine yet.

Read the original article on Business Insider