302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

11月5日,Anthropic在社交媒体平台宣布Claude 3.5 Haiku可以通过API访问。Claude 3.5 Haiku是Anthropic公司在10月22日发布的新模型,在许多评估中的性能与 Claude 3 Opus不相上下,而成本和速度却与上一代Haiku相当。

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

根据官方介绍,Claude 3.5 Haiku 在各种编码、工具使用和推理任务中提供了强大的性能和速度。它在 SWE-bench Verified 上的得分为 40.6%,优于许多使用公开可用的最先进模型的代理——包括原始版本的Claude 3.5 Sonnet和GPT-4o。

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

虽然性能有了提升,但和Claude 3 Haiku相比,Claude 3.5 Haike在输入输出令牌的价格上足足涨四倍之多:

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?


在302.AI上使用Claude 3.5 Haiku

但不管怎样,我们抱着好奇的心态,还是要探一下这个模型到底如何!为了满足用户需求,302.AI聊天机器人以及API超市在第一时间更新了Claude 3.5 Haiku模型。

如果想要更方便、更快速地使用这一模型可以选择聊天机器人。如果需要快速获得Claude 3.5 Haiku模型的API接入方式,可以进入超市,302.AI的API超市为开发者和企业打造了一个高效、便捷的AI应用开发与部署平台,轻松实现AI技术的快速落地。

此外,302.AI提供按需付费的服务方式,能够让用户更好减少资源消耗和减低开发成本。以下分别是聊天机器人和API的获取方式:

聊天机器人进入302.AI找到聊天机器人——点击模型——选择Claude 3.5 Haiku模型使用:

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

API获取:找到API超市——语言大模型——选择Anthropic:

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

但为了更直观让大家了解Claude 3.5 Haiku模型,接下来会使用302.AI的API超市、模型竞技场、网页生成器去测试Claude 3.5 Haiku的响应速度、推理能力、编程能力三方面的表现。


多模型对比:

1、响应速度

对比模型有:claude-3.5-haiku-20241022、claude-3-opus、claude-3-haiku

使用工具:302.AI的API超市—在线调试

提示词为什么我爸妈结婚的时候没邀请我参加婚礼?

可以看到,速度最快的是claude-3.5-haiku-20241022,速度为3.57s,其次是claude-3-haiku,速度为3.8s,最慢的是claude-3-opus,速度是17.63s。果然如Anthropic宣传那样,对于需要快速响应的场景,claude-3.5-haiku-20241022无疑是一个优选。

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

2、推理能力

对比模型有:gpt-4o、claude-3.5-haiku-20241022、claude-3-opus、claude-3-haiku

使用工具:302.AI的模型竞技场

提示词:假设:2#3=5,3#5=7,5#7=11。请问:11#13=?

首先看下GPT-4o的答案,答案是正确的,整个回答也是有逻辑条理的。

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

先来看下claude-3-haiku的回答,从5#7=11的差值为6就出现了错误,因此整个递增规律其实是不存在的。

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

接着是今天的主角claude-3.5-haiku-20241022,没想到居然和claude-3-haiku一样翻车了,计算出3+5=7以及5+7=11的情况,明显出现了“模型幻觉”,导致最后得出的规律也是错误的。

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

而同为Anthropic公司的老大哥claude-3-opus完全没有问题,回答正确逻辑也清晰。

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

3、编程能力:

对比模型有:claude-3.5-haiku-20241022、claude-3-haiku

使用工具:302.AI的网页生成器2.0

提示词:请帮我制作一个浪漫之心

先来看下claude-3-haiku生成的效果,claude-3-haiku生成的是一个粉色为主色调的页面并带有一点爱心元素,但我本意是希望能够生成一个爱心,这也可以看出claude-3-haiku在编程时对提示词的理解不够:302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

网页生成效果预览链接:https://jgyc-coder.302.ai/zh/share/2zaHKzEkTWFXWHFa1QvCx?lang=zh

claude-3.5-haiku-20241022生成的效果非常好,claude-3.5-haiku完美理解并消化了提示词生成的是一个可完整的爱心,可以看出claude-3.5-haiku出色的指令理解能力与编程能力:

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?

网页生成效果预览链接:https://ac0n-coder.302.ai/zh/share/DtecoyQhz9Iz3WY9yse8a?lang=z


总结

虽然Claude 3.5 Haiku在响应速度和编程能力方面表现出色,显著优于许多竞争对手,但在推理能力的表现上却存在短板。通过302.AI的模型竞技场对比测试,我们可以明显看到,Claude 3.5 Haiku在处理较为复杂的推理问题时容易出现错误,甚至产生“模型幻觉”。

另外,根据官方了解到,Claude 3.5 Haiku目前是作为纯文本模型,之后会将提供图像输入功能,到时价格或许会再有浮动。

后续302.AI也会给大家及时更新Claude 3.5 Haiku的最新动态和功能,与大家一起见证AI领域的每一次进步和创新。

参考文章:

https://www.anthropic.com/news/3-5-models-and-computer-use


👉立即注册免费试用302.AI,开启你的AI之旅!👈

为什么选择302.AI?

● 灵活付费:无需月费,按需付费,成本可控
● 丰富功能:从文字、图片到视频,应有尽有,满足多种场景需求
● 开源生态:支持开发者深度定制,打造专属AI应用
● 易用性:界面友好,操作简单,快速上手

302.AI 基准实验室 | Anthropic最新模型Claude 3.5 Haiku,与其他模型对比表现如何?
All Rights Reserved by 302.AI
Like (0)
302.AI302.AI
Previous 2024 年 11 月 5 日 下午6:16
Next 2024 年 11 月 8 日 下午6:07

相关推荐

  • 302.AI 基准实验室丨编程能力超越Claude Opus 4?DeepSeek V3.1最新版本实测

    DeepSeek 昨晚在 Hugging Face 发布了其最新升级模型 DeepSeek-V3.1-Base。这次更新并没有任何预热宣传,甚至没有放上模型卡。唯一已知的信息是:上下文窗口从原有的64k扩展至128k,从网页、App、小程序都可体验这一模型。从上传的模型版本看,模型尺寸达 685B,支持 BF16、F8_E4M3、F32 等张量类型,平衡模型…

    2025 年 8 月 20 日 基准实验室
    8330
  • 302.AI 赛博月刊丨Vol.8 攻守易形:当开源变成中国主场

    AI 行业大事记 2025 年 8 月 联合出品: Jomy @ 302.AI 南乔 @ ShowMeAI 大聪明 @ 赛博禅心 说明: ①本文讨论了 2025 年7月 AI行业的 103 件大事,涵盖模型、图像、视频、音频、3D、机器人、应用、新闻/融资等多个领域。 ② 本文分类中的「模型」均指代语言模型; ③ 本文分类中的「融资」包含了融资、收购、团队成…

    2025 年 8 月 18 日 赛博月刊
    3500
  • 302.AI 基准实验室丨从视觉语言到GUI交互:智谱GLM-4.5V挑战顶级闭源模型实测

    视觉语言大模型(VLM)作为智能系统的核心基础,正在不断从基础的“识别”向更深层的“推理”跃迁。今年上半年,多模态大模型在视觉领域呈现百花齐放之势,各厂商竞相布局。然而,视觉能力的下一站是“推理”——不满足于让模型读图后回答“这是什么”,更需其调用推理能力理解背后的意图与情境。这种对视觉逻辑和上下文的理解能力,既是实现通用人工智能(AGI)的关键一步,也是构…

    2025 年 8 月 15 日 基准实验室
    4511
  • 302.AI 基准实验室丨GPT-5评测:没能炸场,却精准打脸了竞品:便宜、能打,还不装

    尘埃落定,当地时间 8 月 7 日,OpenAI 终于发布了最新的旗舰 AI 模型 GPT-5。OpenAI 宣称,GPT-5 是其迄今为止最智能、最快、最实用的模型,在编码、数学、写作、健康、视觉感知等领域均展现出卓越的性能。首席执行官 Sam Altman 将 GPT-5 形容为一次“重大升级”,称与其对话“就像在与某个领域的博士级专家交流”。 GPT-…

    2025 年 8 月 8 日 基准实验室
    1.1K1

发表回复

您的邮箱地址不会被公开。 必填项已用 * 标注

Comments(54)

  • vorbelutr ioperbir
    vorbelutr ioperbir 2025 年 6 月 14 日 下午4:05

    The following time I read a blog, I hope that it doesnt disappoint me as a lot as this one. I mean, I do know it was my choice to read, however I actually thought youd have something fascinating to say. All I hear is a bunch of whining about something that you could possibly repair for those who werent too busy looking for attention.

  • reducao do estresse
    reducao do estresse 2025 年 8 月 20 日 上午1:41

    I¦ve read a few just right stuff here. Definitely value bookmarking for revisiting. I wonder how much attempt you place to create one of these excellent informative website.

  • Soulmate Sketch
    Soulmate Sketch 2025 年 8 月 20 日 上午1:52

    certainly like your web-site however you need to take a look at the spelling on several of your posts. Several of them are rife with spelling issues and I find it very troublesome to inform the truth however I¦ll certainly come again again.

  • macan empire
    macan empire 2025 年 8 月 20 日 上午3:31

    Hi, I think your site might be having browser compatibility issues. When I look at your website in Safari, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, fantastic blog!

  • Prozenith
    Prozenith 2025 年 8 月 20 日 上午4:45

    Loving the info on this web site, you have done outstanding job on the posts.

  • Escalade de bloc centre-ville Montréal
    Escalade de bloc centre-ville Montréal 2025 年 8 月 20 日 上午7:02

    Excellent web site. Lots of helpful info here. I’m sending it to several buddies ans also sharing in delicious. And obviously, thanks in your effort!

  • slot macan empire
    slot macan empire 2025 年 8 月 20 日 上午7:32

    You actually make it seem so easy along with your presentation however I in finding this topic to be actually something which I think I might by no means understand. It seems too complicated and extremely huge for me. I’m taking a look forward to your next publish, I’ll try to get the dangle of it!

  • Dentiste Chicoutimi
    Dentiste Chicoutimi 2025 年 8 月 20 日 上午11:25

    Oh my goodness! a tremendous article dude. Thank you Nevertheless I’m experiencing issue with ur rss . Don’t know why Unable to subscribe to it. Is there anyone getting identical rss drawback? Anybody who knows kindly respond. Thnkx

  • hiv rash
    hiv rash 2025 年 8 月 20 日 下午2:48

    I’m still learning from you, while I’m trying to achieve my goals. I definitely liked reading all that is posted on your blog.Keep the stories coming. I liked it!

  • https://micropipetas.ucoz.net/
    https://micropipetas.ucoz.net/ 2025 年 8 月 20 日 下午5:09

    I believe this web site contains some rattling great information for everyone. “The expert at anything was once a beginner.” by Hayes.

  • MLB Streams Online
    MLB Streams Online 2025 年 8 月 20 日 下午8:58

    me encantei com este site. Para saber mais detalhes acesse nosso site e descubra mais. Todas as informações contidas são conteúdos relevantes e diferentes. Tudo que você precisa saber está está lá.

  • Lipovive
    Lipovive 2025 年 8 月 20 日 下午9:13

    Great – I should definitely pronounce, impressed with your site. I had no trouble navigating through all the tabs and related information ended up being truly easy to do to access. I recently found what I hoped for before you know it at all. Reasonably unusual. Is likely to appreciate it for those who add forums or something, website theme . a tones way for your customer to communicate. Nice task..

  • Dentiste Saint-Jean-sur-Richelieu
    Dentiste Saint-Jean-sur-Richelieu 2025 年 8 月 20 日 下午9:48

    I like what you guys are up too. Such clever work and reporting! Keep up the excellent works guys I have incorporated you guys to my blogroll. I think it’ll improve the value of my site :).

  • Chiro Boucherville
    Chiro Boucherville 2025 年 8 月 21 日 上午9:47

    Those are yours alright! . We at least need to get these people stealing images to start blogging! They probably just did a image search and grabbed them. They look good though!

  • Dentiste Québec
    Dentiste Québec 2025 年 8 月 21 日 下午2:14

    Attractive part of content. I simply stumbled upon your blog and in accession capital to claim that I acquire actually loved account your blog posts. Anyway I’ll be subscribing to your augment or even I fulfillment you get right of entry to constantly quickly.

  • Conception site web Longueuil
    Conception site web Longueuil 2025 年 8 月 21 日 下午9:00

    Hello I am so excited I found your site, I really found you by error, while I was looking on Aol for something else, Anyhow I am here now and would just like to say many thanks for a marvelous post and a all round thrilling blog (I also love the theme/design), I don’t have time to look over it all at the moment but I have bookmarked it and also added in your RSS feeds, so when I have time I will be back to read more, Please do keep up the excellent work.

  • classroomed unblocked games
    classroomed unblocked games 2025 年 8 月 22 日 上午12:11

    After all, what a great site and informative posts, I will upload inbound link – bookmark this web site? Regards, Reader.

  • Soulmate Sketch
    Soulmate Sketch 2025 年 8 月 22 日 上午7:10

    Thanks for the good writeup. It if truth be told was a entertainment account it. Glance complex to far introduced agreeable from you! However, how could we keep in touch?

  • Pink Salt Recipe
    Pink Salt Recipe 2025 年 8 月 22 日 上午10:06

    The Pink Salt Trick is a minimalist but effective morning routine: Just drink a glass of lukewarm water mixed with a pinch of Himalayan pink salt as soo

  • Lipovive
    Lipovive 2025 年 8 月 22 日 上午11:49

    hello!,I really like your writing very much! percentage we keep up a correspondence extra approximately your article on AOL? I require an expert on this space to unravel my problem. May be that is you! Taking a look forward to look you.

  • olxtoto
    olxtoto 2025 年 8 月 23 日 上午10:48

    What i don’t understood is if truth be told how you are now not actually much more well-appreciated than you might be right now. You’re so intelligent. You realize thus significantly in the case of this subject, produced me for my part consider it from a lot of varied angles. Its like men and women are not fascinated except it is something to do with Lady gaga! Your individual stuffs excellent. At all times handle it up!

  • The Vendoors
    The Vendoors 2025 年 8 月 23 日 下午3:16

    It’s the best time to make some plans for the future and it is time to be happy. I’ve learn this post and if I may just I want to recommend you few attention-grabbing things or suggestions. Perhaps you can write next articles relating to this article. I wish to learn even more issues about it!

  • vehicle tuner
    vehicle tuner 2025 年 8 月 23 日 下午5:28

    You have brought up a very wonderful details, thanks for the post.

  • probiotic
    probiotic 2025 年 8 月 23 日 下午6:47

    Thanks for the sensible critique. Me & my neighbor were just preparing to do a little research on this. We got a grab a book from our area library but I think I learned more clear from this post. I am very glad to see such fantastic information being shared freely out there.

  • хоккей онлайн
    хоккей онлайн 2025 年 8 月 24 日 上午3:07

    Can I just say what a reduction to search out someone who actually knows what theyre talking about on the internet. You definitely know methods to bring a difficulty to gentle and make it important. Extra people need to learn this and understand this aspect of the story. I cant consider youre no more fashionable since you positively have the gift.

  • produtos mirra em São Carlos
    produtos mirra em São Carlos 2025 年 8 月 24 日 上午4:47

    You really make it appear really easy with your presentation but I find this topic to be really something that I believe I would never understand. It seems too complicated and extremely wide for me. I am looking ahead in your subsequent submit, I will try to get the hang of it!

  • rush 芳香
    rush 芳香 2025 年 8 月 24 日 上午6:23

    Utterly composed subject matter, Really enjoyed examining.

  • moviebox pro apk
    moviebox pro apk 2025 年 8 月 24 日 上午10:06

    I just couldn’t depart your web site before suggesting that I really enjoyed the standard information a person provide for your visitors? Is going to be back often in order to check up on new posts

  • Insulating Refractory Brick
    Insulating Refractory Brick 2025 年 8 月 24 日 上午11:52

    Nice post. I was checking continuously this blog and I am impressed! Extremely useful information specifically the last part :) I care for such information a lot. I was seeking this particular information for a very long time. Thank you and good luck.

  • seguradora samsung
    seguradora samsung 2025 年 8 月 24 日 下午10:03

    Nice post. I was checking constantly this blog and I am impressed! Very useful information specially the last part :) I care for such info much. I was looking for this particular info for a very long time. Thank you and good luck.

  • kopitogel
    kopitogel 2025 年 8 月 25 日 上午3:47

    Hello, Neat post. There is an issue with your web site in web explorer, might test this?K IE still is the marketplace leader and a big component to other people will miss your wonderful writing due to this problem.

  • Cara membatalkan pinjaman Kredione
    Cara membatalkan pinjaman Kredione 2025 年 8 月 25 日 上午10:16

    I do agree with all the ideas you’ve presented in your post. They are really convincing and will certainly work. Still, the posts are too short for newbies. Could you please extend them a little from next time? Thanks for the post.

  • kopitogel
    kopitogel 2025 年 8 月 25 日 下午12:19

    I rattling happy to find this web site on bing, just what I was looking for : D as well saved to bookmarks.

  • bandar toto macau
    bandar toto macau 2025 年 8 月 25 日 下午12:37

    Enjoyed examining this, very good stuff, regards.

  • top up game
    top up game 2025 年 8 月 25 日 下午1:58

    Whats Happening i’m new to this, I stumbled upon this I’ve discovered It positively helpful and it has aided me out loads. I am hoping to give a contribution & aid other users like its helped me. Good job.

  • pestoto link alternatif
    pestoto link alternatif 2025 年 8 月 25 日 下午5:14

    Unquestionably believe that that you stated. Your favorite reason seemed to be on the net the simplest factor to take into account of. I say to you, I certainly get irked whilst other folks consider concerns that they plainly do not recognise about. You managed to hit the nail upon the highest as smartly as defined out the entire thing without having side effect , people can take a signal. Will probably be back to get more. Thanks

  • pestoto jitu togel
    pestoto jitu togel 2025 年 8 月 25 日 下午11:41

    Greetings! I know this is kind of off topic but I was wondering if you knew where I could locate a captcha plugin for my comment form? I’m using the same blog platform as yours and I’m having trouble finding one? Thanks a lot!

  • who invented exams
    who invented exams 2025 年 8 月 26 日 上午1:37

    I’ve been exploring for a little bit for any high-quality articles or weblog posts in this kind of space . Exploring in Yahoo I eventually stumbled upon this site. Reading this information So i am satisfied to exhibit that I have a very just right uncanny feeling I found out just what I needed. I such a lot without a doubt will make sure to do not overlook this site and provides it a look on a constant basis.

  • kopitogel
    kopitogel 2025 年 8 月 26 日 上午3:12

    I am often to blogging and i really appreciate your content. The article has really peaks my interest. I am going to bookmark your site and keep checking for new information.

  • pestoto togel
    pestoto togel 2025 年 8 月 26 日 上午7:42

    I’ve been absent for some time, but now I remember why I used to love this website. Thank you, I’ll try and check back more frequently. How frequently you update your web site?

  • Lipovive
    Lipovive 2025 年 8 月 26 日 上午11:37

    I would like to thank you for the efforts you’ve put in writing this site. I’m hoping the same high-grade website post from you in the upcoming as well. Actually your creative writing skills has inspired me to get my own website now. Really the blogging is spreading its wings rapidly. Your write up is a good example of it.

  • prediksi togel
    prediksi togel 2025 年 8 月 26 日 下午3:30

    Hi there! This post couldn’t be written any better! Reading through this post reminds me of my previous room mate! He always kept talking about this. I will forward this article to him. Pretty sure he will have a good read. Thank you for sharing!

  • situs togel online
    situs togel online 2025 年 8 月 26 日 下午3:40

    I’ve recently started a site, the info you offer on this site has helped me greatly. Thank you for all of your time & work. “The achievements of an organization are the results of the combined effort of each individual.” by Vince Lombardi.

  • Lipovive
    Lipovive 2025 年 8 月 26 日 下午5:08

    I got what you mean , thankyou for posting.Woh I am lucky to find this website through google. “The test and use of a man’s education is that he finds pleasure in the exercise of his mind.” by Carl Barzun.

  • prediksi macau
    prediksi macau 2025 年 8 月 26 日 下午9:27

    Fantastic beat ! I would like to apprentice while you amend your website, how could i subscribe for a blog site? The account aided me a acceptable deal. I had been tiny bit acquainted of this your broadcast provided bright clear concept

  • Eva Bloom Soulmate Sketch
    Eva Bloom Soulmate Sketch 2025 年 8 月 27 日 上午3:36

    I gotta favorite this site it seems invaluable very useful

  • agen slot gacor
    agen slot gacor 2025 年 8 月 27 日 上午6:51

    I haven’t checked in here for some time since I thought it was getting boring, but the last few posts are great quality so I guess I’ll add you back to my everyday bloglist. You deserve it my friend :)

  • Eva Bloom
    Eva Bloom 2025 年 8 月 27 日 上午8:14

    Pretty! This was a really wonderful post. Thank you for your provided information.

  • light green sapphire
    light green sapphire 2025 年 8 月 27 日 下午2:37

    Attractive section of content. I just stumbled upon your website and in accession capital to assert that I get in fact enjoyed account your blog posts. Anyway I will be subscribing to your augment and even I achievement you access consistently quickly.

  • proteção contra acidentes Ipiranga
    proteção contra acidentes Ipiranga 2025 年 8 月 27 日 下午4:15

    I have recently started a web site, the info you offer on this website has helped me greatly. Thank you for all of your time & work.

  • Pink Salt Trick for Weight Loss
    Pink Salt Trick for Weight Loss 2025 年 8 月 27 日 下午7:29

    I was very pleased to find this web-site.I wanted to thanks for your time for this wonderful read!! I definitely enjoying every little bit of it and I have you bookmarked to check out new stuff you blog post.

  • indo cair
    indo cair 2025 年 8 月 27 日 下午10:02

    I really like your writing style, good info, appreciate it for putting up :D. “God save me from my friends. I can protect myself from my enemies.” by Claude Louis Hector de Villars.

  • Pink Salt Trick for Weight Loss
    Pink Salt Trick for Weight Loss 2025 年 8 月 28 日 上午6:50

    you have a great blog here! would you like to make some invite posts on my blog?

  • Pink Salt Trick for Weight Loss
    Pink Salt Trick for Weight Loss 2025 年 8 月 28 日 下午2:42

    I got what you mean ,bookmarked, very nice web site.