推荐微信扫码登录以获得更好的体验!另:🎉建议更新到最新版,以体验新功能!🎉 版本更新记录→

普林斯顿-耶鲁“相约周末”品读汇第七场:荣登《时代》杂志AI

字幕摘录

时间英文中文
0:03Good day, everyone, and welcome to this event at Yale Center大家好,欢迎来到耶鲁中心
0:08Beijing, Yale University's home here in China.北京,耶鲁大学在中国的故乡.
0:12And a special welcome to our speakers,特别欢迎我们的演讲者,
0:16Professor Aravind Narayanan and Dr. Sayesh Kapoor,阿拉文德·纳拉亚南教授和萨耶什·卡普尔博士
0:22as well as our commenter, Thomas Luo.以及我们的评论家 托马斯·罗
0:27Welcome to the center.欢迎来到中心
0:29I'm Carol Rafferty, a Yale College alumna我是卡罗拉费蒂,耶鲁大学的校友
0:32and also executive director of the Yale Center Beijing.并兼任耶鲁北京中心执行董事.
0:37And today we are so delighted to be hosting this book talk今天我们很高兴能主持这个书评会
0:42on AI snake oil, what artificial intelligence can do,在AI蛇油, 人工智能可以做什么,
展开字幕全文(1442 条)
序号英文中文
1Good day, everyone, and welcome to this event at Yale Center大家好,欢迎来到耶鲁中心
2Beijing, Yale University's home here in China.北京,耶鲁大学在中国的故乡.
3And a special welcome to our speakers,特别欢迎我们的演讲者,
4Professor Aravind Narayanan and Dr. Sayesh Kapoor,阿拉文德·纳拉亚南教授和萨耶什·卡普尔博士
5as well as our commenter, Thomas Luo.以及我们的评论家 托马斯·罗
6Welcome to the center.欢迎来到中心
7I'm Carol Rafferty, a Yale College alumna我是卡罗拉费蒂,耶鲁大学的校友
8and also executive director of the Yale Center Beijing.并兼任耶鲁北京中心执行董事.
9And today we are so delighted to be hosting this book talk今天我们很高兴能主持这个书评会
10on AI snake oil, what artificial intelligence can do,在AI蛇油, 人工智能可以做什么,
11what it can't, and how to tell the difference.和如何分辨区别。
12This is a collaboration with the Princeton University Press这是与普林斯顿大学出版社的合作
13Beijing office and is part of the Princeton and Yale北京办事处是普林斯顿和耶鲁大学的一部分
14ideas series, where we connect Chinese readers with Princeton我们把中国读者和普林斯顿联系起来
15University Press's authors on the most cutting edge大学出版社最尖端的作者
16ideas in our world.思想在我们的世界。
17So what's today's talk about?那么今天谈什么?
18I think the title of the book really perfectly我觉得书的题目很完美
19encapsulates what we're going to talk about,囊括了我们要谈的内容,
20which is what AI can do, what it can't,这是AI能做的,它不能做的,
21and how to tell the difference.和如何分辨区别。
22I don't know if our speakers online are able to tell,我不知道我们网上的演讲者能否说出
23but at 8 AM on a Friday night, you但星期五晚上8点,你
24have a full house of people who I see are probably有一整栋房子的人 我看见他们可能
25high school or middle school students to working高中或中学生参加工作
26professionals or diplomats or journalists or whatnot.专业或外交官或记者,等等。
27So I hope this would draw a wide audience for your book所以我希望这本书能吸引广大读者
28here in China.在中国
29We will also have live streaming audience joining online.我们也会有现场观众加入网络。
30So we'll be able to tell you the figures,所以我们可以告诉你数字
31although not as fast as you could虽然你没有最快的速度
32with the work you do in artificial intelligence.和你在人工智能中的工作有关
33So we're all very eager to hear what you have to say.所以我们都渴望听到你说的话
34A bit of introduction about our speakers and our commenter介绍一下我们的发言者和评论员
35today.今时.
36书作者Arvind Narayanan教授
37and Dr. Sayesh Kapoor from Princeton University,和普林斯顿大学的萨耶什·卡普尔博士,
38they have been recognized by Times Magazine被《时代杂志》认出来
39as two of the 100 most influential experts in AI.作为AI百大最具影响力的专家中的两位.
40Arvind Narayanan是计算机科学的教授
41at Princeton University and the director普林斯顿大学和院长
42of the Center for Information Technology Policy.信息技术政策中心
43He studies the societal impact of digital technologies,他研究了数字技术的社会影响,
44especially AI, and has co-authored a number of books,特别是大赦国际,并共同撰写了一些书籍,
45actually, including Fairness and Machine Learning,事实上,包括公平与机器学习,
46as well as, I found out in the book,还有,我在书里发现,
47Bitcoin and Cryptocurrency Technologies.比特币和密码货币技术。
48We need to invite you to speak for us more.我们需要邀请你代表我们发言。
49These are all very timely talks.这些都是非常及时的会谈。
50Sayesh Kapoor博士是博士候选人
51at the Center for Information Technology信息技术中心
52at Princeton University.在普林斯顿大学
53Princeton University, he previously worked for Facebook,普林斯顿大学 他以前在Facebook工作过
54doing content moderation, and conducted AI research进行内容节制,并进行人工智能研究
55at Columbia University and the Swiss Federal Institute哥伦比亚大学和瑞士联邦研究所
56of Technology in Lausanne.在洛桑的技术。
57Our commenter today, Thomas Luo,我们今天的评论员 托马斯·罗
58is the founding partner of GenAI Assembling是GenAI的创始合伙人
59and founder and CEO of Sea Planet and PingWest.也是海星球和平西的创始人兼首席执行官.
60Thomas is a prominent alumnus of Tsinghua University托马斯是清华大学的著名校友
61and has built a reputation as a keen observer并树立了观察者的声誉,
62of technological innovation in both China中国和中国的技术创新
63and the Silicon Valley.还有硅谷
64And before we dive into the discussion,在讨论之前
65I'd like to especially thank我想特别感谢
66the Princeton University Press Beijing Office普林斯顿大学出版社北京办事处
67and our Yale Center Beijing team for hosting this event,我们的耶鲁中心北京小组 主办这次活动,
68as well as this very fun series.还有这个很有趣的系列
69The Princeton University Press Beijing Office普林斯顿大学出版社北京办事处
70will also be gifting two copies of this book还会赠送两本书
71to the first two people in the audience who ask questions.给观众头两个问问题的人
72So this is very exciting, but the book is also available所以,这是非常令人兴奋的, 但书也有
73for sale after the event outside.外出活动后出售。
74So ka-ching, ka-ching, people will be buying your books.所以,卡青,卡青, 人们会买你的书。
75And without further ado, let's welcome our speakers不用多说了,欢迎我们的演讲者
76and commenter, thank you very much.和评论员,非常感谢。
77Thank you so much for that kind introduction.非常感谢你的介绍
78Hi everyone, my name is Arvind Narayanan.大家好 我叫阿文德·纳拉亚南
79I hope you can hear me okay.希望你听得见我说话
80I'm going to start us off with a few minutes我先从几分钟开始
81telling kind of the story of this book讲述这本书的故事
82and then Saish will do a presentation然后赛什会做一个演示
83of the contents of this book.本书的内容。
84And I will chime in from time to time我会不时地敲门
85during the presentation.介绍期间。
86And then I would love to hear your questions,然后我想听听你的问题
87have a discussion and so forth.有讨论等等。
88Thank you for being here on a Friday evening.谢谢你周五晚上能来
89Okay, so for me, the story of this book started对我来说,这本书的故事开始了
90many years ago when I was doing research多年前我做研究的时候
91on what could go wrong with artificial intelligence,人工智能有什么不对劲,
92particularly I was looking at potential biases特别是我看 潜在的偏见
93that could result, AI as you might know,你可能知道,艾丽克丝
94uses machine learning technology and the data that's used使用机器学习技术和所使用的数据
95for training machine learning comes from data created用于培训机器学习的数据
96by people, data about people.由人,关于人的数据。
97And so it's going to reflect cultural stereotypes因此,它将反映 文化定型观念
98in various societies.在各种社会中。
99Those could be gender biases,这些可能是性别偏见,
100those could be various other kinds of biases.这些可能是各种其他类型的偏见。
101And as you might know, there is an active community如你所知,有一个活跃的社区
102of researchers who are looking正在寻找的研究人员
103into these kinds of questions.进入这样的问题。
104However, around 2019, I started thinking about不过,2019年左右,我开始思考
105are there cases where there are problems deeper than bias?是否有比偏见更深层次的问题?
106Is AI being used in situations where it doesn't work at all人工智能是否被用于完全无效的情况
107and we shouldn't expect it to work at all?我们不该指望它能成功吗?
108And in particular, I saw over and over again尤其是,我一次又一次地看到
109that there were these hiring automation technologies有这些雇佣自动化技术
110where these AI vendors would go to companies and say,在那里,这些AI供应商 会去公司说,
111look, whenever you advertise a job opening,你看,每当你广告 一个职位空缺,
112you have hundreds of people,你有上百个人
113maybe a thousand people applying to this position.也许有一千人申请这个职位
114And if some of you are job seekers, you might know,如果你们有些人是求职者,你们可能知道
115I think this is true all around the world我觉得全世界都是这样
116that there are so many people competing有这么多人竞争
117for each individual job.每项工作。
118And so the people who are reviewing our job applications,所以那些审查我们工作申请的人
119they don't know what to do.他们不知道该怎么办。
120There are too many applications申请太多
121to review too many people to interview.以审查太多的人 采访。
122And so the AI companies were saying,所以AI公司说,
123look, use our AI product,用我们的人工智能产品
124ask your job candidates to upload a video,请候选人上传视频
125a short 30 second video where they're talking about短短的30秒视频 他们谈论
126not even so much their job qualifications,甚至没有这么多的工作资格,
127but about their hobbies or whatever.但他们的爱好或什么的。
128And our product will use AI to figure out their personality我们的产品会用人工智能 找出他们的个性
129and how good they're going to be at a particular job.以及他们在某项工作上有多好
130And it occurred to me that there was no possible way我突然想到,不可能有办法
131by which this could work.它可以通过它发挥作用。
132I did not know any evidence that AI is capable我不知道有证据表明AI有能力
133of this sort of thing.这种事
134And coincidentally at that time in 2019, five years ago,巧合的是,五年前的2019年,
135almost to the day actually,几乎直到今天,实际上,
136I was invited to give a talk at MIT我被邀请去麻省理工学院演讲
137and I gave a talk called AI Snake Oil.我做了一个叫AI蛇油。
138And I pointed to this and other kinds of AI technologies我指出这种和其它类型的AI技术
139that I thought couldn't work.我认为不能工作。
140I called it an elaborate random number generator.我把它称为一个精心的随机数生成器。
141And I pointed to evidence from research我指出研究的证据
142led by my Princeton colleague,在我的普林斯顿同事的带领下
143sociologist professor, Matthew Salkonic.马修·萨尔科尼奇社会学家教授.
144When you look at how well machine learning is able当你看机器学习有多好
145to predict what's going to happen in a person's life,预测一个人的生活中会发生什么
146the ability to predict that能够预测
147is only slightly better than random.仅略优于随机。
148And that should not be surprising, right?这不奇怪吧?
149The future is not determined yet.未来尚未确定。
150No one can know what's going to happen in the future.未来无量众生能知.
151Yes, if you have a lot of data and algorithms,是的 如果你有很多数据和算法
152you can do slightly better than random,你可以做比随机稍好一点,
153but it's really just picking up crude statistical patterns但它真的只是 收集粗糙的统计模式
154in the data.在数据中。
155It's not some magic technology that can see the future.并不是某些魔法技术能看见未来.
156So I gave that talk.所以我就说了
157The next day I put up my slides online.第二天我在网上放幻灯片
158I thought maybe 20 of my colleagues would look at it,我以为我的20个同事会看看
159but instead the slides went viral online.但幻灯片却在网络上传播
160And I didn't know that this is something我不知道这是什么
161that could happen with academic research.在学术研究中可能发生这种情况。
162And I was very surprised.我很惊讶。
163Within two days, I had 20 or actually more than that,在两天内,我还有20个或更多
16430 or 40 invitations in my inbox,我收件箱里有三四十份邀请函
165asking me to turn that talk into a book or an article叫我把这段话变成书或文章
166or something like that.或者类似的东西。
167And I was very surprised.我很惊讶。
168Why are people so interested in this topic?为什么人们对这个话题这么感兴趣?
169And I realized it was not because I had said我意识到这不是因为我说过
170something profound, but in fact,一些深刻的,但事实上,
171precisely because I had something正是因为我有东西
172that many people have noticed independently,许多人独立地注意到,
173that a lot of what is being sold as AI doesn't作为人工智能出售的很多东西
174and probably can't work.而且可能无法工作。
175Although, of course, there is a lot of genuine progress in AI.当然,大赦国际取得了许多真正的进展。
176We talk about that in the book as well.我们在书里也谈到了这一点。
177But while there are many people pushing back against faulty AI,但是,虽然有很多人反对错误的AI,
178there are relatively few computer scientists saying,计算机科学家说,
179look, I understand how AI works.听着,我知道AI是怎么工作的
180I built AI technology.我建立了AI技术。
181And I'm telling you that there is no way我告诉你,没有办法
182that this particular application of machine learning机器学习的特殊应用
183can possibly work.可能会工作。
184So I felt like that's a story I wanted to tell.所以我觉得那是我想讲的故事
185But at that time, I didn't feel ready to tell that story.但当时,我还没有准备好讲述这个故事.
186I felt like a lot more research needed to be done.我觉得需要做更多的研究。
187我很高兴Sayaj Kapoor加入我的队伍
188And as you heard in the introduction,正如你在介绍中听到的,
189he has built machine learning technologies他建立了机器学习技术
190在Facebook这样的地方。
191So he has seen what they can be useful for,故他看见他们对于什么是有用的,
192but also what their limitations have been firsthand.但他们的局限性是第一手的
193And we've been doing research for many years.我们已经做了多年的研究。
194And we've found many surprising things我们发现很多奇怪的事情
195in the course of that research.在研究过程中
196For instance, we've been looking at AI for science.例如,我们一直在寻找AI的科学。
197And of course, it can be very powerful.当然,它可能非常强大。
198We've had a couple of Nobel prizes我们有过几次诺贝尔奖
199for the application of AI to scientific discovery.应用人工智能进行科学发现。
200But we've also seen how it can really但我们也看到了 如何真正可以
201go wrong when scientists carelessly科学家粗心大意,就错了
202apply machine learning.应用机器学习。
203There can be errors in the claims索赔中可能有错误
204that you make that go undetected that are sitting你使那未被发现的坐着,
205in the scientific record until years later,在科学记录中,直到数年后,
206someone realizes that this discovery is actually bogus.有人意识到这个发现其实是虚假的.
207And we think that's a little bit of a crisis going on right我们认为,这是 一点点的危机正在发生
208now in the scientific world.现在在科学世界。
209And we've written papers exposing我们写了论文 揭露
210the scale at which these mistaken claims are being made.这些错误说法的提出规模。
211So it's been a learning process for us.所以这对我们来说是一个学习的过程。
212And we're so excited now to share some of those learnings我们非常兴奋地分享这些学习
213with you.和你们一起
214So with that, I will turn it over to Sayaj.这样我就把它交给Sayaj
215Thank you again for being here.再次感谢你来到这里。
216Absolutely, yeah.当然,是的。
217Thank you so much for being here, everyone.非常感谢你们能来,各位
218And thanks, Arvind, for that wonderful intro.谢谢你 阿文德 精彩的介绍
219So I wanted to start us off with the three words所以我想从三个字开始
220in the title of the book, just AI and snake oil,在书名,只是AI和蛇油,
221and basically talk about what we even mean并基本上谈论 我们甚至意味着什么
222when we use these words, AI.当我们用这些词,AI。
223So I think it's very surprising that despite 80 years of work所以,我觉得这非常令人惊讶的是, 尽管80年的工作
224in this area, it's still really hard在这个区域,还是很难
225to give an overarching definition of what constitutes AI.对什么构成大赦国际给出总体定义。
226But in the book, we use a three-factor test,但是在书中,我们用一个三要素测试,
227three loose criteria to determine if something三条松散的标准 来确定什么
228is or isn't AI.是还是不是AI。
229So I found this definition to be useful.所以我觉得这个定义很有用。
230I hope it is for you as well.我也希望你也会这样
231The first factor is whether the task第一个因素是任务是否
232that we are using AI or using a tool to solve我们使用AI或工具来解决
233requires some creative effort or training for humans.需要一些创造性的努力或对人类的培训。
234So one example is text-to-image tools所以一个例子是文本到图像工具
235that generate an image based on a prompt in the text.生成基于文本中提示的图像。
236This would be an example of AI by this definition,根据这一定义,这将是大赦国际的一个例子,
237because creating images or artwork因为创建图像或艺术品
238requires creative effort or training for humans.需要人类的创造性努力或培训。
239The second criteria is that the behavior of the tool第二个标准是工具的行为
240should not directly be specified in the code by the developer.开发者不应在代码中直接指定。
241So one example of such a tool might be a rule-based tool,因此,这种工具的一个例子是基于规则的工具,
242which sort of looks at your conditions什么样的情况
243and takes a specific decision based on that.并据此作出具体决定。
244In fact, even a thermostat, in some sense,事实上,即使是自动调温器, 在某种程度上,
245has its code or has its behavior directly specified.已直接指定其代码或行为。
246So if the temperature goes above a certain degree,如果温度超过一定程度
247you turn on the cooling.你打开冷却器。
248If the temperature goes below a certain degree,如果温度低于一定程度
249you turn on the heating.你打开暖气。
250That is not an example of AI.这不是大赦国际的例子。
251We do want the behavior to be learned我们确实希望人们能够了解我们的行为
252from patterns in the data rather than directly being从数据中的图案而不是直接
253hard-coded by the developers.由开发者硬编码.
254The third and final criteria that we are applying我们适用的第三项也是最后标准
255is that there should be some flexibility in the inputs即投入应有一定的灵活性。
256that we use to give to the tool.我们用来给工具。
257So for example, if we are using an AI tool比如说,如果我们在使用人工智能工具
258to distinguish between images of cats and dogs,区分猫和狗的画面,
259the tool should work about as well.工具也应该发挥作用。
260The tool should be able to take in inputs该工具应能够吸收投入
261that it hasn't seen before.从来没有见过。
262So it shouldn't just work on images of dogs and cats所以,它不应该只是工作 在狗和猫的形象
263that the tool has seen before,工具已经看到,
264but rather it should generalize to some extent但它应该在某种程度上概括
265to images that have not been seen before,给以前从未见过的图像,
266even if there is some accuracy loss.即使有 某些准确性损失。
267So this is like an overarching definition of what we mean所以,这就像一个总体的定义 我们的意思
268when we use the term AI.当我们使用AI这个词。
269Now, of course, as you can tell,现在,当然,如你所知,
270this is a really broad definition这是一个非常宽泛的定义
271and we'll come back to that in a minute.一会儿再谈这个
272But I want you to dive a little bit further但我希望你更远一点
273for just a minute,就一会儿,
274which is what is the dominant paradigm for using AI today?今天使用AI的主要模式是什么?
275And that is machine learning.这就是机器学习。
276So machine learning refers to learning from examples所以机器学习是指从实例中学习
277and learning patterns in the data数据中的学习模式
278using these past examples.使用这些过去的例子。
279So for example, given enough photos of cats比如说,给猫的照片足够多
280on the one hand and dogs on the other,一方面是狗 一方面是狗
281a machine learning system机器学习系统
282can learn to distinguish between the two.可以学会区分两者。
283I find this a hilarious example我觉得这个例子很有趣
284of the difficulty of trying to tell apart a labradoodle,很难分辨拉布拉多
285which is a type of dog from fried chicken in these images.这是一种狗 从炸鸡在这些图像。
286But given enough images of labradoodles on the one hand但只要一面足够多的拉布拉多面
287and fried chicken on the other,和煎鸡在另一边,
288AI systems can in fact today learn to distinguish the two.AI系统实际上今天可以学会区分两者.
289And to create tools like chat GPT,为了创造像聊天GPT这样的工具,
290a very similar process is followed.遵循的程序非常相似。
291So instead of these labels being provided by a human,而不是人类提供的标签
292the labels are generated automatically from existing data,标签由现有数据自动生成,
293say on the internet.在互联网上说。
294So for example, if the sentence,比如说,如果句子
295what is your name appears in the training set你叫什么名字出现在训练场
296or appears on some internet data,或出现在一些互联网数据,
297it might turn into four different examples可能会变成四个不同的例子
298used in the training data for tools like chat GPT.在训练数据中用于聊天GPT等工具.
299So the first example is what is your blank所以第一个例子就是你的空白
300and the correct answer would be name.正确的答案将是名字。
301The second example is what is blank name第二个例子是空白名称
302and the correct answer is your and so on.正确的答案是你,等等。
303And so machine learning really is what powers所以机器学习才是真正的力量
304a lot of the advances that we see in AI,在AI中看到的很多进步,
305especially in the last few years.特别是过去几年
306So this brings me to the next part of the title,因此,我来到标题的下一个部分,
307which is what is the snake oil in the title AI snake oil?AI蛇油标题中的蛇油是什么?
308So snake oil refers to this long standing蛇油是指这个长长的姿势
309or rather old tradition,或相当古老的传统,
310especially within the United States,特别是在美国,
311but all over the world of salesmen全世界都有推销员
312selling snake oil ointments销售蛇油膏
313as a cure for every single possible disease.作为治疗每一种可能疾病的方法。
314So for example, this poster here比如说,这张海报
315shows an example of Clark Stanley snake oil,以克拉克・斯坦利蛇油为例
316which was claimed to cure everything from rheumatism用来治愈风湿病
317to kidney stones to back pains and so on.肾结石的背痛等等。
318Now, of course, these medicines or oils现在,当然,这些药品或油
319did not really work very well.效果不怎么样
320And in the United States,在美国,
321the Food and Drug Administration was established成立了食品和药品管理局
322in part because of these false advertising claims.部分原因是这些虚假的广告主张。
323And as I've been mentioned,正如我所提到的,
324we think there's something similar going on with AI today.我们认为今天AI也有类似的事情发生.
325So this is a screenshot of the example这是一个例子的截图
326he mentioned in the beginning.他一开始提到过
327This is a tool that claims to predict这是一个工具 声称预测
328how well a candidate might do at a job候选人在工作上做得怎么样?
329and is being used by or is used by companies公司正在使用或正在使用
330that are seeking to hire people试图雇用人员
331to decide whose application to move on to the next stage决定谁申请进入下一阶段
332and whom to reject.且加以否认者,
333And this is the sort of information this tool gives out.这就是这个工具给出的信息。
334So note that it has a lot of detailed information所以请注意,它有很多详细的信息
335about every single person.关于每个人。
336In this case, on the top right,在这种情况下,在右上方,
337you'll see that this person is flagged as being assertive你会看到,这个人被标记为 坚定的
338and it even gives out a score.它甚至给出一个分数。
339So in this case, the score is 8.98.因此,在这种情况下,得分是8.98.
340Notice the two decimal points of precision.注意精确度的小数点。
341So it's really talking about how accurately所以,它真的是在谈论 如何准确
342this tool can determine how well this candidate would do.这一工具可以确定该候选人的工作情况。
343And as I've been said,如我所说,
344we think that many of these types of tools我们认为,许多这类工具
345are essentially elaborate random number generators.基本上是精心设计的随机数生成器。
346There is no evidence, very little peer reviewed work没有证据,同行评审的工作很少
347showing that these tools have any efficacy at all,表明这些工具有任何效力,
348let alone at predicting how well someone will do at their jobs.更别提预测别人的工作能做得多好了
349And I think this is the core of a message.我认为这是信息的核心。
350So our key message in the book所以书中的关键信息
351is that the most confusing thing about AI这是关于AI最令人困惑的事情
352is that AI is an umbrella term.AI是一个总括术语。
353It is the same term is used to refer这个词也用来指
354to many different types of technologies,许多不同类型的技术,
355which have very little to do with each other under the hood.和头罩下对方没什么关系
356So some of these technologies have made massive progress这些技术已经取得了巨大进步
357in the last 10 years.过去10年
358For example, generative AI.例如,遗传性AI.
359So the image here is an image generated using OpenAI's因此这里的图像是使用 OpenAI 生成的图像
360text to image tool called Dali.文本到图像工具,名为 Dali。
361It was an image generated using just a very simple prompt,这是用一个非常简单的提示生成的图像,
362an astronaut riding a horse.太空人骑着马
363And this is the image it came up with.这就是它产生的形象。
364And clearly we've been making improvements显然我们一直在改进
365to text generation models like chat GPT,到文本生成模型,如聊天GPT,
366to image generation models like Dali,像达利这样的图像生成模型
367and also to generative AI in other domains以及其它领域的遗传性AI
368like protein folding.像蛋白质折叠。
369All of these have indeed been transformative.所有这些确实是变革性的。
370On the other hand, we have tools which we call predictive AI.另一方面,我们有我们称之为预测性AI的工具。
371These are tools that are used to make predictions这些都是用来预测的工具
372about individual people's futures.关于个人的未来。
373And on that basis, make decisions about whether or not在此基础上,决定是否
374to hire them for a job,雇他们做工作,
375or whether they should be released on bail或应否保释他们
376when they're being criminally charged,当他们受到刑事指控时
377or what their insurance rates should be,或他们的保险费率是多少,
378or whether they should receive insurance and so on.或者他们是否应该得到保险等等。
379And I think this is where we find a lot of snake oil.我想这就是我们发现很多蛇油的地方。
380And we'll come back to predictive AI in a minute.我们马上就回来预测AI。
381But in the book, we also cover two other types但是在书中,我们也涵盖另外两种类型
382of applications of AI, including social media algorithms.包括社交媒体算法。
383Both the algorithms used to optimize for engagement两种算法都用来优化交战
384on social media, but also more importantly,但更重要的是,
385the algorithms that are used to moderate content用于调和内容的算法
386or to take down content if it does not agree或删除内容,如果它不同意
387with the policies that a social media platform has.以及社交媒体平台的政策。
388And finally, we briefly talk about robotics,最后,我们简短地谈到机器人
389including in self-driving cars in the book as well.包括书中的自驾车
390Okay, so let's get back to predictive AI,好吧,让我们回到预测AI,
391which is where I mentioned there's a lot of snake oil.我提到那里有很多蛇油
392So what we think is happening with predictive AI所以,我们认为发生 预测AI
393is that vendors who are selling predictive AI是卖预言AI的卖家
394exploit the public's confusion利用公众的困惑
395over the different types of AI.超越不同类型的AI。
396They sell their tools as if they're state of the art,他们卖自己的工具 仿佛他们最先进的,
397but under the hood,但是在引擎盖下
398these tools are doing something fairly unsophisticated.这些工具正在做一些相当不成熟的事情。
399For example, I really like this sort of case study比如说,我真的很喜欢这种案例研究
400of Ritorio.里托里奥
401Ritorio是一家雇佣公司。
402On its website, it claims to identify在其网站上,它声称识别
403and drive winning behaviors for different types of jobs,推动不同类型工作的胜利行为,
404including customer service.包括客户服务。
405And they use AI-powered video analysis他们使用人工智能的视频分析
406to make these determinations.作出这些决定。
407Now, in most cases, when companies make these claims,现在,在大多数情况下, 当公司提出这些要求,
408we don't really have the tools to assess我们真的没有工具来评估
409how well their tools work.他们的工具如何有效。
410But in this case, an investigative journalism group但在这个案子里 一个调查新闻组
411was able to get access to the tool能够访问工具
412and test out how well it works.并测试它的工作原理。
413What this found was astonishing.这个发现令人吃惊。
414So the same video of a person所以,同一个人视频
415with just the background in the back changed后面的背景就变了
416led to dramatically different scores.导致得分大不相同。
417So for example, in this image here,例如,在这个图像中,
418if someone was speaking in front of a plain background,如果有人在普通背景面前说话
419they would get a much lower score他们得到的分数会低得多
420compared to if they have an image of a bookshelf以有书架的形象发誓,
421in the background.在背景中显示。
422And they found many other such cases,他们发现了许多其他这样的案件,
423which highlighted that these tools强调了这些工具
424are essentially relying on correlations in the data.基本上依靠数据的关联性。
425They don't really look at what the job candidate is saying,他们并不真正看 候选人在说什么,
426but rather on superficial appearances,但其实是表面的,
427such as whether there's a bookshelf in the camera.比如摄像机里有没有书架
428Now, this might seem like a funny example,现在,这似乎是一个有趣的例子,
429but indeed it can be consequential if you're a job seeker.但是如果你是求职者,那就可能因此发生。
430But predictive AI has actually been used但预言AI实际上被使用
431for far more consequential applications.更具有后果的应用。
432For example, in 2013, the Netherlands deployed an algorithm例如,2013年,荷兰采用了算法
433to detect welfare fraud.发现福利欺诈。
434That is if families with children were taking money如果有孩子的家庭拿钱
435from the state in a fraudulent manner.从国家以欺诈的方式。
436The algorithm wrongly accused thousands of families算法错误地指责了成千上万的家庭
437and sent many into debt.并且使许多人背负债务。
438In some cases, families were asked to pay back在有些情况下,家庭被要求偿还
439over 100,000 euros.超过10万欧元。
440Six years after the algorithm was introduced,算法推出六年后
441it was finally found out that the algorithm had these flaws最后发现算法有这些缺陷
442and it was discontinued.它被中止了。
443And over the fallout over the algorithm was used,在算法的反射上,
444the Dutch prime minister荷兰总理
445and his entire cabinet had to resign.他的整个内阁不得不辞职。
446There are also examples within the US.在美国也有这方面的例子。
447So in 2017, US healthcare technology company Epic2017年,美国医疗科技公司Epic
448launched a sepsis prevention algorithm启动预防败血症算法
449and claimed to have an extremely high accuracy.并声称其准确度极高。
450Four years later, when an independent investigation四年后,当独立调查
451was conducted on the efficacy of this algorithm,以这种算法的功效进行,
452it found that the accuracy was actually much lower.它发现准确性实际上要低得多。
453So while Epic had claimed a relative accuracy of about 80%,虽然Epic声称相对准确度约为80%,
454the actual accuracy was about 60% or so,实际准确度约为60%左右,
455much closer to a coin toss.离掷硬币更近
456And one year after this investigation,调查一年后
457Epic discontinued this one size fits allEpic 停止使用此尺寸
458sepsis prediction model.败血症预测模型.
459Now, if companies can indeed predict sepsis early,现在,如果公司真的可以 早预测败血症,
460that would be a huge advance这将是一个巨大的进步
461because sepsis is one of the deadliest diseases,因为败血症是最致命的疾病之一
462especially in hospitals.特别是在医院里
463But here what we're seeing is there is inadequate validation但这里我们所看到的是 验证不充分
464of these tools in the real world.这些工具在现实世界。
465And finally, another example from the US最后,美国的另一个例子
466is the US state of Oregon in 20182018年是美国俄勒冈州
467implemented an algorithm to predict执行一个预测算法
468if children are at risk of maltreatment.如果儿童有遭受虐待的危险。
469But after widespread reports of bias但是在广泛报道偏见之后
470against black families in particular,特别是针对黑人家庭,
471the tool was discontinued in 2022.该工具于2022年中止。
472So you'll note that all three tools here所以,你会注意到,所有三个工具在这里
473are examples of predictive AI.它们是预测性AI的例子。
474In many cases, these tools just don't work在许多情况下,这些工具是没用的
475as well as they are promised to.他们确是被警告的。
476And that eventually leads to fallout over these tools use.这最终导致了这些工具的使用。
477But in the meantime, they're actively causing harm但与此同时,他们正在积极造成伤害
478to job seekers, to people who are taking child benefits向求职者、领取子女津贴的人发放
479and so on.诸如来.
480And in fact, there have been hundreds of such incidents事实上,发生了数百起这样的事件
481in the last few years in fields like insurance,在过去几年中, 在保险等领域,
482to mortgage, to the DHS,向人口与健康调查提供抵押贷款,
483to the Department of Homeland Security and so on.给国土安全部等等
484And I think this is what leads to our pessimism我觉得这就是导致我们悲观的原因
485about predictive AI.关于预测AI。
486And in fact, we have an entire chapter in the book事实上,书中有一章
487about how difficult it is to predict these life outcomes.预测这些生命结果有多难
488So it's not just about AI going wrong in these cases,所以这不仅仅是关于AI在这些情况中出错,
489but rather that many of the types of things但其实很多种类的东西
490we are trying to predict with AI我们试图与AI预测
491might have fundamental limits to their predictability.它们的可预测性可能会受到根本性的限制。
492So maybe I'll stop here for a minute所以,也许我会在这里停留一分钟
493and let Arvind chime in.让阿文德进来
494Sure, thank you.好的 谢谢
495Yes, I don't have too much to add.是的,我没有太多补充。
496I'll talk for a couple of minutes我谈几分钟
497and then we'll, at the end of the presentation,然后,在演讲结束时,
498I'll say a little bit more about what's in the book.略说经中之事.
499Unless you actually wanna go to that slide, Sayash,除非你真的想去看那张幻灯片 Sayash
500then I can go through that slide if that's okay.如果可以的话 我可以通过幻灯片
501Great.不错
502So this is our way of thinking about这就是我们思考的方式
503all of the things that can go right or wrong with AI.所有那些可以对错的AI。
504So we have placed,所以,我们安置,
505and this is from the introductory chapter of the book,这是书中介绍的一章,
506we have placed various applications of AI我们提出了各种AI的申请。
507into this two-dimensional chart.输入此二维图表。
508On the X axis, what you see is a spectrum.在X轴上,你看到的是光谱.
509Some applications of AI are completely fine.AI的一些应用完全没问题.
510For instance, autocomplete in our phones,例如,自动完成我们的手机,
511that's an example of AI,这是AI的例子,
512or at least it would have been called AI at one point,或者至少应该叫AI,
513but it's no longer necessarily called AI today.但它今天不一定叫AI了
514I'll come back to that point.我会回到这一点。
515We have a slide on that.我们有一个幻灯片。
516And on the right-hand side,在右边
517we have many applications of AI that we think are harmful.我们有很多AI的应用 我们认为是有害的。
518So if you look at the top right, for instance,所以,如果你看看右上方,例如,
519we have criminal risk prediction that Sayash talked about.萨亚什所说的犯罪风险预测
520We don't think AI should be used to predict我们认为不应该用AI来预测
521who might commit a crime in the future.将来可能会犯罪
522That's just not something we should use AI for.我们不该用人工智能的
523And similarly, video interviews,同样,视频采访,
524we don't think AI should be used我们认为不应该使用AI
525for analyzing people's videos分析人们的视频
526to see how well they will perform at a particular job.看看他们在某项工作上表现如何。
527There's just no basis to expect that to work.没有理由期望它能成功
528So that's the X axis.这就是X轴
529But on the Y axis, what you see here但是在Y轴上,你在这里看到的
530is that regardless of whether something works well是,不管 东西是否工作良好
531or doesn't work at all, that's the Y axis,或者根本没用 这就是Y轴
532it can be either benign or harmful.可以是良性的,也可以是有害的。
533So for instance, autocomplete works really well,比如说,自动完成非常有效
534but if you look at the bottom middle,但是如果你看看中间的底部
535image generation for stock photography,用于 stock 摄影的图像生成,
536it's true that image generators like Dolly or Majourney是真的,像多莉或Majourney这样的图像生成器
537or even video generators can do a really good job.甚至是视频生成器都能做得很好
538That doesn't mean that that application of AI这并不意味着AI的应用
539is completely okay.完全没事。
540There are some problems with that.有一些问题。
541The big problem with that application of AI适用大赦国际的重大问题
542is that it is trained on data created by artists,由艺术家创造的数据
543photographers, and other creative people,摄影师和其他有创造力的人
544and they are not being compensated in any way.而且他们没有得到任何补偿。
545So this is something we talk about in the book.所以我们在书里谈这个
546As a society, how can we remedy this injustice?作为一个社会,我们如何纠正这种不公正?
547I think that's an important question we should ask.我认为这是一个我们应该问的重要问题。
548It's not that we should stop using image generators.我们不应该停止使用图像生成器。
549That's not what we're recommending.这不是我们的建议
550We use image generators ourselves.我们自己使用图像生成器。
551This is less of an issue for individuals to be aware of这对人们来说不是一个了解的问题。
552and more of an issue for society, for regulators,对于社会,对于监管者来说,
553for the media to bring attention to and so forth.让媒体引起注意等等。
554So on the bottom left here are things左边的底部有东西
555that both work well and are not really problematic.两者都运作良好,而且没有真正的问题。
556So another example is code generation.所以另一个例子是代码生成。
557As you might know, you can use AI你可能知道,你可以使用人工智能
558to automatically generate code.以自动生成代码。
559It can even create entire apps, relatively simple apps.它甚至可以创建整个应用程序,相对简单的应用程序.
560Again, these are things we make use of ourselves再说一遍,这些是我们利用的
561pretty heavily.相当严重。
562It's not a really problematic application of AI.这不是一个真正的问题 应用AI。
563We do have to think about, are there security bugs我们一定要考虑一下 是否有安全漏洞
564in the generated code, for instance?例如,在生成的代码中?
565There is research showing that AI-generated code有研究表明AI生成的代码
566can have more security vulnerabilities,安全漏洞可能更多,
567making it more vulnerable to hackers.让它更容易被黑客攻击
568That's something we all need to be aware of.这是我们都需要意识到的。
569But overall, that's an application of AI但总的来说,这是AI的应用
570that we very much approve of.我们非常赞成
571And going back to the top right, sorry,回到右上方 对不起
572if you could stay on that slide, Sayash,如果你可以留在幻灯片上,萨亚什,
573going back to the top right,回到右上方,
574we talked about criminal risk prediction.我们谈了犯罪风险预测
575We talked about video interviews.我们谈论了视频采访。
576Another one here is cheating detection.这里还有一个是作弊检测
577So what this is talking about is, as you might know,所以,这是在谈论, 正如你可能知道,
578many educators are concerned that students are using许多教育工作者担心学生会使用
579ChatJPT和其他AI工具做功课.
580And so there are a lot of AI products所以有很多AI产品
581claiming to detect which homeworks are AI-generated.声称检测哪些作业是AI生成的.
582And perhaps some of you have experience with this yourselves也许你们中有些人有经验
583that these tools don't work well,这些工具不起作用,
584and all over the world,和全世界,
585students are getting falsely accused of cheating using AI.学生被诬告利用AI作弊.
586And we think that is a huge, huge problem.我们认为这是一个巨大的问题。
587Instructors shouldn't be using these.教官不应该用这些
588They should be modifying the education system他们应该改变教育制度
589so that they don't have to worry about让他们不必担心
590学生是否使用 ChatJPT 。
591We have been doing a lot of that work ourselves我们自己做了很多工作
592in our own teaching here at Princeton.我们自己在普林斯顿教书
593So that's the bottom left, and that's the top right.这就是左下方,右上方。
594On the other hand,另一方面,
595there is something like predicting civil wars,有类似预言的内战,
596which you see in the closer to the top left here.在离这里最近的地方。
597So that is a case where it's not a commercial application因此,这是一个案例,它不是一个商业应用
598of AI, but instead it is a scientific application of AI.但是,这是大赦国际的科学应用。
599A lot of papers in political science很多政治学论文
600that said we can accurately predict说我们可以准确预测
601where civil wars are going to happen using AI.使用AI进行内战。
602And our investigation showed, we have a paper on this,我们的调查显示,我们有一篇论文
603that all of those papers had errors.所有的文件都有错误
604That doesn't work at all.这根本行不通
605And just like we said,正如我们所说,
606we shouldn't expect to be able to predict我们不应该指望能够预测
607people's future behavior,人们的未来行为,
608who might commit a crime or who will be good at a job.谁可能犯罪,谁将善于工作。
609We also shouldn't expect to be able to predict我们也不应该指望能够预测
610where wars will happen.在那里,战争将发生。
611There are theoretical reasons to expect理论上是有原因的
612that wars are fundamentally unpredictable.战争根本无法预测
613So this is a theme that we keep coming back to因此,这是一个主题 我们继续回来
614over and over in the book,一遍又一遍地在书中,
615that the future is fundamentally unpredictable.未来根本无法预测。
616So one last thing I will end with,所以我最后要说一件事
617Sayesh, if you could go to that slide.萨耶什,如果你可以去那个幻灯片。
618There is a funny definition of AI that says,AI有个有趣的定义说,
619AI is whatever hasn't been done yet.AI是所有还没有做过的事情。
620So what does that mean?这是什么意思?
621AI is whatever hasn't been done yet.AI是所有还没有做过的事情。
622So when an application of AI starts working really well,所以当人工智能的应用开始有效时
623like we have a bunch of examples of these in the slide.就像我们在幻灯片里有很多例子
624So things like the Roomba or other robot vacuum cleaners,所以像Roomba或其他机器人吸尘器
625or even a web search and so forth.甚至网络搜索等等
626So all of these examples on the slide,因此,所有这些例子在幻灯片上,
627we probably use on a daily basis, right?我们可能每天使用,对不对?
628Speech recognition, we all dictate texts to our phones.语音识别 我们都会给手机发短信
629They work really well.他们的工作真的很好。
630And when that happens,而当它发生的时候,
631it kind of fades into the background.它会消失在背景中
632We take it for granted.我们认为这是理所当然的。
633We stop calling it AI.我们不再叫它AI
634It's when an application of AI is new,这是当一个应用AI是新的,
635like much of generative AI today,就像今天的许多基因AI,
636when it can work well,当它可以运行良好,
637but also can really go wrong也会出错的
638when it has societally double edged implications.它具有双重社会边缘影响。
639That's when we are more likely to call it AI.那时我们更可能把它称为AI.
640And so that's what it means.故其义也.
641AI is whatever hasn't been done yet.AI是所有还没有做过的事情。
642The definition of AI constantly keeps getting redefinedAI的定义不断被重新定义
643so that it's always at the frontier of what is possible.让它永远处于可能的前沿
644And then that's part of the reason然后这就是原因之一
645why AI doesn't have a technical definition.为什么AI没有技术定义.
646It's more of a sociological definition这更是一个社会学的定义
647of what we collectively choose to call AI我们集体选择的AI
648because we want to indicate因为我们想表明
649that it's cutting edge technology.这是尖端技术。
650And so what we predict所以,我们预测
651is that much of what we call AI today,这就是我们今天所说的AI,
652like self-driving cars,像自驾车,
653those are called AI today.他们今天被称为AI。
654But one day, even though self-driving cars today但有一天,尽管今天自驾车
655occasionally get into crashes,偶尔会撞车
656there are even deaths due to self-driving cars,甚至因为自驾车而死亡
657one day that'll be a solved engineering problem.有一天,那将是一个解决的工程问题。
658We think the number of accidents from self-driving cars我们认为自驾车事故的数量
659will drop to nearly zero.将降至近零。
660There are historical examples of this.有历史的例子可以说明这一点。
661When elevators first were a thing,当电梯第一次是一件事情,
662there was a huge amount of concern about their safety.他们的安全受到极大关注。
663But now, of course,但现在,当然
664elevator accidents are extremely, extremely rare.电梯事故极为罕见。
665And so we think this will happen with self-driving cars.所以,我们认为这会发生 在自驾车。
666We won't call it AI anymore.我们不会再叫它人工智能了
667We'll take it for granted.以是义故.
668In fact, we will even drop the term self-driving.事实上,我们甚至会放弃自我驾驶这一术语。
669We will just call them cars most likely,我们只管叫他们车子
670and we'll need a new term like manual car我们需要像手动汽车这样的新术语
671for what we call cars today.今天我们称之为汽车。
672And so that's our optimistic vision for the future of AI.这就是我们对AI未来的乐观愿景.
673This is the kind of AI we want more of,这是那种我们想要更多的AI,
674tools that do a specific task that work well执行具体任务的工具
675and don't have these kind of dubious societal implications并且没有这种可疑的社会影响
676like many other technologies like criminal risk scoring.就像许多其他技术 比如犯罪风险评分。
677Self-driving cars are going to save自驾车会省钱的
678perhaps on the order of a million lives per year也许每年有100万条生命
679that are lost today due to car accidents.今天因为车祸而失去的
680On the other hand, criminal risk scoring另一方面,犯罪风险得分
681will never become this technology永远不会成为这种技术
682that we take for granted, I think,我认为我们是理所当然的,
683because the problems with it are not technical.因为它的问题不是技术性的。
684It's not that we need more data to better predict the future.我们不需要更多的数据来更好地预测未来。
685It's rather that the future is fundamentally unpredictable,更确切地说,未来根本上是不可预测的,
686and it's not morally justified to predict而在道德上无法预测
687what someone is going to do别人会怎么做?
688and punish them on the basis of that.并据此惩罚他们。
689It's only morally justified to punish someone惩罚别人才有道德上的理由
690on the basis of what they have already done.以他们已经做的为基础。
691And so because of that, criminal risk scoring因此,犯罪风险得分
692will not become this acceptable technology将不会成为这种可接受的技术
693that we take for granted, but self-driving cars will.我们当然可以 但自驾车会
694That's our prediction.这是我们的预测。
695And so hopefully that gives you an idea of the distinction希望这能给你一个区别的想法
696between the kinds of AI that we want more of我们想要更多的人工智能
697and the kinds of AI that we want to push back on.以及我们想继续的人工智能
698Okay, back to you, Sayas.好吧,回到你,萨亚斯。
699Fantastic, thank you, Arvind.太棒了 谢谢你 阿文德
700So maybe in the next like 10 minutes or so,也许在接下来的10分钟左右,
701we'll quickly jump into one other chapter in the book我们很快会跳进书的另一章
702which talks about how AI hype persists.它讲述了AI的喧闹是如何持续的.
703So I think one reason for AI hype persisting is clear,所以我认为一个原因 AIhype坚持是清楚的,
704which is that companies conflate the different types of AI即公司将不同类型的AI混为一谈
705which have very little to do with each other,他们彼此之间几乎没有任何关系,
706things like generative AI and predictive AI.比如基因AI和预测AI
707And while generative AI has made a lot of advances虽然基因AI取得了很大进步
708over the last decade,过去十年,
709predictive AI essentially relies on decades-old technology.预测性AI主要依靠几十年的技术.
710But when companies conflate these two,但当公司把这两个人混为一谈时,
711that results in hype about these products.导致这些产品的喧嚣。
712But I think there are also companies但我认为还有公司
713that sell generative AI tools or like,出售基因AI工具或类似,
714there's essentially a lot of hype基本上有很多杂音
715around generative AI tools themselves.围绕基因AI工具本身。
716Here's what I mean by that.这就是我的意思。
717So this is a screenshot of the abstract这就是抽象的截图
718OpenAI的技术报告
719when it released the GPT-4 series of models.当它发布GPT-4系列模型时.
720And in that abstract was a very interesting sentence.在这个抽象中,有一个非常有趣的句子。
721So OpenAI said that GPT-4 exhibits human level performance所以OpenAI说,GPT-4展示了人类层面的表现.
722on various professional and academic benchmarks,关于各种专业和学术基准,
723including passing a simulated bar exam包括通过模拟酒吧考试
724with a score in the top 10% of test takers.在考试录取者中得分最高的10%。
725What this sentence was interpreted to mean very widely,这句话被解释为非常广泛的含义,
726including in the press,包括媒体,
727was that GPT-4 is about to replace lawyers.是GPT -4即将取代律师。
728But if you think that's what's likely to happen,但如果你认为这有可能发生
729I think that is an example of AI hype as well,我认为这也是AI hype的例子,
730which was peddled quite heavily by these news organizations被这些新闻组织大肆推崇
731once GPT-4 was launched.在GPT-4发射后
732And that's because it's not a lawyer's job因为这不是律师的工作
733to answer bar exam questions all day.整天回答律师考试的问题
734And so when we rely on these benchmarks所以,当我们依靠这些基准
735to see how well these tools can be used以了解这些工具的使用情况
736to solve real world tasks,解决现实世界的任务,
737or perhaps even do the job of a real person,或者甚至做一个真正的人的工作,
738I think that leads to exaggerated claims.我认为这导致了夸张的说法。
739Now, these exaggerated claims are not new at all.现在,这些夸张的说法根本不新鲜。
740So this is Jeffrey Hinton,这是杰弗里·欣顿
741the recent Nobel Prize winner in 2016.2016年的诺贝尔奖获得者
742In 2016, he said, and I'm quoting him,2016年,他说, 我在引用他的话,
743is, if you work as a radiologist,如果你是放射学家
744you like the coyote that's already over the edge你喜欢野狼已经越过边缘
745of the cliff, but hasn't yet looked down.但还没有往下看
746So he doesn't realize there's no ground underneath him.所以他不知道下面没有地盘
747He goes on to say,他接着说,
748people should stop training radiologists now.人们应该停止训练放射科医生
749It's just completely obvious that within five years,很明显,五年内,
750deep learning is going to do better than radiologists.深入学习会比放射科医生做得更好。
751Mind you, the statement was in 2016.请注意,声明是在2016年。
752In 2024, there was a worldwide shortage of radiologists.2024年,全世界缺乏放射学家.
753So why is this disconnect happening?那么,为什么这种断开?
754I think one of the reasons is that methods experts我认为原因之一是 方法专家
755like Jeff Hinton certainly is,就像杰夫・欣顿当然是,
756so experts who sort of think about AI very deeply,因此,专家 排序思考AI非常深刻,
757perhaps don't really understand也许不太明白
758what it is for domain experts,对于域专家来说,
759people who work as radiologists or lawyers or what have you,那些做放射科医生或律师的人 或者你有什么
760to actually, what it takes实际上,它需要什么
761to actually do their jobs very well.真正做好他们的工作
762So they're not in the best position所以他们不是最好的人选
763to talk about the impact of AI on those jobs.讨论AI对这些工作的影响。
764So that's certainly one factor.这当然是一个因素。
765Another factor is that the AI we have today另一个因素是今天的人工智能
766perhaps might not be up to the mark itself也许不能达到标记本身
767when it comes to replacing radiologists.在替换放射科医生的时候
768So here's what happened, and this is like an example事情是这样的 这就像一个例子
769of how an AI tool that was trying to diagnose pneumonia试图诊断肺炎的AI工具
770from chest x-rays went wrong.胸部X光检查出了问题
771So this is an example of the chest x-ray,这是胸部X光的例子
772and the tool was meant to sort of diagnose pneumonia工具是用来诊断肺炎的
773on this basis.在这方面。
774But what instead happened was,但结果却是
775as you can see on the slide, on the top right,正如你可以看到在幻灯片, 在右上方,
776almost the entire sort of reason the AI model几乎都是人工智能模型的原因
777was making its decisions about pneumonia正在决定肺炎
778was based on whether or not there was a hospital token是因为有没有医院的标志
779on the top right side of the image.在图像的右上方。
780So instead of looking at the lungs for evidence of pneumonia,所以,与其看肺部 肺炎的证据,
781all the AI tool was doing was recognizingAI工具所做的一切 正在承认
782what token the hospital had put on the top right side,医院在右上方放了什么标志
783and on this basis, making its decisions.并在此基础上作出决定。
784So this is an example of a failure in AI tools所以这是AI工具失败的例子
785that we'll come back to.我们会回来的
786But for the moment, let's come back to this sort of map但暂时,让我们回到这种地图
787of how AI hype persists.爱尔莎·霍普如何坚持下去。
788So the first reason for AI hype所以,第一个原因 AIhype
789is that companies make tall claims,是公司提出高要求,
790whether it's predictive AI companies是否是预测性的AI公司
791sort of claiming to sell AI那种声称出售AI
792and conflating between different types of AI,以及不同类别AI之间的混杂,
793or generative AI companies that overcame或基因化AI公司 克服
794how well their tools work and how general they are.他们的工具如何运作,他们如何是普通的。
795Now, let's head back to the sphere of research现在,让我们回到研究领域去
796for a minute.一分钟。
797So how do we tell in AI research所以,我们如何在AI的研究中说
798how well a system performs?系统表现如何?
799The best way of doing this最好的办法
800and the most widespread way of doing this today以及今天最普遍的方法
801is by using something called benchmark datasets.是通过使用一个叫做基准数据集。
802So for OpenAI's example, the dataset that they used以OpenAI为例,他们使用的数据集
803was that of a simulated bar exam,是模拟律师考试,
804where they took a number of questions,他们问了一些问题,
805mostly multiple choice questions,多数选择问题,
806and asked the model to respond with answers.并要求模特儿回答
807And what you then do is you train the AI systems然后你做的是训练人工智能系统
808on one part of it.在其中的一部分。
809But crucially, you set aside,但关键是,你让开
810let's say around 30% or half of the test of the dataset假设数据集测试的30%或一半左右
811to evaluate the AI models on that test set.评估测试组上的AI模型。
812And this part is essential to machine learning more broadly而这部分对于机器学习更广泛至关重要
813because if you don't separate out this dataset,因为如果你不分开这个数据集,
814if you evaluate your AI on the same dataset如果你在同一个数据集上评价你的AI
815it was trained on,它被训练在,
816then you're essentially teaching to the test.那你基本上就是在教测试
817So the AI tool can essentially memorize the examples因此,AI工具基本上可以记住实例
818in the dataset that it was trained on.在它所训练的数据集中。
819And this is an example of what we call leakage.这就是我们所谓的渗漏的例子。
820So there is information that is leaked about the dataset因此,有信息泄露 关于数据集
821to the AI tool by virtue of being trained通过培训,加入AI工具
822on the entire dataset.整个数据集。
823And there's no sort of hidden test set没有隐藏的测试集
824that it can be evaluated on.它可以被评价。
825So this is one example of leakage.所以这是渗漏的一个例子。
826There are other examples as well.还有其他例子。
827So the chest x-ray image that we saw a few slides earlier因此,胸部X射线图像,我们看到一些幻灯片之前
828is an example of what happens when we rely on these AI tools就是我们依靠这些人工智能工具 会发生什么的例子
829{\fn黑体\fs22\bord1\shad0\3aHBE\4aH00\fscx67\fscy66\2cHFFFFFF\3cH808080}只有像那些已经隐藏的答案
830in the chest x-ray.胸前X光检查
831So if there's like a token that indicates所以,如果有像一个标志 显示
832that a chest x-ray scan is from a particular hospital胸部X光扫描来自某家医院
833that makes it more likely for the AI tool to work well这使得人工智能工具更容易运作
834on images from that hospital, but not from other ones.在医院的照片上,但不是其他的。
835So as I mentioned a few years ago,所以,正如我几年前提到的,
836we started looking at this problem我们开始研究这个问题
837in the field of civil war prediction.在内战预测领域。
838And we found that every single paper我们发现每张纸
839which claimed that AI tools did better声称AI工具做得更好
840than decades old regression methods,数十年来的回归方法,
841every single one of those papers每一个文件
842suffered from some of the other form of leakage.受到某种其他形式的渗漏的影响。
843And in fact, this sort of led us to investigate事实上,这导致我们调查
844whether leakage is also an issue in other science fields渗漏是否也是其他科学领域的一个问题
845that are adopting AI and machine learning.正在通过人工智能和机器学习。
846And when we looked at ML-based science,当我们看着基于ML的科学,
847that is scientific research that uses machine learning,这是利用机器学习的科学研究,
848we found that leakage is widespread in these fields.我们发现在这些领域渗漏很普遍。
849So this is a screenshot from a paper from 2023,这是2023年一篇论文的截图
850where we found that over 294 papers我们发现294份论文
851across 17 different scientific fields suffered from leakage.共有17个不同的科学领域受到渗漏的影响。
852And perhaps more surprisingly,也许更令人惊讶的是,
853we found that each of these fields我们发现 每一个领域
854was independently rediscovering what it means是独立地重新发现它的意思
855for AI results to be impacted by leakage.AI结果受到渗漏的影响。
856We have since updated this survey.我们自此更新了这项调查。
857So in our latest run, we found over 600 papers所以最近我们发现600多份论文
858across 30 different fields suffering from leakage.覆盖30个不同田地 受到渗漏影响
859And we think it very much is contributing我们认为它很有贡献
860to a crisis in science.在科学危机。
861In fact, this crisis has been outlined事实上,这场危机已经概述
862by several sort of journalistic pieces,以数种新闻片,
863and others have also caught onto it.其他人也发现了
864We've heard about data leakage causing issues我们听说数据泄露引起问题
865in healthcare, in machine learning,在保健,机器学习,
866research in other scientific disciplines, and so on.其他科学学科的研究,等等。
867And while there are genuine advances absolutely虽然有真正的进步 绝对
868that AI has led to things like alpha foldAI导致了类似α折叠的东西
869and protein folding models和蛋白质折叠模型
870that have rightly been recognized,他们确已被确认,
871there is also a vast amount of research还有大量的研究
872that suffers from this reproducibility crisis受到这种可复制危机的伤害
873primarily because of leakage.主要因为渗漏。
874Okay, so let's come back to our map of how AI hype persists.好吧,让我们回到我们的地图 如何AI的hype坚持。
875So our first part was companies making tall claims所以,我们的第一部分是公司 提出高要求
876without transparency.没有透明度。
877In addition to that, AI research is suffering除此之外,AI的研究也在受苦
878from a reproducibility crisis.从可复制的危机。
879And what these two things together mean这两件事的意义
880is that most of the prominent AI results that we see大部分显著的AI结果,我们看到
881are likely to be exaggerated.可能会被夸大
882On top of that, we've also seen a lot of input此外,我们还看到很多投入
883by public figures.根据公众人物。
884So for example, when GPT-4 came out,例如GPT-4出来后
885many influential people signed this open letter许多有影响力的人都签署了这份公开信
886that called for a pause on giant AI experiments.这要求暂停巨型AI实验
887This letter also mentioned that AI that is more powerful这封信还提到,大赦国际的权力更大。
888than GPT-4 could pose civilization level risks,超过GPT-4可能造成文明程度的风险,
889perhaps even the risk of extinction.甚至还有灭绝的危险
890And on that basis, all of these signatories在此基础上,所有签署者
891were asking to pause these experiments.他们要求暂停这些实验
892We call this an example of critique hype,我们称这为批评胡言乱语的例子,
893that is criticism at face value,也就是正面的批评,
894which also leads to hype about AI.这也导致了关于AI的喧嚣.
895In this case, for instance,例如,在这种情况下,
896by saying that AI will soon be powerful enough说AI很快会足够强大
897to pose civilization wide risks.给文明带来巨大的风险。
898And I think this is an example of something我想这是个例子
899that's quite pervasive today,今天很普遍,
900and especially by public figures特别是公众人物
901who talk about the harms of AI.他们谈论AI的伤害。
902So coming back to the map,所以回到地图上
903in addition to prominent AI results being exaggerated,除了显著的AI结果被夸大外,
904public figures also distract from the real issues公众人物也分散对实际问题的注意力
905of misinformation that is likely to arise可能发生的错误信息
906when people over rely on these tools当人们依赖这些工具时
907or perhaps the labor implications of tools或也许工具对劳动力的影响
908by pointing to sci-fi threats like civilizational collapse.指向科幻威胁 比如文明崩溃
909And both of these together mean两者都意味着
910that there is rampant AI hype有猖獗的AI 谣言
911in many of the sources of information在许多信息来源中
912that are available to people.给人们提供
913Finally, the way this information is conveyed to the public最后,如何向公众传播这一信息
914closes the feedback loop of hype.关闭hype的反馈循环。
915So here's a screenshot这是一张截图
916of what popular news headlines look like大众新闻头条是什么样子
917right after Microsoft launched their Bing's AI chat,就在微软推出他们的AI聊天后
918which relied on GPT-4 under the hood.它依赖于GPT-4 在引擎盖下。
919The New York Times said,纽约时报说,
920Bing's AI chat, I want to be alive.Bing的AI聊天 我想活着
921There were other outlets, for instance,还有其他渠道,例如,
922saying things like, are AI chat bots turning sentient?说着什么 AI聊天会变得有灵性吗?
923And we think that when the public is faced我们认为当公众面对
924with headline after headline,标题后为标题,
925claiming that AI could perhaps be sentient,声称大赦国际可能具有灵敏性,
926that has a really negative effect这真的有负面效应
927on how the public could treat AI systems,关于公众如何对待AI系统,
928perhaps as being sentient.也许是有意识的
929The really sad thing about all of this这一切真可悲
930is that we have known for at least six decades now我们至少已经知道60年了
931that when humans interact with AI-based chat bots,当人类与基于AI的聊天室互动时
932they are likely to anthropomorphize them,他们有可能使他们变成人类,
933to treat them as if they were human-like.把他们当人一样对待
934So for example, this is an image of Eliza,比如说 这是伊丽莎的影像
935a chat bot that was developed by Joseph Weissenbaum in 1966.1966年由约瑟夫·魏森鲍姆开发的聊天机器人.
936Eliza is an example of a really simple chat bot.伊丽莎是一个非常简单的聊天机器人的例子。
937All it is doing is sort of parroting back your responses它所做的只是 某种程度地解释你的答复
938in the form of a question,以问题的形式,
939and even technically, it is extremely rudimentary.即使是在技术上,它也是极其初级的。
940It just has a list of rules on the basis of which它有一份规则清单 在此基础上
941it asks the next question or sends the next message.它问下一个问题 或发送下一个信息。
942So for example, Eliza could start with something like,比如说,伊丽莎可以从...
943is something troubling you?有什么问题吗?
944And the person might respond, men are all alike.这个人可能会回应 男人都一样
945Eliza would just respond伊丽莎会回应的
946with a fairly generic question in this case.还有一个很普通的问题
947What is the connection, do you suppose?你觉得有什么联系?
948And so on and so forth.及诸众生.
949The really interesting thing about Eliza关于伊丽莎的有趣的事
950is not how it was designed,这不是设计它的方式,
951but rather the effect it had但它的影响
952on people who interacted with it.与它互动的人。
953Many of the people who talked to this chat bot很多和这个聊天机器人交谈的人
954would, after the conversation, refuse to believe在谈话后 拒绝相信
955that they just talked to an AI chat bot,他们刚跟一个AI聊天机器人谈过了
956that they hadn't really talked to another human.他们没有真的跟另一个人说话。
957This was termed the Eliza effect这被称为伊丽莎效应
958as an example of the implications of treating AI systems作为处理AI系统所涉问题的一个例子
959as if they are human-like.就像他们像人类一样
960And so given that we have this vast amount of understanding所以考虑到我们有 如此巨大的理解
961and like many experiments,像很多实验一样
962showing that humans tend to treat AI systems as human-like,显示人类倾向于将人工智能系统视为人一样,
963I think it is particularly sad in some sense我觉得从某种意义上说,这特别可悲
964that these news outlets claimed that Bing's AI chat这些新闻声称Bing的AI聊天
965in this case was turning sentient.在这个案子中 变得很敏感
966So rather than informing their readers而不是通知读者
967about how to watch out for symptoms like the Eliza effect,如何注意象伊丽莎那样的症状
968they were actually feeding in to the hype.他们其实是喂进 杂音。
969And this, I think, completes the feedback loop of AI hype.我认为这完成了AI的回馈循环。
970So when journalists uncritically report on AI所以当记者不严谨地报道AI时
971and exploit our cognitive biases like anthropomorphism,利用我们的认知偏见 像人类形态学,
972this essentially completes the feedback loop of AI hype,这基本上完成了AIhype的反馈循环,
973especially in the public sphere.特别是在公共领域。
974Okay, and I'll quickly hand it back to Arvind好,我马上交给阿文德
975for a brief overview of what else is in the book.简略地概述书中的其他内容。
976Sure, maybe I will just take one minute当然,也许我只需要一分钟
977just to share some final thoughts只是想谈谈最后的想法
978and then really look forward to what Thomas has to say.然后真的期待 托马斯要说的话。
979So many people started paying attention to AI很多人开始关注AI
980after ChatGPT came out, but in fact, it goes back 80 years.在ChatGPT出来后,但事实上,它可以追溯到80年前.
981So this is a screenshot from the 1950s这是1950年代的截图
982and the history of neural networks神经网络的历史
983actually goes back to the 1940s.实际上可以追溯到1940年代.
984Let's keep going on those slides, Sayesh.让我们继续这些幻灯片,萨耶什。
985So we have a whole chapter discussing why it is that所以我们有一整章讨论为什么
986we've talked a little bit about what goes wrong我们聊了一下出了什么事
987when we try to use AI to predict the future.当我们试图使用AI来预测未来时.
988And I briefly mentioned research我简短地提到研究
989by our Princeton colleague, Matt Salgonik.我们普林斯顿的同事 马特·萨尔戈尼克
990We summarized that research.我们总结了这一研究。
991We have a lot of other research.我们有很多其他的研究。
992And there's a whole chapter in the book书里有一整章
993that doesn't even talk about AI,连人工智能都没说
994but it's more about a sociological understanding但更多的是社会学的理解
995of why the future is hard to predict.为什么未来很难预测。
996Then there is existential risk那还有生存风险
997that Sayesh already mentioned.萨耶什已经提到。
998We talk about the role of institutions.我们谈到了机构的作用。
999I'll save this for the Q&A.我会留着给QQA
1000What we mean by broken AI我们的破解AI的意思
1001is appealing to broken institutions.正在吸引破碎的机构。
1002We talk about regulations a little bit.我们谈一些条例
1003We talk about AI and children,我们谈论AI和孩子们,
1004the role that AI is going to play大赦国际将发挥的作用
1005in the life of a child born today, for instance,例如在今天出生的孩子的生活中,
1006we think is going to be much more significant我们认为会更重要
1007than it plays in our lives today.而不是它在我们今天的生活里
1008But anyway, we'll save all that for later.但是,无论如何,我们会保存这一切 以后。
1009For now, we just want to mention现在,我们只想提一下
1010that the book is available for purchase.书可以买到
1011And with that, we look forward to hearing因此,我们期待听到
1012what you have to say.你该说什么?
1013Thank you.谢谢
1014Thanks, Mr. Narayana and Mr. Kapoor谢谢,纳拉亚纳先生和卡普尔先生
1015to give us this presentation给我们介绍一下
1016and to give us a very fundamental definition给我们一个非常基本的定义
1017何谓AI,何谓AI,
1018and what AI can do,以及大赦国际能做什么,
1019and what those kind of the problems什么样的问题
1020that AI cannot solve,AI无法解决,
1021especially I really admire this part,特别是我真的很欣赏这个部分,
1022like just Mr. Narayana said,就像纳赖亚纳先生说的
1023okay, AI cannot predict the future.好吧,AI无法预测未来。
1024And he just gave us some kind of the examples他只是给我们一些例子
1025and the reasons why AI cannot predict future,以及大赦国际无法预测未来的原因,
1026which is really, I think this is a really crucial part这是真的,我认为 这是一个真正的关键部分
1027for us to understand what AI can do为了让我们明白AI能做什么
1028and what AI cannot do, right?和什么AI不能做的,对不对?
1029So, but my question,所以,但我的问题,
1030yeah, I will raise some kind of the question.是的,我会提出 某种问题。
1031So my question may pretty focus所以,我的问题可能相当集中
1032on the part of the AI hype,由AI的歇斯底里,
1033because we really every day,因为我们真的每天都,
1034you know, I'm a journalist entrepreneur我是记者企业家
1035and we pretty focused on AI我们相当专注于AI
1036and we do a bunch of this kind of the AI coverages.我们做一堆这样的AI覆盖。
1037We talk with the AI figures and AI companies我们跟AI的人物和AI公司谈过
1038and to get a deeply experienced并获得一个深刻的经验
1039down this kind of the AI hardware,在这种AI硬件,
1040AI devices, AI language models,AI设备,AI语言模型,
1041or this kind of things.或这种东西。
1042And we do a lot of this kind of things我们做很多这样的事情
1043and sometimes we sort of like,有时候我们喜欢,
1044and we are in the way to blindfold it,并且阻碍我们遮住它。
1045run towards this kind of the AI papers,跑到这种AI文件,
1046or the AI companies, or the AI prototypes,或AI公司,或AI原型,
1047or AI products.或AI产品。
1048We strongly feel that there are a lot of this kind我们强烈地感到 有很多这样的
1049of the AI hypes.爱尔莎·霍普斯
1050Yeah, I can just raise with an example对,我可以举个例子
1051that I like a week ago,我喜欢一个星期前,
1052my company hosted our own AI event我公司承办了我们的AI活动
1053in Beijing right over here in Beijing.在北京就在这里
1054Before the event, I set up a rule,事发前 我订了一条规矩
1055I set up a rule to prohibit our speakers我订了一条禁止发言的规则
1056to use the buzzwords like AGI or scatting law使用诸如 AGI 或 分解定律 的 蜂鸣词
1057or this kind of things.或这种东西。
1058The rule I set up, yeah,我规定的规则,是的,
1059this rule is established because each speaker本规则的确立是因为每个发言者
1060or panelist can put his or her own stamp或主讲人可以自己盖章
1061on the envelope of AGI or generative AI关于AGI或基因AI的信封
1062or scatting law.或散诸法.
1063Each one can give their own understanding on that每个人可以给出自己的理解
1064which causes more misconceptions or confusions, I think.我认为这会引起更多的误解或混淆。
1065So during the event, I think I tried my best所以在活动中,我想我尽力了
1066to remind each one, okay, we won't talk about AGI today.提醒每个人,好吗,我们今天不谈AGI。
1067Don't mention that word.别提这个词了
1068Don't mention scatting law.别提散乱法.
1069What you are doing is not based on the scatting law, okay?你这样做不是根据 散乱法,好吗?
1070We cannot say that.我们不能这么说。
1071I tried my best to do that,我尽力了
1072but still, in some of the sessions但是,在一些会议上
1073and we unconsciously talk about AGI我们无意识地谈论AGI
1074or this kind of things, yeah.或这种事情,是的。
1075I think this reflects how we get used我觉得这反映了我们是如何被利用的
1076or how the whole industry, I mean the AI industry,或者整个行业,我的意思是AI行业,
1077AI industry got used to enjoying this kind of the best words.AI行业习惯了享受这种最好的词.
1078Even most of the time we are probably即使大多数时候我们可能
1079unaware of this kind of a situation.不知道这种情况
1080Yeah, so let's talk deeper about the AI hype.是啊,让我们更深入地谈谈AI的喧闹。
1081Yeah, I think the last chart is talking about是啊,我想最后的图表 是谈论
1082谁做了这种AI的hype
1083or this kind of the exaggerated AI claims.或这种夸张的AI声称。
1084Who made that kind of things?谁做的那种东西?
1085I think both of you conclude我想你们两个都说完了
1086this kind of the people into three groups.这种人分成三组
1087Three groups, one is that the companies,三组,一个是公司,
1088the AI companies who are selling their products,销售其产品的AI公司,
1089their AI products or their AI solutions.他们的AI产品或AI解决方案。
1090The second group is the AI researchers,第二组是AI研究者
1091like you guys, the AI researchers像你们一样,人工智能研究人员
1092who spread out a lot of these papers他们散发了很多这些文件
1093or this kind of things.或这种东西。
1094And third group is the people like us,第三组是像我们这样的人
1095the journalists or the reporters or editors记者或记者或编辑
1096who are covering AI.他们正在掩护大赦国际。
1097So my first question may start from the group like us.我的第一个问题可能来自我们这样的群体。
1098Yeah, so no, I just noticed different kind of the medias是啊,所以没有,我只是注意到 不同的媒体类型
1099have different attitudes or standing points有不同的态度或立场
1100on AI companies, I think, yeah.有关AI公司,我想,是的。
1101For professional or very vertical tech专业或非常垂直的技术
1102or AI media or AI outlets, I think we always或AI媒体或AI机构, 我认为我们总是
1103just portray over optimistic light只是描绘出乐观的光芒
1104to AI products or AI companies.- AI产品或AI公司。
1105While the mass media always remind people虽然大众传媒总是提醒人们
1106the harm or this kind of the risk of AI,AI的伤害或这种风险,
1107I think this is very interesting.我觉得这很有趣
1108But each of this kind of the media get traffic,但每类媒体都有流量
1109get traffic, get this kind of the people's attraction,堵车 吸引人们
1110I think.我觉得
1111In my team, I'm always struggling on this kind of things.在我的团队里,我总是在为这种事挣扎
1112I always, I sometimes guard my team我总是,我有时守护我的团队
1113to use those kind of the very moderate words用那种温和的词
1114or very balanced tones to tell AI stories,或非常平衡的音调来讲述AI的故事,
1115to describe AI product or to comment描述AI产品或评论
1116how AI company make senses to the society, to its users.AI公司如何给社会,给用户带来意义.
1117But I sometimes struggle to get traffics但我有时会拼命去堵车
1118competing with those kind of the other medias与其他媒体竞争
1119who have very strong opinion,他们有很强的意见,
1120who provides very fruitful emotional value提供非常有成果的情感价值
1121instead of insight provider.而不是提供洞察力
1122So I think, I'm not sure, how can you guys tell me, okay,所以我想,我不知道, 你们怎么能告诉我,好吗,
1123whether is this a unsolvable dilemma这是否是一个无法解决的难题
1124or how the mass media or no matter the mass media或大众传媒如何或不论大众传媒如何
1125or even the tech media can do this kind of things better或甚至科技媒体 可以做这样的事情更好
1126to let more people, not only for the industry,让更多的人, 不仅仅是为行业,
1127but the masses of all the people但人民大众
1128to have a more clearer and neutral understanding更清楚和中立的理解
1129on what AI is, how it works,关于AI是什么,它是如何工作的,
1130and what's the background technology behind that.背后的背景技术是什么?
1131Thank you.谢谢
1132Yeah, that's a very hard problem是啊,这是一个非常困难的问题
1133from the perspective of journalists从记者的角度来看
1134to know how to cover AI in a more responsible way了解如何以更负责的方式覆盖大赦国际
1135while also competing with other journalists同时也与其他记者竞争
1136who might not have the same standards.他们可能没有同样的标准。
1137I think in general, this is a challenge我觉得总的来说,这是个挑战
1138all throughout journalism, not just in AI.整个新闻,不只是在AI。
1139And so I think the solutions are going to have to be broader所以我认为解决方案必须更加宽泛
1140and maybe not specifically about AI.也许不是关于AI。
1141I can share a couple of thoughts, but you're the expert.我可以分享一些想法 但你是专家
1142I'm curious to hear what has worked for you我很想知道什么对你有用
1143and what has worked less well for you as well.以及那些对你不太有用的东西
1144So one thought is that as you pointed out,所以,有一个想法是, 正如你指出,
1145this is very tied to the business models.这与商业模式密切相关。
1146If the business model is based on clicks, of course,如果商业模式是基于点击,当然,
1147it's going to be hard to have more in-depth coverage.要进行更深入的报导是很难的.
1148One thing I've noticed我注意到一件事
1149in the United States media ecosystem美国媒体生态系统
1150is that the journalistic organizations是记者组织
1151that want to provide in-depth factual coverage希望提供深入的事实报道
1152tend to move towards a different business model.倾向于走向不同的商业模式。
1153It's subscription-based,它的订阅,
1154where readers want to come back month after month读者希望月复一月
1155because they know that this outlet因为他们知道这个出口
1156is going to give them good information.将会给他们好的信息。
1157Some of them are becoming nonprofits他们中有些人正在成为非营利组织
1158where they are funded by donations由捐款供资
1159in order to do in-depth reporting.以便进行深入的报告。
1160And that's not necessarily just for AI.这不一定只是AI的。
1161That has been true historically历史上就是这样
1162where a lot of the most in-depth reporting其中很多最深入的报告
1163comes from more nonprofit journalistic organizations更多来自非营利新闻组织
1164than the ones who are competing for clicks.胜过那些竞拍者。
1165Another is just to have self-regulation,另一种就是自我约束
1166I think, among journalists.我想,在记者中间。
1167And we have been to a few journalism conferences,我们参加了几次新闻会议,
1168for instance, again, here in the US,例如,在美国这里,
1169where journalists are discussing how we can all do better记者们正在讨论我们如何做得更好
1170and hold each other accountable, right?互相责备,对吧?
1171Where they work together他们一起工作的地方
1172instead of necessarily always competing with each other.而不是总是相互竞争
1173And one last third suggestion最后三分之一的建议
1174is perhaps a different kind of content也许是另一种内容
1175when you're covering something that's in the news,当你在报道新闻时
1176when you want to cover a product当你想要覆盖一个产品时
1177that a company put out, for instance.比方说,一家公司已经解散了
1178It's hard to do that without hype胡说八道很难做到
1179because you have to make it seem因为你必须让它看起来
1180like this is something remarkable,像这样的东西是了不起的,
1181something that is worth the reader or viewer or listener值得读者、观众或听众欣赏的东西
1182paying attention to.关注。
1183And when you're covering something dangerous about AI,当你掩盖AI危险的事情时
1184again, you have to hype it up再说一次,你必须把它弄乱
1185because you have to make it seem like this is very special.因为你得让它看起来很特别
1186But there is another kind of content, right?但还有另一种内容,对不对?
1187Another kind of content might be an interview另一种内容可能是采访
1188with someone who is working in AI, for instance.例如在AI工作的人
1189And it seems like people really love好像人们真的喜欢
1190these in-depth interviews, podcasts, you know?这些深入的采访,播客,你知道吗?
1191So for instance, in the US,例如,在美国,
1192we have podcasts like Joe Rogan,我们有播客 像乔罗根,
1193which have become enormously successful,他们已成功,
1194have become media empires on their own自己成为媒体帝国
1195and really competing with traditional media outlets.与传统媒体竞争
1196So that is surprising to me.这让我很惊讶
1197And it's a sign that people really want这是人们真正想要的标志
1198this kind of in-depth content这种深入的内容
1199that comes from our journalists talking to an expert.这来自于我们的记者 与专家交谈。
1200So that could be another kind of content所以,这可能是另一种内容
1201where you can have more depth.在那里你可以有更深的深度。
1202That'd be great.这将是伟大的。
1203You know, just for my own experience,你知道,只是为我自己的经验,
1204recently, I mean, just during the past probably a year,最近,我的意思是, 只是在过去可能一年,
1205I mean, the major channels for me to get deeper我的意思是,主要渠道 我更深入
1206and understand on the most cutting edge AI technology并了解最前沿的AI技术
1207or this kind of the models or this kind of the researchers或这种模型或这种研究者
1208or the business ideas are coming from或商业想法来自
1209those kind of the podcasts hosted by VC firms此类播客由《维也纳公约》公司主办
1210like Andreus and Horace or Y Combinator像安德烈乌斯和贺拉斯或Y组合
1211or NoPriori or this kind of the VC guys或无主或这种越共的家伙
1212who are hosting this kind of the postcards他们主持这种明信片
1213而不是 TechCrunch、 Verge 或 商业内幕
1214or this kind of the mass media.或这种大众传媒。
1215I think this is because this kind of the,我觉得这是因为这种,
1216I mean, the insiders,我的意思是,内线,
1217no matter the VC guys or entrepreneurs,不管越共的人和企业家
1218they can get better understanding on what they're doing.他们可以更好地了解自己在做什么。
1219But one following question,但有一个问题
1220highly relevant to that is that,与此密切相关的是,
1221do you think that the, I mean, the reporters你觉得,我的意思是,记者
1222or the journalists who are covering AI或报道大赦国际的记者
1223need to read AI research papers frequently,需要经常阅读AI研究论文,
1224probably in a weekly basis也许每周一次
1225or research papers frequently to know more about that或研究论文 经常了解更多
1226because most of the journalists include myself.因为大多数记者包括我自己
1227I read papers frequently, but for myself, I think,我经常看报纸,但我觉得
1228I'm still with not an AI background我还是没有AI的背景
1229or a computer science background.或计算机科学背景。
1230I'm not with that background.我没有那种背景
1231It's sometimes just give me some kind of the challenges有时候只是给我一些挑战
1232to read some details,阅读一些细节,
1233but thanks for AI tools like Chaijibiti or Cloud, right?但是谢谢你的人工智能工具 比如Chaijibiti或Cloud,对不对?
1234Do you think it's really needed for,你觉得它真的需要,
1235Do you think it's really needed for AI tools你觉得真的需要人工智能工具吗?
1236for non-AI background journalists to read AI papers?非AI背景记者阅读AI论文?.
1237Yeah, I think that's a great question.是啊,我觉得这是一个很好的问题。
1238So, I mean, in some sense, it depends on the sort of所以,我的意思是,从某种意义上说, 这取决于什么类型的
1239journalism that you are doing.你做的新闻工作
1240So, for example, for science journalists who are reporting所以,比如说,对于正在报道的科学记者来说
1241specifically on the contents of a paper and comparing it to the previous state of the art,特别是一篇论文的内容,并将其与以前的艺术水平进行比较,
1242I think that is a very important skill to have.我认为这是一种非常重要的技能。
1243But for other types of journalists, for example,但对其他类型的记者来说,
1244people looking at the impact of AI on society, I'm not sure if that's the most high-value way.人们看AI对社会的影响,我不确定这是否是最有价值的方式.
1245So, I'll give you an example.所以,我给你一个例子。
1246One of the journalists whose work I really like in the US我很喜欢在美国工作的记者之一
1247is Timothy B. Lee, and a lot of his work is related to self-driving cars.是Timothy B. Lee 他的很多作品都和自驾车有关
1248So, he reports所以,他汇报
1249on the state of progress on self-driving cars and so on.关于自驾车等进展状况.
1250But a lot of the insights that he has但他有很多见解
1251are not by reading papers on the state of the technology, but rather by looking at the并不是通过阅读有关技术状况的论文,而是通过观察
1252statistics from companies like Waymo and Cruise, by looking at the statistics released by government从Waymo和Cruise等公司获得的统计数据,
1253organizations, by comparing the regulatory stances on self-driving cars across the states in the US.通过比较美国各州自驾汽车的监管立场
1254And that does not necessarily require deep academic expertise, but it does require being able to find这并不一定需要深层次的学术专业知识,但确实需要找到
1255the right sources and being able to read government documents or being able to track down正确来源和能够阅读政府文件或能够追查
1256companies' reports when they are releasing them.公司的报告,当他们被释放。
1257And I think we're at the point, or at least slowly我想我们到了点,或者至少慢一点
1258beginning to get to the point, where AI companies are also starting to figure out what they communicateAI公司也开始找出他们沟通的内容
1259to the public.告大众曰.
1260And many of these sort of nuggets of information are hidden within this large许多这类信息 隐藏在这个巨大的
1261reports that companies release.报告公司释放。
1262So, I was part of this initiative called the Foundation Model所以,我是这个倡议的一部分 叫做基础模型
1263Transparency Index.透明度指数。
1264And companies were required to or asked to report a hundred different things公司被要求或被要求 报告百种不同的东西
1265about how they train their AI models.他们是如何训练他们的AI模型。
1266And I think there were some very interesting insights我觉得有一些非常有趣的见解
1267in a lot of what the companies reported, which were not related to academic insights really,在很多公司的报道中 与学术见解无关
1268but which were more about where do they get the training data from, or how much do they pay their但他们从哪里得到培训数据 或支付多少钱
1269workers when they're annotating data, and so on.工人们在分析数据时,
1270And so, if people are looking at sort of the impact所以,如果人们在看 那种影响
1271of AI on society, then I think this type of secondary information can be quite useful and我认为这种次要信息可以很有用
1272important.这很重要
1273That'd be great to get more access to the data and the facts to get better than standing最好能让更多的人获得数据 和事实 得到比站立更好的
1274on the AI.在人工智能上。
1275Okay, let's talk further about the researchers like you guys.好吧,让我们进一步谈论 研究人员喜欢你们。
1276Researchers sometimes研究人员有时
1277may still spread some kind of the AI hype to the public.可能还会向公众传播某种AI的谣言.
1278So, and now in some kind of the,所以,现在在某种情况下,
1279could you please to, yeah, I will list you some kind of the AI researcher figures like麻烦你,是的,我会列出一些 AI研究者的数字像
1280Jeffrey Hinton, and you just mentioned, right, or Yellow Koon, a guy I pretty, yeah, I like him aJeffrey Hinton, 你刚才提到,是的,还是黄坤,一个我漂亮,是的,我喜欢他
1281lot, I think.我觉得是很多
1282And probably Fei-Fei Li, I think.还有李飞飞吧
1283And I think, yeah, would you please to give some我想,是的,请你给一些
1284kind of the comments on their role to be a, or would you please to give the comments on或请各位发表评论。
1285these figures and their roles to the public to tell about what, are they acting in the right way这些人物和他们的角色 告诉公众什么, 他们的行为是正确的方式
1286to tell the people the right thing about AI?告诉人们AI的正确之处?
1287How do you think about it?你觉得怎么样?
1288Would you like to give some你想给一些
1289kind of the comments about these kind of the peers in the AI researcher field?对AI研究者领域这类同行的评论是什么?
1290Thank you.谢谢
1291I'm happy to share some comments on that.我很乐意就此发表一些看法。
1292I think there are a couple of reasons why我想有几个原因
1293AI researchers are often hyping AI too much, and I'll share some thoughts on how they can do better.AI研究者们经常对AI叹气过多,我将分享一些关于他们如何能做得更好的想法.
1294One is, if you look at the reason why researchers are getting into AI.第一,如果你看看 研究人员进入AI的原因。
1295I mean, let me tell you my我的意思是,让我告诉你我的
1296own story.自己编的故事。
129725 years ago, when I decided that my undergrad major would be in computer science,25年前,当我决定 我的研究生将进入计算机科学,
1298it's because one day I wanted to build AGI.因为有一天我想建造AGI
1299I wanted to help build it.我想帮助建造它。
1300I really liked your rule,我真的很喜欢你的规矩
1301by the way, and your conference of not talking about AGI.顺便说一句,还有你的会议 不谈论AGI。
1302I think we need more of that at more我认为我们需要更多的 更多
1303events.事件。
1304But nonetheless, the fact remains that many AI researchers are thinking about this.但是,事实上,许多AI研究者仍在思考这个问题。
1305It's这是
1306this kind of North Star, and obviously many researchers believe that it can completely很明显,许多研究者认为它可以完全
1307transform the world if you had AI that could do any job that any person could do.如果你有人工智能 做任何人都能做的任何工作 就能改变世界
1308And so a lot of这么多
1309people are coming into the AI field because they have a kind of religious belief that this world人们进入AI领域 因为他们有某种宗教信仰 这个世界
1310changing thing is achievable.改变事物是可以实现的。
1311And so you're starting from a baseline of people who believe所以,你开始 从一个基线的人相信
1312in something radical.在激进的东西。
1313I'm not talking about whether that belief is true or false,我不是说这种信念是真还是假
1314but you can imagine if someone is really committed to this mission, if you will,但你可以想象,如果有人 真的致力于这个任务, 如果你愿意,
1315then they are going to believe some things that might sound really radical or crazy.然后他们会相信一些事情 听起来非常激进或疯狂。
1316So I think that's part of the reason.所以我认为这就是原因之一。
1317And a second more mundane reason is that everybody needs to get还有一个更普通的理由是 每个人都需要得到
1318funding.供资。
1319Yann LeCun和Jeff Hinton, 对他们来说, 他们的布局相当不错.
1320They don't need to他们不需要
1321hype AI to get funding.高调AI来获得资金。
1322But for a lot of other researchers, unfortunately, if you但对于很多其他研究者来说 不幸的是 如果你
1323put out a press release touting how amazing your new invention is, you get more attention,发布一份新闻稿 说出你的新发明多么惊人 你得到更多的关注,
1324potentially more funding and so forth.可能有更多的资金等等。
1325And even in our research, we are often thinking carefully即使在我们的研究中 我们经常仔细思考
1326about our paper titles.关于我们的论文标题。
1327Are we exaggerating those too much?我们是不是夸大了这些?
1328So I think that's a struggle所以我觉得那是一场斗争
1329for every single AI researcher.每一个AI研究员。
1330And a third thing, I think something new...第三件事,我觉得有些新...
1331Sorry, go ahead.对不起,请便。
1332Can I可以吗?
1333share one last thought on that?和大家分享最后的想法吗?
1334In terms of how people can do better.论人如何能更善.
1335So one thing that's changed,所以有一件事已经改变了,
1336AI used to be a really niche topic, and then it was okay for AI researchers to say some crazyAI曾经是一个非常合适的话题, 然后AI研究人员可以说一些疯狂
1337things because the people who were paying attention were mostly other AI researchers.因为关注的人大多是其他AI研究者
1338But the extent to which the public and the media are now paying attention to what AI researchers但公众和媒体关注AI研究人员的程度
1339are saying is, of course, on a completely different scale.意思是,当然, 是一个完全不同的规模。
1340Now AI researchers have become现在AI研究者变成了
1341public figures.公众人物.
1342And many researchers have not yet understood this fact that for public researchers,而许多研究者尚未意识到这一事实,对于公共研究者来说,
1343there is a higher ethical standard for any kind of public figure that we should hold them to.任何类型的公众人物都应该遵守更高的道德标准。
1344And还有
1345what they say matters, and they can't just say whatever is on their mind all the time.他们说的话很重要 他们不能老是说他们心里想的
1346And I还有我
1347think there needs to be a culture change.认为需要改变文化
1348Oh, that'd be great.哦,这将是伟大的。
1349So is that to say that researchers,这么说来 研究人员
1350I mean, the entrepreneur, researchers being entrepreneur will be harmful for the original AI我的意思是,创业者, 研究人员是创业者 将对原AI有害
1351research, because then this will give them the added motivation to make the AI hype.研究,因为这样他们就会得到更多的动力 来制造AI的热闹。
1352Is that right?是吗?
1353I mean, AI researchers, yeah, be entrepreneurs.我的意思是,AI研究人员,是的,做企业家。
1354Sanaj, do you want to?萨纳伊,你想吗?
1355Yeah, sure.当然
1356I mean, I don't我的意思是,我没有
1357think there's an issue with researchers becoming entrepreneurs per se.认为研究者成为企业家本身有问题.
1358I do think like a big我确实像一个大
1359challenge with the AI tools that we have today is that we don't really have enough real world users对AI工具的质疑,我们今天有的是 我们真的没有足够的真实世界用户。
1360that are being sort of productionized.正在生产
1361And so maybe that is something we need more of.也许我们需要更多
1362But I think the specific challenge with AI hype in entrepreneurs is, I think researchers are seen但我认为在创业者中 AI hype的具体挑战 是,我认为研究者被看到
1363as this trusted public figure who talks sort of dispassionately about scientific research and作为这个值得信赖的公众人物, 他有点冷静地谈论科学研究和
1364communicates that to the public.向大众传达。
1365And when they turn into entrepreneurs, then they become people当他们变成企业家, 然后他们成为人
1366who have something to sell.他们有东西卖。
1367And I think this sort of transition, even though there is no clean line,我认为这种转变 即使没有干净的线条
1368this sort of transition needs to be appreciated by like journalists writing articles about people这种转变需要像记者那样 写关于人的文章
1369who now have like a business incentive to sell things and not just treat them as neutral,他们现在有 商业激励 出售的东西, 不只是把它们视为中立,
1370independent parties.独立党派。
1371And I think that is what needs to be emphasized a lot more.我认为,必须更加强调这一点。
1372So when an所以当一个
1373entrepreneur or like someone who is trying to sort of set a company of the ground says something企业家或喜欢有人 谁试图设置一个公司 地面说
1374about that company, that should be seen as a statement by someone who has a financial interest关于那家公司,那应该被看作是有经济利益的人的声明
1375in that company, rather than a statement by a third party expert who has a dispassionate view而不是由持有冷静观点的第三方专家的陈述
1376to some extent on the workings of that company.在某种程度上,关于公司的运作。
1377And I think that is what we are sort of trying to我想这就是我们试图
1378wrap our head around right now, simply because we have seen this huge boom in AI in the last few把我们的头围起来,仅仅因为我们看到 在AI的这个巨大的繁荣 在最后几个
1379years.岁月
1380This wasn't a problem maybe 20 years ago when AI was useful for a few things other than,也许20年前 AI对一些事情有用
1381I don't know, like this type of AI was useful for maybe handwriting recognition or whatever.我不知道,像这种AI 有用 也许笔迹识别什么的。
1382But all of a sudden it has become a consumer technology.但突然间它变成了一种消费技术.
1383And so we're seeing a huge boom所以我们看到一个巨大的繁荣
1384of researchers turning into entrepreneurs.研究者变成企业家。
1385And I think we need to treat their claims with a我认为我们需要用
1386little bit more skepticism, especially when it's about their products or their industry.更有一点怀疑,特别是当它涉及到他们的产品或工业时.
1387Hey, that'd be great.嘿,这将是伟大的。
1388Yeah, sure.当然
1389Still talk a little bit more about the AI companies还要多谈谈AI公司
1390who have the strongest motivation to do AI hype.谁有最强的动机做AI的hype。
1391In a way, you may rather say在某种程度上,你可能宁愿说
1392this kind of the advertisements displayed on YouTube about AI companies or AI products,在YouTube上刊登的关于AI公司或AI产品的广告,
1393or even their websites.甚至是他们的网站
1394I mean, the AI companies' websites are all AI hype, I think.我的意思是,AI公司的网站 都是AI的hype,我认为。
1395In a way,在某种程度上,
1396we can say that.我们可以这么说
1397So how, I mean, just how the public can get a better understanding所以,我的意思是, 如何让公众得到更好的理解
1398from those kind of the advertisement materials or those kind of the advertisement videos.从那些广告材料 或那种广告视频。
1399And we always see this kind of the Grammar, the Grammar Lake or the Chachibee TV, even now Cloud,我们总是看到这种语法, 语法湖或Chachibee电视, 即使现在云,
1400我的意思是,云 动力由Anthropic。
1401And they just display their advertisement in San他们只是展示他们的广告 在桑
1402Francisco airport on the YouTube and everywhere.弗朗西斯科机场在YouTube和各地。
1403And how people just get the right understanding和人们如何得到正确的理解
1404from those kind of the advertisement materials and to have a more balanced and objective从这类广告材料 并有一个更平衡和客观
1405understanding about AI by reading or by hearing or by watching these kind of things.通过阅读、听觉或观看这些东西来理解AI。
1406Or anyone or anybody or any organization can play a more moderate role to change this kind或任何人 或任何组织可以发挥更温和的作用 改变这种
1407of the situation, I think.我认为,情况。
1408Advertisement about AI now is everywhere, it's everywhere, especially关于AI的广告现在到处都是,它到处都是,特别是
1409Silicon Valley and Bay Area.硅谷与湾区.
1410I'll say that there's one really big good thing about generative AI我会说,有一个真正的大好事 关于基因AI
1411compared to, let's say, predictive AI.比起预测性AI
1412If a company comes out and claims, oh, our AI can predict who如果一个公司出来并声称, 哦,我们的AI可以预测谁
1413is going to commit a crime, and that's their advertisement, there's nothing you can do to这是他们的广告,你无能为力
1414check that claim for yourself.你自己去查查那份索赔
1415Generative AI is very different.遗传性AI非常不同.
1416如果Chachibee或云声称
1417I don't know, whatever it is, legal work, 如果你是律师或一些法律工作
1418expertise, that's a claim you can check for yourself.专家,这是一个权利主张 你可以检查自己。
1419And that's a much more efficient way这是更有效率的方法
1420of doing it than trying to figure out if their advertisement is hyped or not or reading journalistic而不是试图找出他们的广告 被赞美与否 或阅读新闻
1421articles or even listening to this talk or reading our book.写文章,甚至听这些话 读我们的书
1422There's something much more还有更多
1423high value you can do with your time, which is just to play with generative AI products yourself,高价值你可以做你的时间, 这只是玩 基因AI产品自己,
1424just within a few hours of using it, you're going to get a pretty good understanding of its在使用后几小时内 你就会非常了解它
1425potential as well as its limitations for the specific use cases that you care about.以及它对于你所关心的具体用途的局限性。
1426And I'm sure many of you are already doing that.我敢肯定,你们很多人已经这样做了。
1427I very much encourage you to continue doing that.我非常鼓励你继续这样做。
1428记住,AI不仅仅是Chachibee或云。
1429It doesn't have to be specifically a不一定是特别的
1430bot that you go and type into.机器人,你进入。
1431AI is integrated into a number of other software products that weAI被整合到许多其他软件产品中,我们
1432use on an everyday basis.每天使用。
1433So when you're interacting with AI, be mindful of that.所以当你与AI互动时,要注意这一点.
1434Use that as a way to用它来作为方法
1435develop your intuition on what it's doing well, what it's not doing well.发展你的直觉 关于它做什么好, 做什么不好。
1436When you're on social当你在社交上
1437media, remember that so much of content out there is AI generated.媒体,请记住, 这么多的内容 有AI生成。
1438So use that as a way to update所以用它来更新
1439your understanding of the kind of realistic images that are possible to create with social media.你对社交媒体所能创造的现实形象的理解。
1440So yeah, basically, my advice is through the course of our everyday interaction, both with AI所以,基本上,我的建议是通过 我们日常的互动, 无论是与AI
1441products and other kinds of software products, we should be constantly reflecting on that and产品和其他类型的软件产品,我们应当不断对此进行反思。
1442updating our intuition for what AI can and cannot do, generative AI specifically, at any given point更新我们的直觉,说明AI能做什么和不能做什么, 具体地说,在任何特定的时间点,
该视频共有字幕 1443 条。解锁更多字幕为会员功能,请移动到 价格