推荐微信扫码登录以获得更好的体验!另:🎉建议更新到最新版,以体验新功能!🎉 版本更新记录→

你真的无法“叫醒一个装睡的人”吗?耶鲁教授为你重释社会心理学

字幕摘录

时间英文中文
0:04Hello, everybody.哈罗,大家好。
0:05Good morning for those of you guys joining us from the US and good evening早上好,你们这些家伙从美国加入我们,晚安
0:10if you're joining us from China or elsewhere in Asia.如果你从中国或亚洲其他地方加入我们
0:14Good to see everybody.很高兴见到大家
0:15For those给那些
0:16of you guys that are able to, it'd be great if you could turn on your webcam just so that如果你们能打开你的网络摄像头 那就太好了
0:20we can see some faces so we're not just talking to a wall of blank screens and random names.我们可以看到一些面孔 所以我们不只是在谈论 空白屏幕和随机名称的墙壁。
0:28It's always good to be able to put some faces to names here as we're still getting back to总是能把一些面孔 给这里的名字,因为我们仍然 回到
0:39in person, but it's still great to be able to do these Zoom meetings and be able to connect但还是很棒的 能够做这些Zoom会议和连接
0:44from people all over the world.从世界各地的人。
展开字幕全文(1022 条)
序号英文中文
1Hello, everybody.哈罗,大家好。
2Good morning for those of you guys joining us from the US and good evening早上好,你们这些家伙从美国加入我们,晚安
3if you're joining us from China or elsewhere in Asia.如果你从中国或亚洲其他地方加入我们
4Good to see everybody.很高兴见到大家
5For those给那些
6of you guys that are able to, it'd be great if you could turn on your webcam just so that如果你们能打开你的网络摄像头 那就太好了
7we can see some faces so we're not just talking to a wall of blank screens and random names.我们可以看到一些面孔 所以我们不只是在谈论 空白屏幕和随机名称的墙壁。
8It's always good to be able to put some faces to names here as we're still getting back to总是能把一些面孔 给这里的名字,因为我们仍然 回到
9in person, but it's still great to be able to do these Zoom meetings and be able to connect但还是很棒的 能够做这些Zoom会议和连接
10from people all over the world.从世界各地的人。
11So my name is Devin Lau.我叫刘德文
12I am the Associate Director of Yale我是耶鲁大学的副院长
13Center Beijing, and I'm very glad today to have you guys join us for a talk on a new book by北京中心,我很高兴今天有你们 加入我们讨论一本新书
14Professor Alex Kabak on a very pertinent and relevant topic that I'm sure in this increasingAlex Kabak教授的话题很贴切 我相信这个话题越来越重要
15age of polarization and extreme views is more important than ever, and so very excited to时代的两极分化和极端观点比以往任何时候都更加重要,因此非常激动
16have you all join us.请大家加入我们
17Let me quickly introduce our speaker and then we'll get right to it.让我很快介绍一下我们的演讲人 然后我们马上开始
18So Professor Alex Kabak is Associate Professor of Political Science at Yale as well as a ResidentAlex Kabak教授是耶鲁大学政治学副教授 也是一名居民
19Fellow of the Institution for Social Policy Studies and the Center for the Study of American社会政策研究所和美国研究中心研究员
20Politics.政治学.
21After completing his bachelor's at the University of Chicago, he received his PhD完成芝加哥大学的学士学位后,他获得了博士学位
22in political science from Columbia University.哥伦比亚大学政治学专业。
23His principal interest research as I said earlier我之前说过他的主要兴趣研究
24lies in political persuasion and its implications for the malleability of public opinion, especially在于政治说服及其对公众舆论的可塑性的影响,特别是
25in the context of elections, which is of course the subject of his new book in today's talk,在选举的背景下 这当然是 他的新书的主题 今天的谈话,
26but he's also the co-author of Research Design in the Social Sciences Declared Diagnose Redesign,但他也是"社会科学公开诊断重新设计研究设计"的共同作者,
27which is a research design textbook that introduces a language for describing research design and an这是一本研究设计教科书,介绍了描述研究设计的语言,以及
28algorithm for evaluating the properties.用于评价属性的算法。
29So for those of you that are in political science or所以,对于你们这些在政治学或
30interested in more of the nuts and bolts of his work, that's I think also an对更多他作品的坚果和螺栓感兴趣 我想这也是
31interesting topic he'd be willing to discuss.有趣的话题 他会愿意讨论。
32And so lots of interesting things to talk about today,今天有很多有趣的事情要谈
33so I'm just going to turn it over to him and then we'll have some time for questions at the end.所以我要把它交给他 然后我们有时间提问
34Great.不错
35Thank you so much Devin.非常感谢德文
36Thanks to Yale Center Beijing for inviting me to come talk to感谢耶鲁中心邀请我来
37you about this.你 关于这个。
38This book has been such a long time coming.这本书来得太久了
39It was my dissertation work seven这是我的论文作品七
40years ago and at the time I was just so focused on the empirical findings that I did not really take,几年前,当时我只 如此专注于经验性 发现,我没有真正采取,
41even though my advisors were telling me to, I didn't really take the尽管我的顾问告诉我, 我并没有真正采取
42step backwards to understand what it all means for politics.向后退一步,以了解这一切对政治意味着什么。
43So now I can, you know,所以,现在我可以,你知道,
44it's finally in print and I can wave it at you and that's really exciting for me.它终于印下来了 我可以向你挥手 这对我来说真的很刺激
45But I also have had但我也有过
46intervening seven years when rewriting it from the very beginning and re-encountering all of7年的干预,从一开始就重写它 并重新面对所有
47the experiments.实验
48I've had an opportunity now to really understand what it does mean for politics.我现在有机会真正理解它对于政治的意义.
49And so what I hope that I can do in this talk is give you a sense of the main claim, how I came to所以,我希望我能在这个演讲中 做一个让你感觉 主要的主张,我是如何来到
50that main claim, but also what it does mean for politics more generally.这主要主张, 但也意味着政治更普遍。
51I'm going to focus the我将集中精力
52talk around three key ideas.围绕三个关键思想展开讨论.
53And so if you're, if you come along with me for that first key idea,所以,如果你是, 如果你跟我来 第一个关键的想法,
54I think then you'll be happy to go along to the second.我想你会很高兴去第二。
55And if you're okay with one and two,如果你一两个可以的话
56then you might be okay with the third idea, but you're under no obligation.那你也许可以接受第三个想法 但你没有义务
57So if you, if you所以,如果你,如果你
58don't agree, that's okay.不同意,没关系。
59I'm happy to answer questions throughout if they come up for you or我很乐意回答所有的问题 如果他们来找你或
60we can save them to the end.我们可以把他们救到最后
61It's totally up to you.这完全取决于你。
62Okay.摆
63I'll share screen now.我现在就分享屏幕
64Oh no,哦,没有,
65you're going to get to see the whole talk.你会看到整个谈话。
66One second.一秒钟。
67All right.好吧,我们走。
68So that first idea,所以第一个想法
69that first key idea is that the persuasion and parallel pattern is common.第一个关键点是说服和平行模式是常见的。
70I'm trying to say that我想说
71what normally happens when people encounter persuasive political information is that they当人们遇到有说服力的政治信息时 通常会发生什么
72change their minds a little bit in the direction of information and that that change, that change改变他们的想法 一点点方向的信息 改变,改变
73in their attitudes is similar for different groups.不同群体的态度类似。
74And so if you were to make a picture of所以如果你要拍张照片
75what that looks like, it looks like parallel lines.看起来像是平行线
76So this pair of persuasion and parallel所以这对说服和平行
77pattern is the thing that I'm claiming is general.我所声称的规律是一般的
78Now, of course that that has to be an over claim现在,当然,那必须是 超额索赔
79because I have only studied people in the U S who might take surveys.因为我只研究过美国可能接受调查的人
80So I'm trying to generalize所以我想概括一下
81that claim to people in the U S who might not take surveys and to people who live in Canada,对美国可能不参加调查的人和居住在加拿大的人的权利要求,
82who might and might not take surveys and people who live in France, people who live in Argentina可能或不会接受调查的人 住在法国的人 住在阿根廷的人
83and indeed in China and people who live in the 23rd century and people who live in the 16th century.在中国和生活在23世纪的人 以及生活在16世纪的人
84Like I'm trying to make a general claim about what happens when people encounter persuasive就像我试图对人们遇到有说服力的情况 提出一个一般性的主张
85information.资料。
86But of course, I've only studied the people that I did do that I did study, right?但当然,我只研究过 我做过的人,我确实学习,对不对?
87So这么说
88that generalization is going to be have to be made not on the basis of an actual empirical finding,不得根据实际经验结论进行概括,
89but instead on the basis of the theoretical generalization.但以理论概括为基础。
90And I'm hoping that you'll be我希望你会
91willing to come with me on that particular on that particular journey.愿意与我一起踏上这一段旅程。
92Let me show you a picture of让我给你看一张
93what the persuasion and parallel pattern looks like.说服和平行模式是什么样子的。
94This is a stylized version.这是一个结构化的版本。
95So these are not所以这些不是
96data.数据。
97This is the, this is a schematic version.这是,这是一个图表版本。
98Imagine there are two kinds of people in the world.想象世界有两种人
99There are blue people and there are red people and they disagree on average about some policy.有蓝色的人和红色的人 他们平均不同意一些政策。
100So the vertical axis of this figure is policy support.因此,这个数字的垂直轴是政策支持.
101You can see that the blue people on你可以看到,蓝色的人在
102average support the policy at a higher rate than the red people.平均支持政策的比例高于红色人群。
103And that's when you don't give当你不给
104them any persuasive information.任何有说服力的信息
105If you go over to the right side of the graph, now this is what如果你去右侧的图表, 现在这是什么
106happens when you give positive persuasive information.当你给出有说服力的正面信息时
107That is to say, facts and也就是说,事实和
108argumentation that has a target attitude that you're trying to move in the positive direction.具有目标态度的争论 你正试图朝着积极的方向发展
109So for people who are in the blue group, that information is congenial.所以对于在蓝色人群中的人来说, 这些信息是同源的。
110Like they already agree好像他们已经同意了
111and they like that information.他们喜欢这个信息。
112They move in the direction of information and support the policy他们向信息方向发展,支持政策
113even more.更何况.
114For people who are in the red group, that group is counter attitudinal.对于属于红色群体的人来说,这个群体是反态度。
115They don't like他们不喜欢
116that information, but nevertheless they update in the direction of information.这些信息,但从信息的方向加以更新。
117My argument is我的论点是
118fully symmetric.完全对称。
119So if you were to instead see negative persuasive information, you would move所以,如果你看到负面的说服性信息, 你会移动
120in the negative direction.在负方向。
121And that would be, so that would be pro attitudinal for the people who这将是,所以这将是 支持人们的态度
122are in the red group, but it would be counter attitudinal for people who are in the blue group.属于红色群体,但对于属于蓝色群体的人来说,这是反面的态度。
123So that's just, that's the, that's the persuasion parallel pattern in a nutshell.所以,这就是, 简言之,这就是说服的平行模式。
124That's what I'm这就是我
125trying to claim is commonplace, is that people update their views in the direction of information人们试图声称,这是司空见惯的, 是人们更新 他们的观点方向信息
126by a small amount.以少许之数.
127And it's not different for the red group and the blue group, right?对红组和蓝组来说也没什么不同 对吧?
128That's the就是这样
129key thing is that there is a central similarity in the way that people respond to political关键是人们对政治的反应有中心相似性
130information.资料。
131Let me say a couple of other comments about this figure, about what is让我就这个数字,什么是
132included in the argument and what is excluded.(b) 列入论点和排除的内容。
133So I'm only talking about treatments that所以我只说治疗
134you could put on this axis, on the horizontal axis.您可以在此轴上, 在水平轴上。
135Other kinds of treatments are not persuasive其他种类的治疗没有说服力
136information.资料。
137So for example, a group Q is not persuasive political information.例如,一个Q团体并不具有说服力的政治信息。
138A group Q is一个组Q是
139like what some other group in society thinks.就像社会上其他群体的看法
140So in the U S context, you might say Republicans所以在美国,你可以说共和党人
141support the policy.支持这项政策。
142And then the causal effect of that on Republican respondents这对共和党人的影响
143views is going to be to increase their support, but among Democrats, that would be to decrease观点将会增加他们的支持, 但在民主党人中, 这将减少
144their support.他们的支持。
145So you get oppositely signed treatment effects of that kind of a group Q所以,你得到相反签名 治疗效果 类组Q
146treatment.治疗。
147So that's not what I'm talking about when I'm talking about persuasive information.因此,我说的不是说服性的信息。
148There I'm talking about like trying to make an argument to change your mind on a particular我说的就是 试图提出一个论点 改变你对某个
149issue using facts and logic and argumentation.利用事实、逻辑和论证。
150Another important thing is what is scoped in另一件重要的事情是,什么是范围在
151on this vertical axis?是否在此垂直轴上?
152What are the kinds of outcome variables that we're talking about?我们谈论的结果变量是什么?
153And that's going to be anything that can be construed as a policy support variable, not这会是任何可以被理解为 政策支持变量,而不是
154other things that are sometimes measured in these persuasion experiments, like how much you like the有时在这些说服实验中测量的其他东西 比如你喜欢什么
155information or how much you like the speaker, right?信息或者你有多喜欢演讲者,对吧?
156So those sorts of evaluations are not所以这些评价不是
157what I'm talking about here.我在这里说的。
158I'm talking instead about policy support.我说的是政策支持。
159Okay.摆
160Let me give you an让我给你一个
161example of persuasion in parallel from one of these experiments.与其中一项实验平行说服的例子。
162This is a study done by这份研究是由
163Chong and Druckmann in 2010 in the U S. The policy area we're studying here is support for2010年,Chong和Druckmann在美国效力. 我们研究的政策领域是支持
164Patriot Act, which was a policy introduced after 9 11.《爱国者法》,这是在9月11日之后实行的一项政策。
165Republicans, when you don't do anything to共和党人,当你不做任何事情
166them, they support the policy at a higher rate than do Democrats.他们支持政策的速度比民主党高
167If you give them pro information,如果你给他们专业信息
168so these were six arguments in a row that the subjects were exposed to, six arguments about因此,这些是连续6个论点 被主体接触到, 关于
169why the Patriot Act is so good, why we should support the Patriot Act.为什么爱国者法案这么好,为什么我们应该支持爱国者法案.
170It's going to keep us它会让我们留下
171safer in a dangerous world.在一个危险的世界里更安全
172We're going to beat the terrorists, et cetera.我们要打败恐怖分子等等
173And when Republicans当共和党人
174are exposed to that information, they increase their support for the Patriot Act.面对这种信息,他们加强了对《爱国者法》的支持。
175And so do我也一样
176Democrats.民主党人.
177So Democrats are also persuaded just like Republicans by about the same amount.因此,民主党人也像共和党人一样,以大约相同数量被说服.
178There is a alternative treatment condition to which subjects could be randomly assigned.还有一个其他治疗条件,可以随机分配对象。
179And还有
180that was to get six arguments about why the Patriot Act is very bad.也就是说 爱国者法案为什么非常糟糕
181It impinges upon our它影响我们
182personal freedoms.个人自由。
183It's a violation of privacy, et cetera, that causes Democrats to decrease their这是一种侵犯隐私等行为,导致民主党人减少
184support for the Patriot Act, but also for Republicans.支持爱国者法案,但也支持共和党.
185So that was the original study这就是最初的研究
186由Chong和Druckmann在2010年之前主持。
187I don't know, maybe 2008.我不知道,也许2008年。
188I came along in graduate我毕业就来了
189school and simply redid the study on a new sample.重新整理研究样本
190So this is the Mechanical Turk sample.这就是土耳其机械公司的样本。
191Mechanical机械
192Turk is a service provided by Amazon where you can essentially get like online workers to takeTurk是亚马逊公司提供的一项服务, 你可以基本上得到像网上工人一样接受
193surveys.调查。
194It's completely unrepresentative of the national population, right?这完全不能代表全国人民,对吧?
195They're just他们只是
196weirdos on the internet.网上的怪人
197And you can see that they have different average, like the Republicans你可以看到,他们有不同的平均, 像共和党
198on Mechanical Turk have a different average opinion from the Republicans in the national与全国共和党相比,
199probability sample.概率样本。
200Even so, on Mechanical Turk, the treatments had very similar effects.即便如此,对于机械突厥来说,这些治疗方法也有非常相似的效果.
201So这么说
202Republicans on Mechanical Turk updated their opinions in line with the treatments that they共和党人关于机械土耳其 更新他们的意见 根据他们的待遇
203saw.锯.
204If you saw the pro treatment, you became more pro.如果你看到专业治疗, 你变得更专业。
205If you saw the con treatment, you became如果你看到骗局,你就变成
206more con.更多的骗局。
207There's actually three instances of the persuasion and parallel pattern in this figure.这个数字中实际上有三个说服和平行模式的例子.
208You've got the persuasion and parallel pattern on the left-hand side.你左手边有说服力和平行模式
209You've got the persuasion你有说服力
210and parallel on the right-hand side.右侧是平行的。
211And also you have one where you can see that people who还有你可以看到的人谁
212are Mechanical Turkers respond to this information and people who are not Mechanical Turkers respond机械突厥人回应这个信息 而那些不是机械突厥人的人回应
213to this information by about the same amount, right?对这个信息,大约相同数量,对不对?
214So that's to say, this is one of the也就是说,这是其中之一
215research design implications of this work is you can't use like these online convenience samples研究设计的影响是 你不能像这些在线方便样本一样使用
216to do descriptive research.进行描述性研究。
217You're going to get the wrong answer about the level of opinion because你会得到错误的答案 关于意见的程度,因为
218of all of the normal sampling bias things that you're taught in introductory statistics class,所有正常的抽样偏差 东西,你教 在入门统计课程,
219right?对吧?
220Mechanical Turkers are not representative of the population.机械突厥人不代表人口.
221Absolutely.当然
222But for the kinds但对于这些种类
223of things we study in survey experiments, when we're studying the causal effects of treatments,当我们研究治疗的因果时
224those are typically quite similar from person to person.它们通常在人与人之间相当相似。
225And so that's the reason why you所以这就是你为什么
226can study those things on non-representative samples and still learn something about human还可以在非代表性样本上研究这些东西 并且仍然了解人类
227beings in general, right?人一般,对不对?
228I'm giving you the substantive talk today, but there is a whole我今天给你实质性的演讲,但有一个整体
229research design side of this, which takes advantage of the fact that when you know that研究设计方面, 利用这一事实,当你知道
230the treatment effects are going to be relatively homogeneous, you can generalize from one sample治疗效果会相对一致,你可以从一个样本中概括
231to another, even though there's no design-based reason for that.虽然没有设计上的理由,
232Okay.摆
233So the book is 23 of those那本书是23本
234kinds of experiments, okay?那种实验,好吗?
235And so chapter five of the book is extraordinarily boring.所以书的第五章特别无聊。
236It's like这就像
237a justification over and over and over again of why that experiment counts on the horizontal axis一次又一次地说明为什么实验依赖于水平轴
238and why that experiment counts on the vertical axis.以及为什么实验依赖于垂直轴.
239And so it's just like a slog to get through所以,它只是像一个slog通过
240all of those experiments.所有这些实验。
241It would be very boring for you, and it would be very boring for me to对你来说会很无聊,我也会很无聊
242go through all 23 of those experiments.经历所有23个实验
243And so what I'm going to do is I'm just going to flash所以,我要做的是,我只是要闪耀
244on the screen the picture that shows up from all of them.在屏幕上显示的图片 从所有他们。
245So you get a sense of how parallel所以,你得到的感觉 如何平行
246and how commonplace this parallel persuasion finding is.而这种平行的说服结论是多么的常见。
247Let me pull that up.让我拉起来。
248So here's所以这里
249chapter five of the book.该书第五章。
250Here's an experiment where people update in parallel, approximately.这里有一个实验,人们平行更新,大约。
251Here's another experiment where people update in parallel.这里还有另一个实验,人们可以平行更新.
252There's more parallelism.更有并行论.
253This is the这是
254one we were just looking at.一个我们刚刚看到的。
255That's the Patriot Act experiment.这是爱国者法案的实验。
256Here's some more parallelism,这里有一些比较平行的,
257still more.还有更多
258This one, the negative treatment was more powerful than the positive treatment,这个,负面的治疗 比正面的治疗更强大,
259but you can see that it's still similar across different groups from the left and the right.但是,你可以看到,它仍然相似 在不同的组 从左右。
260This page is just nothing but parallel lines.此页面只是平行行。
261So is this one.这个也是
262So is that one.那个也是
263So are these.这些也是
264So is that.这也是。
265Okay, that's it.好了 就这样
266So the point of showing you all those things was to very briefly所以,告诉你所有这些事情的要点 是非常简短的
267convince you that across this set of experiments that includes让你相信,在这一系列实验中
268some experiments that I did with collaborators, others where I was replicating somebody else's我和合作者做了一些实验 其他的我复制别人的实验
269work on a new sample and a third set where I was just like, I need some more persuasion experiments新的样本和第三套的样本 我需要更多的说服实验
270and there's this organization called TESS where if you get a grant from TESS, you get to run your有个叫TESS的组织 如果你从TESS那里得到一笔赠款 你就可以运行你的
271experiment on a representative sample, but the requirement is that the data from that experiment进行具有代表性的样本实验,但要求从实验中获得的数据
272be posted online.在线发布。
273So I just downloaded a whole bunch of persuasion experiments and showed that于是我下载了一大堆说服实验 并显示
274it is also true in those ones.在那些方面也是如此。
275In no way am I trying to say that I have sampled at random我绝不是想说我随机抽样
276from the set of possible persuasion experiments.从一套可能的说服实验。
277There's no design, and it's not in any way like根本就没有设计,根本就没有
278of the ones that have ever been done.那些曾经做过的
279If I were to redo this study now, I would choose a different如果我现在重新做这个研究,我会选择一个不同的
280set of 23 experiments to do.23个实验
281I'm gratified to know that when I look at persuasion experiments,我很高兴知道 当我看说服实验时
282now that the book is printed and all the rest of it, and I look at new ones, I keep finding现在书已经印了,其他的都印了 我看着新的,我一直发现
283the same pattern.同样的模式。
284I was talking to a Chinese scholar earlier this week and he showed me his我本周早些时候和一位中国学者谈过 他给我看了他的
285persuasion experiment, and then by people who are predisposed to support the government and说服实验,然后由那些 倾向于支持政府和
286people who are predisposed to oppose the government, you see very similar treatment effects of那些倾向于反对政府的人 你可以看到非常相似的治疗效果
287information even in the Chinese context.信息甚至在中文背景。
288So this is not something that is specific to American所以这不是美国特有的
289people.人们
290This is a feature of human beings, or so I claim, that people are persuaded a small amount这是人类的一个特点,所以我声称, 人们被说服了少量
291of information in that.里面的资料。
292I'm not trying to confine that finding to any particular policy area or to我并不想把发现局限于任何特定政策领域或
293any particular person or to any particular way to divide up the subgroups.任何特定的人或任何划分分组的特定方式。
294It's a general finding.这是一般的发现。
295I look forward to, in the future, people finding exceptions to that, and that's the way this goes.我期待着,在未来,人们 找到例外, 这是这种方式。
296But what's important, I think, is to instead of focusing on all the ways that we're different,但是,我认为重要的是, 而不是专注于我们不同的方式,
297we should focus on the ways in which we are quite similar, and we are quite similar in our我们应集中探讨我们相当相似的方式,我们相当相似。
298susceptibility to persuasive information.容易获得有说服力的信息。
299Okay, I'm going to go back to sharing and I'm going to好吧,我要回去 分享,我要去
300give you a way to summarize all that information that's slightly different from just flashing给您一个方法来总结所有那些 稍有不同的信息 与只是闪光
301those pictures at you.那些照片对你。
302Okay, so this figure is a way of looking at all of the experiments all at好吧,这个数字是看所有实验的方法
303once.曾经
304I'm going to take each experiment and standardize it so that the effects are expressed我要把每个实验都标准化 这样效果就能表达出来
305not in whatever scale happened in that experiment, but instead in standardized units divided by the并不是在试验中发生的任何规模,而是在标准单位中,除以
306standard deviation in the control group so that now we can understand a treatment effect in terms控制组中的标准偏差,这样我们现在就可以理解一个处理效果
307of what fraction of a standard deviation have we moved people.我们移动了多少人
308The horizontal axis on this figure此图上的横向轴
309is the average treatment effect among people who call themselves Democrats.也就是所谓的民主党人的平均治疗效果
310The vertical axis is垂直轴为
311that same thing, the average effective information among people who call themselves Republicans.同样的事情, 平均有效的信息 在人们 自称共和党人。
312What you can see from this figure is that when Democrats have a large treatment effect,从这个数字中可以看出,当民主党人有巨大的治疗效果时,
313so too do Republicans.共和党人也一样
314They share that.他们也一样
315When they have a middling treatment effect,当他们有 干预治疗效果,
316so too do Republicans.共和党人也一样
317That's just to say that the treatment effects across all of these也就是说,治疗效果 贯穿所有这些
318are quite correlated in the sense that whatever the effect is going to be for Democrats, that's相当相关 意思是不管对民主党的影响是什么
319what you're going to find for Republicans.你会为共和党人找到什么
320The reason is that both of them have effects that原因是他们两个都有影响
321are quite similar to the overall average effect.与总体平均效应相当相似。
322This is just to say that the effects are quite这只是说, 效果相当
323homogeneous by partisanship.由党派而同质。
324If I do the same thing by racial group, so now on the horizontal axis,如果我做同样的事情 种族集团, 所以现在在水平轴上,
325I have the effect of treatment among white respondents correlated with the effect of我对白人回应者有治疗效果
326treatment among black respondents.黑人受访者的待遇。
327You can see that this scatterplot is less tightly correlated你可以看到,这个散点的紧密关联性较小
328and there's a very clear understanding of why that's the case.并且对原因有非常清楚的理解.
329There are far fewer black黑的要少得多
330respondents in these samples than there are white respondents, so the confidence intervals in the这些样本中的受访者比白人受访者要多,因此,在样本中的置信间隔是:
331horizontal direction are quite tight.水平方向相当紧凑.
332That just creates attenuation in a correlation.这只会在关联中产生减弱
333That's a straightforward consequence of the different amounts of measurement error that这是不同程度的测量错误造成的直接后果
334we're seeing from the racial comparison versus the partisanship comparison.我们从种族对比和党派对比来看
335Now we can look at现在我们可以看
336this pattern by six different ways of dividing up the population.以六种不同的方式划分人口。
337We had partisanship and race.我们有党派和种族。
338We can also look at ideology.我们还可以审视意识形态。
339We can look at gender.我们可以看性别。
340We can look at age.我们可以看年龄。
341We can look at我们可以看看
342education.教育。
343In all of these cases, we've got good evidence that the effects are correlated.在所有这些案件中,我们都有确凿的证据 证明影响是相互关联的。
344If it's如果是这样
345larger for one subgroup, it's also going to be larger for the other subgroup.对于一个小分组来说,它也会是另一个小分组中更大的.
346The correlation is相关性是
347tighter when those things are estimated with more precision and it's less tight when that's当那些东西被更精确地估算出来时 收紧点 当那样的时候
348estimated with less precision.估计的准确性较低。
349That's just to say any differences that we're seeing by these那只是说我们所看到的区别
350covariates is just a straightforward consequence of having less information about those people.共变只是对这些人了解较少的一个直接后果。
351It is this picture that convinces me that the persuasion and parallel pattern is common.正是这张照片让我相信,说服和平行模式是常见的。
352That's这是
353the basis on which I'm trying to convince you that the persuasion and parallel pattern is common.我试图说服你 说服和平行模式是常见的
354I don't have any further proof for you than what is in this figure.我没有任何进一步的证据给你 比这个数字是什么。
355Here ends the empirical这里结束经验
356portion of the talk.谈的部分。
357If you're not convinced now, I won't be able to convince you further如果你现在不说服我 我就无法进一步说服你
358because I have no more information to do that with.因为我没有更多的信息 这样做。
359I don't know whether I have convinced you,我不知道我是否说服过你
360but suppose that I have.但假设我有
361Suppose that you now believe that the persuasion and parallel pattern假设你现在相信 说服和平行模式
362is common, then your next question is, Alex, you say that it's common, but why don't we see it all亚历克斯,你的下一个问题是 你说这是常见的,但为什么我们不看到这一切
363the time if it is?如果是时间呢?
364I'm going to give you three explanations for this.I三释此.
365The first is, in order to首先,为了
366see the persuasion and parallel pattern, you need to have a randomized experiment.请看说服和平行模式, 你需要有一个随机化的实验。
367You need to see你该看看
368units in their untreated condition and you need to see units in their treated condition.处于未治疗状态的单位,需要看到处于治疗状态的单位.
369If you don't have that, then you can't draw the lines between what people would say on average如果你没有,那你就不能 划清人们平均说的界限
370if they weren't treated and what they would say on average if they were.如果他们没有被治疗 和他们平均会说什么 如果他们是。
371What do we have instead?我们还有什么?
372We have repeated cross-sectional polls of the same kinds of people.我们重复了同一类人的跨部门投票。
373This is a figure that displays这是一个显示
374attitudes towards gay marriage in the US by seven different ways to divide up the population,美国以七种不同方式对待同性恋婚姻的态度,
375partisanship, ideology, religion, religious attendance, race, generation, gender.党派,意识形态,宗教,宗教出席,种族,世代,性别.
376In all总之
377of these subgroups, people went from not supporting gay marriage as much to supporting gay marriage at人们从不支持同性恋婚姻到支持同性恋婚姻
378a much higher level.更高级
379They do that in parallel for basically all of these lines.他们这样做的平行 基本上所有这些线。
380Even those who really连那些真的
381do not support gay marriage, white evangelical Protestants, for example, they have a very low不支持同性恋婚姻, 白人福音派新教徒, 例如,他们有非常低的
382level of support.支助水平。
383Even they increase their support for gay marriage over the course of this period.即使他们在此期间也增加了对同性恋婚姻的支持.
384People who have very high support, so liberal Democrats, they increase their support even more支持度很高的人, 自由民主党, 他们增加了他们的支持
385during this time.在此期间。
386You can find instances of this parallel public's finding.你可以找到这个平行的公众发现的例子.
387This is a classic这是经典
388finding in the political science literature that many, many issues have this feature.在政治学文献中发现,很多,许多问题都有这一特点.
389Here's an这个
390example of an issue where they do not have that feature.例如,它们没有这种特征的问题。
391I did not know before starting this开始之前我不知道
392research that in the 80s, Democrats and Republicans had the same average opinions about whether or在80年代,民主党和共和党对
393not people should be allowed to have abortions.不应该允许人们堕胎。
394Over the course of this period, Democrats and在此期间,民主党和
395Republicans have absolutely split and diverged in their opinions.共和党人的意见绝对分裂和分歧.
396There are other issues like还有其他问题
397immigration, for example.例如,移民问题。
398Immigration attitudes have diverged over time, not moved in parallel.移民的态度随着时间的推移而有所差异,而不是同时移动。
399This kind of information about people's attitudes, I argue you can't use it to understand whether or这种关于人们态度的信息,我认为你不能用它来理解是否
400not it's the case that people update their views in the direction of information in a similar而不是人们更新 他们的观点方向的信息 类似
401amount.金额。
402You can't use this information to study the question that I'm trying to study.你不能用这个信息来研究我试图研究的问题.
403The reason原因
404is that what's the treatment variable in these graphs?这些图表中的治疗变量是什么?
405It's time.是时.
406Many things move with time,许多事情随时间而移动,
407not just information.不仅仅是信息
408We don't really know what the treatment is.我们不知道治疗是什么
409We also don't know that people我们还不知道有人
410who are Democrats and people who are Republicans are getting the same treatment.他们是民主党人 共和党人得到同样的待遇
411They could be他们可能是
412getting exposed to different information.接触不同的信息
413That's another possibility.这是另一种可能性。
414A third problem第三个问题
415is that the kinds of people who call themselves Republicans now are different from the kinds of现在自称共和党人的人 和那些
416people who called themselves Republicans before.以前自称共和党人的人
417There's generational replacement.代代代代相传.
418There's also还有
419been wild changes in party leadership.党的领导权发生了巨大的变化。
420Some people have selected out of calling themselves有些人选择了自己
421Republicans and some people have selected in.共和党人和一些人已经入选.
422There's no sense in which it's the same people没有什么意义是同一个人
423over time in these graphs.随时间推移在这些图表中。
424It's just the set of people who call themselves Democrats and只是一群自称民主党人
425Republicans.共和党人.
426That's all to say.即说一切法.
427It's not like I think that public opinion polling like this is这不像我认为 民意调查像这样
428not useful.无用。
429It does not tell us about the causal effects of information.它没有告诉我们信息的因果关系。
430For that, you need an为此,你需要一个
431experiment.实验。
432Then there's a third reason.后有第三因缘.
433This third reason is more of a sociological critique第三个原因是社会学批评
434of our discipline of political science, which is that suppose you do your experiment and you look我们的政治学学科, 这就是假设你做你的实验,你看着
435at the average effect.在平均效果。
436Fantastic.厉害
437You've got statistical significance.你有统计意义。
438You have shown that你已经证明
439your persuasive treatment does, in fact, move attitudes.事实上,你的有说服力的治疗会改变态度
440Then someone in the audience will say,然后观众会说
441well, that's nice, but is it different for different kinds of people?嗯,这是很好的, 但它是不同的人吗?
442They'll raise that他们会提高这个
443question.问题。
444Perhaps you've been in an audience when someone has raised such a question.也许有人提出这样的问题的时候你一直在观众席上
445Perhaps you've也许你已经
446asked such a question yourself.你自己问了这样一个问题。
447The researchers, they go back to their office and very dutifully研究者们,他们回到自己的办公室,非常忠诚
448run that regression where you check to see whether or not the effects are different for运行返回,请检查效果是否不同
449those two.那两个
450It's not.这不是。
451It doesn't happen.亦不发生.
452Then that analysis somehow doesn't make it into the paper.那这个分析不知怎的 无法写进报纸里
453It doesn't make it into the press release.它没有进入新闻稿。
454It doesn't make it into the way that people talk它不会让别人说话的方式
455about the experiment.关于实验。
456If anything, it ends up as a footnote in the paper, and we checked如果有什么,它最后作为 报纸的脚注,我们检查
457for heterogeneity by this, that, and the other thing.对于异性 由这个,那,还有另一件事。
458We didn't find anything.我们什么也没找到
459All right.好吧,我们走。
460The fact of homogeneity is frequently an afterthought for researchers.同源性这个事实对于研究者来说经常是一个事后思考.
461When you discover当你发现
462homogeneity, you don't make the paper about that.同质性,你不做论文 关于这一点。
463It's only when you find differences in只有在你发现差异时
464treatment effects that you make a whole new theoretical section to explain that difference.治疗效果,你做了一个全新的理论部分 来解释这种差异。
465I think this is a pathology of our discipline to do it that way.我认为这是我们纪律的病理 这样做。
466Instead, we should be focusing相反,我们应该集中精力
467on the ways in which people are similar, since what we're trying to do is learn generalizable关于人们相似的方式, 因为我们试图做的是 学习一般的
468things about people.关于人的事情。
469I don't have any proof that that's the reason why we don't see the我没有证据说明为什么我们看不到
470precision and parallel pattern, but that's my intuition is that there's a sociological problem.精确和平行的图案, 但我的直觉是有一个社会学问题。
471I'm going to not discuss these design objections in detail, but you might have concerns that these我不打算详细讨论这些设计上的反对意见 但你可能担心这些
472experiments somehow don't answer the question as we've described.实验并没有如我们所描述的那样回答问题。
473Some of those parallel lines其中一些平行线
474aren't exactly parallel.并不完全平行。
475There's a defense of that, which is that you really have to believe有个理由,那就是你必须相信
476very strongly in your measurement technique that a move from two to three is exactly equal to a move在你的测量技术中非常强烈地认为,从2到3的移动完全等于一个动作
477from five to six.从五至六.
478Essentially, in someone's heart, that that measurement really reflects基本上,在某人的心目中,这种测量确实反映了
479exactly the same thing, and I'm unwilling to make that claim too strongly.同样的事情, 我不愿意 提出这种说法太强烈。
480You might say,你可能会说,
481Alex, congratulations.亚历克斯,恭喜你
482You have looked at six covariates, but that's not the relevant one.你看过6个共变体, 但这不是相关的一个。
483You have to look at some further way that human beings differ from each other.你必须更深入地审视人类彼此不同的方式。
484There's always a总是有
485new proposal for some difference between people that will explain why they are more or less新的建议,在人们之间有所区别, 以解释为什么他们多少
486persuadable.疑惑无边.
487I don't know that I have measured the correct X.我不知道我测量了正确的X。
488It's not possible for me to know that我不可能知道这一点
489it's an infinite.这是一个无限的。
490It's always another one that you could ask.它总是另一个你可以问。
491You could be worried about你可能会担心
492measurement error in these experiments.这些实验中的测量错误。
493What if people know what you're after, and so then they如果人们知道你在追求什么 那么他们
494just give you the answer that you want to hear, so-called demand effects, or perhaps people are只是给你一个答案 你想听到, 所谓的需求效应, 或者也许人们是
495shy and are worried about embarrassment, and so then they don't tell you the truth害羞和担心尴尬, 所以他们不告诉你真相
496about what they think.关于他们的想法。
497They instead give you what they think you want to hear.他们给了你他们想听的
498Both of those are possible.两者都是可能的。
499I don't have any proof that they're not happening.我没有证据证明他们没发生
500All I have is我唯一拥有的就是
501indirect evidence from other domains where when we look for that kind of a problem, we look for其它领域的间接证据 当我们寻找这种问题时,我们寻找
502demand effects, we look for sensitivity bias, we are unable to demonstrate that it would be a需求效应,我们寻找灵敏度偏差,我们无法证明这将是
503problem in a setting like this.在这样的环境下出现问题。
504I don't know for sure, but it's not like I'm unaware of the problem.我不知道,但我不是不知道这个问题。
505Let me move on now to the second key idea.我现在谈谈第二个关键想法。
506Thus far, what I've been talking about is the effect到目前为止,我一直在谈论的是效果
507of persuasive information on policy attitudes, what I'm going to call Z1 on Y1.关于政策态度的说服力信息, 我要称之为Z1对Y1。
508I want toи稱
509distinguish persuasive information from another kind of treatment, which is group cues.区分有说服力的信息与另一种治疗方式,即群体提示。
510Again,再说一遍
511like I said earlier, group cues are treatments that tell you not why you should support a policy.正如我之前说过的, 团体提示是治疗 告诉你,你为什么不支持一个政策。
512Here's the reasons why.这就是原因
513Instead, it's what somebody else in society thinks.相反,这是社会上其他人的想法.
514Group cues分组提示
515absolutely generate differently signed treatment effects for different people.绝对产生不同的签名 治疗效果不同的人。
516For an in-group对于一组
517member, an in-group cue is going to increase their support for the policy.将增加他们对政策的支持。
518For an out-group member,对于一个外组成员,
519that same cue will decrease their support for the policy.同样的提示会减少他们对政策的支持。
520There's all kinds of interesting work to有各种各样的有趣的工作
521on group cues.在组合提示。
522We have overlapping identities.我们有重叠的身份。
523We have many different groups that we're members of.我们有很多不同的团体 我们的成员。
524Is it the case that you can be cued by any group that you're a member of?你是否被任何你所属的团体指使?
525Does it depend on the这取决于
526strength of your attachment to that group?你对这个团体的忠诚?
527Are there some groups that you allow to speak for你们是否允许一些团体发言?
528politics and other groups that you don't?政治和其他你没有的团体?
529These are questions that we don't know the answers to这些都是我们不知道答案的问题
530just yet.还没有
531It's really important, even though we don't know the answers to those questions,尽管我们不知道这些问题的答案,
532it's really important to distinguish this kind of treatment from that kind of treatment要区分这种治疗和这种治疗
533because if someone comes to me, Alex, I did an experiment.因为如果有人来找我 Alex 我做了个实验
534I found oppositely signed treatment我发现相反的签名治疗
535effects.效应。
536You're wrong.你错了
537People aren't persuaded in parallel, but it's actually a group cue treatment.人们没有被说服 平行, 但实际上这是一个团体提示治疗。
538Then we haven't actually shown that it's not true that people update their views in parallel那么,我们并没有实际显示, 不是真的 人们更新 他们的观点平行
539to persuasive political information.向有说服力的政治信息。
540That's the treatment distinction I want to make.这就是我想要的治疗区别。
541Now, an outcome distinction I want to make is drawing the distinction between现在,我要作出的一个成果区分是区分
542people's policy attitude.人们的政策态度。
543That's the thing that the persuasive information is trying to change说服力的信息就是想改变
544from something I'm calling an affective evaluation.从我所谓的 感人评价。
545That means how much you like the person这意味着你有多喜欢这个人
546who's telling you that, how much you like the message that you're saying.谁在告诉你,你多么喜欢 你所说的信息。
547Do you think that it你觉得
548is high quality?高质量吗?
549Do you think that it is unbiased?你觉得这是没有偏见的吗?
550Do you think that it is persuasive?你觉得这有说服力吗?
551All of these所有这些
552that other measurements are about rating that treatment and rating that messenger.其他的衡量标准是 评分治疗和评分信使。
553The effects of persuasive information on those ratings are also heterogeneous.对这些评级的说服性信息的影响也各不相同。
554If you are the狦琌
555kind of person who likes the information, then your affective evaluation goes up when you see it.那种喜欢信息的人, 然后,你的感性评价升 当你看到它。
556But if you dislike the information, your affective evaluation goes down.但是如果你不喜欢信息, 你的感性评价会下降。
557Many people who have been trying to study the effects of persuasion have许多试图研究说服效果的人
558mistaken the effects on affective evaluations for the effects on policy attitudes.错误地认为对情感评价的影响对政策态度的影响。
559People reject人们拒绝
560information with which they disagree.他们不同意的信息。
561No, no, no.不,不,没有。
562People criticize information with which they人们批评他们用的信息
563disagree.意见不一。
564That doesn't mean that they reject it.这并不意味着他们拒绝。
565You are updating your views in line with the您正在按照
566information even though you don't like it.尽管你不喜欢信息
567That's what I really want you to understand from this key我真的很希望你能从这把钥匙里明白
568number two is that, yes, people dislike things that are counter attitudinal, but no, they don't第二是,是的,人们不喜欢 东西反态度,但是不,他们不
569reject the information.拒绝信息。
570They update in direction of it.他们向它的方向更新。
571Let me give you a summary of those让我给你一个总结
572predictions.预言。
573Persuasion Parallel is about studying the effect of persuasive information on a target劝导平行是研究有说服力的信息对目标的影响
574policy attitude.政策态度。
575My claim is that that's positive for all groups.我的主张是,这是积极的 所有团体。
576That's the main claim.这就是主要主张.
577If you're如果你喜欢
578we have oppositely signed treatment effects, it'll be positive for people who are in the in-group我们有相反的签名 治疗效果, 这将是阳性 在人群中的人
579and negative for people who are in the out-group.对在外人来说,是否定的。
580As I said, I think there's interesting我说过了,我觉得很有趣
581boundaries to that question that we as social scientists need to map out.我们作为社会科学家需要找出这个问题的界限。
582What about the effects那效果怎么样?
583of persuasive information on those affective evaluations?关于这些有说服力的评价的有说服力的资料?
584These are going to be oppositely这些是相反的
585signed.签名。
586It'll be positive for people who are policy proponents, and they will be negative对支持政策的人来说是正面的 他们也会是负面的
587for people who are policy opponents.给那些反对政策的人。
588We really can't get this and this confused.我们真搞不懂这些
589This fourth这第四个
590group is very odd.团体非常奇怪。
591What's the affective evaluation of a group Q?Q组的情感评价是什么?.
592Imagine you're watching a newscaster想象一下你在看一个新闻机
593who tells you, ah, the Republicans support policy X.共和党支持X政策
594You're not really going to update your views你不会真的要更新你的观点
595about that newscaster.关于那个新闻机。
596It's just a weird fourth category, and there are no experiments that I'm这只是一个奇怪的第四类, 没有实验,我
597investigated.调查。
598It's just on the plot because it is the intersection of that treatment and that因为它是治疗的交汇点
599outcome, but it's not of particular interest to us today.结果,但今天我们并不特别感兴趣。
600Let me talk now about the politics我现在谈谈政治
601implications of that typology.这种类型的影响。
602This is the most important one.这是最重要的。
603Persuasive information劝导性信息
604works to change people's minds in the direction of information a little bit, but it comes at a cost.努力改变人们在信息方向上的想法 但代价不菲
605It comes at a cost of them disliking you.这是他们让你失望的代价
606If you try to change someone's mind, it'll work a little如果你试图改变某人的想法, 它会有点工作
607bit, but they'll be angry at you.但他们会生你的气
608In fact, you'll know that it's working when they get angry.事实上,你会知道,当他们生气时,它就起作用了.
609Effective persuasion will seem to backfire in the sense that people get angry.从人们生气的意义上说,有效的说服似乎会反弹。
610I was scrolling我在滚动
611through my TikTok yesterday, and one of the congresspeople here, AOC, was like,昨天通过我的TikTok, 和这里的一位国会议员,AOC, 喜欢,
612if you're out there trying to make change, and the haters are coming for you, don't stop.如果你在外面试图改变, 而仇恨者来找你, 不要停止。
613That's这是
614how you know that you're doing it right.你怎么知道你这样做是对的
615It's like, wow, I don't know how AOC, how you knew就像,哇,我不知道如何 AOC,你怎么知道
616so well about this point because it's kind of subtle, but it's absolutely right.这一点很好,因为它有点微妙, 但这是绝对正确的。
617She's right她说得对
618about that, that when you try to convince people, you will be effective, and yet they will be mad当你试图说服别人的时候,你会是有效的,但他们是疯的。
619at you.对你
620For a long time, people have been confusing that the negative affective response that people长久以来,人们一直混淆人们的负面反应
621have for saying that you've ended up further apart than when you started.不得不说,你结束了 比你开始。
622Ah, this persuasive attempt啊,这个有说服力的尝试
623was counterproductive, and that's just this misunderstanding of the effects on Y2.只会适得其反,而这只是对Y2效应的误解.
624Those这些
625negative effects on affective evaluations, you can't avoid that.对情感评价的负面影响,你不能避免。
626That's just the way that it goes.就是这样的
627People have a negative response to being persuaded.人们对于被说服有消极的反应.
628You can, of course, sugarcoat things.你当然可以穿好衣服
629Many news channels have learned this, where they package things that are not palatable in nice许多新闻频道都知道了这一点, 在那里,他们包装的东西 是不好的
630packages so that you don't dislike it quite so much.包,以免你非常讨厌它。
631You can do other things to make people like你可以做其他事情 让人们喜欢
632you.你们
633There are many books on how to be persuasive at work, and those are not really about有很多书 关于如何说服工作, 这些不是真的关于
634what arguments work best for different people.什么样的论据对不同的人最有效。
635It's about how do you make people like you?在于如何造化众生.
636How怎么样
637do you make it so that they are not as angry at you?你这样做是为了不让他们对你生气吗?
638Weirdly, that's right.奇怪,这是正确的。
639It's mistaking这是错的
640persuasion for making people like you, but you can offset the affective costs with sugarcoating.说服别人像你一样 但你可以用糖涂抹来抵消影响成本
641If you're trying to persuade people on the other side, don't use group cues.如果你试图说服对方的人, 不要使用团体提示。
642Group cues will cause组提示将引起
643people to go in opposite directions, and that's not what you want to do.人们走相反的方向, 而这不是你想做的。
644Many politicians who are许多政治人物
645doing their campaign advertisements have already learned this in some way.他们的竞选广告已经以某种方式了解到这一点。
646In the U.S., TV ads在美国,电视广告
647run by congresspeople almost never use partisan labels.议员们几乎从不使用党派标签
648They don't remind people of what party他们不会提醒人们什么派对
649they're a member of, and that's because they understand that we'll have oppositely signed他们是其中的一员, 那是因为他们明白 我们将会相反地签署
650treatment effects.治疗效果。
651I don't know that all members of our political communication establishment have我不知道我们的政治通讯机构所有成员
652understood this.理解这一点。
653Group cues are part of how we talk about politics, and this has polarizing团体提示是我们如何谈论政治的一部分, 这已经使两极分化
654effects.效应。
655If you want to be persuasive, you want to avoid those group cues.如果你想有说服力,就想避开那些团体提示.
656Many campaigns try to target the people they think are going to be persuadable, so-called swing许多运动试图针对那些他们认为 将会被说服的人,所谓的摇摆
657voters in the middle.选民在中间。
658I think this is misguided in the sense that everyone is a little bit我认为这是误导 意思是每个人都有点
659persuadable.疑惑无边.
660You might be missing out on people whose minds you could change if you are targeting你可能会错过的人 如果你的目标,你可能会改变想法
661too narrowly to people who are in the middle.对中间的人来说太狭隘了
662A vote that comes from taking people from 90%从90%的选票上投票
663support to 91% support, that counts just as well as taking someone from 10% support to 11% support.支持91%的支持,同样重要的是将某人从10%的支持到11%的支持。
664That targeting is possibly misguided.这种瞄准可能是错误的。
665There are times when the amount of persuasion that you're有时你被说服的程度
666doing is too small to make someone go from being an opposition person to being a supporter.这样做太小了,不能使人从反对派转变为支持者。
667When the thing is right at that cut point between supporting and not supporting,当事情恰好在支持和不支持之间的切点时,
668maybe it makes sense to find people who are at that cut point.也许找到那些处在切点的人是有意义的。
669For that reason, you might want因此,你也许想要
670to target.目标。
671The standard explanations of, well, those people are not persuadable because they're这些人的标准解释是,嗯,他们不是 被说服,因为他们是
672already convinced or they're unconvincible, and it's just the people in the middle that we need已经相信了,或者他们无法相信, 而我们只需要中间的人
673to target.目标。
674I think that's misguided.我认为这是误导。
675There are some research design implications of this.这涉及到一些研究设计问题。
676One is that you can't just ask people to rate treatments to understand their persuasiveness.一是不能只要求人们给治疗评分来理解他们的说服力.
677How persuasive do you think this will be?你觉得这会有多有说服力?
678You're not going to get the right answer because people你不会得到正确的答案 因为人们
679don't know that.这还不知道
680You can't use ratings to judge persuasiveness.你不能用收视率来判断说服力.
681Since I've been out here trying自从我一直在这里尝试
682to tell people that the effects of treatments are mostly homogeneous, people have come at me告诉人们治疗的效果 大多是同质的 人们来找我
683with counterexamples, and I look forward to that.与反例,我期待着这一点。
684I think it's great that people are coming at me我觉得人们冲我过来真好
685with counterexamples, but a lot of times the treatment ends up actually being more of a group但很多时候 治疗结果都更像是一组
686cue, and so then that doesn't count.所以这不算数
687Sometimes it ends up being an affective evaluation outcome,有时它最终是 一种具有情感的评价结果,
688and that doesn't count either.那也不算数
689Really what I'm trying to say is that these distinctions我想说的是这些区别
690are important for understanding how people respond to information, so these are not对了解人们如何应对信息很重要,因此这些不是
691counterexamples in my opinion.反例在我看来。
692Counterexamples could easily happen.反实例很容易发生。
693Go do an experiment where去做个实验
694it's really a persuasive treatment, a persuasive information treatment, and show oppositely signed这真的是一种有说服力的治疗, 一种有说服力的信息治疗, 显示相反的签名
695treatment effects.治疗效果。
696Then that would be an exception.那这将是一个例外。
697We don't see that.我们没有看到。
698All right, the last point.好吧,最后一点。
699Now this is a theoretical point that matters especially现在,这是一个理论问题 尤其重要的是
700from political science theory and less for politics.从政治学理论 少用于政治。
701If you're less interested in political如果你对政治不感兴趣
702science theory, you don't have to pay attention to this part, but this is what I've been talking科学理论,你不必注意这部分, 但我一直在谈论这个
703about so far.目前为止
704The previous section was about how it matters for politics, and this is how it matters上一节是关于政治的重要性,这就是它的重要性
705for our theories of how people understand political information.我们的理论 人们如何理解政治信息。
706Motivated reasoning theory有动机的推理理论
707is a large body of theory that presupposes that people have motivations and that they use those是一个庞大的理论体系,它预示着人们有动机,使用这些
708motivations to arrive at particular attitudes.产生特殊态度的动机。
709In particular, you are supposed to have accuracy尤其是,你应该有准确性
710goals on the one hand and directional goals on the other, so an accuracy goal is trying to arrive一方面是目标,另一方面是方向目标,所以准确的目标就是试图达到
711at the correct answer.在正确的答案。
712That's you're motivated to get the correct answer.这就是你得到正确答案的动机
713You're trying to arrive你试图到达
714at the right policy attitude.在正确的政策态度。
715The directional goal is trying to arrive at a particular policy方向目标是试图达成一个特定政策
716like you have in order to protect your group identity.就像你为了保护自己的群体身份而拥有的
717What you're going to try to do is reason你要做的是解释
718your way to finding out that you hold that attitude.你如何发现你持有这种态度。
719That's a directional goal.这是一个方向目标。
720These two things are supposed to interact with what happens when you encounter persuasive这两件事应该 与发生 当你遇到说服力
721information.资料。
722Depending on your directional goals and your accuracy goals, information will have a根据您的方向目标和准确性目标,信息将有一个
723different effect.不同的效应。
724This expression is to say, well, let's talk about, let's just write it a little这个表情是说,好吧,让我们谈谈,让我们写一下
725differently.不一样
726What is the effective counter attitudinal information?什么是有效的反态度信息?
727That's the interesting这是有趣的
728case.案例。
729So whatever directional motivation you have and whatever accuracy motivation you have,所以不管你有什么方向动机 也不管你有什么精确动机
730the only thing that's going to change in this expression is whether or not you get that这个表情唯一要改变的就是 你是否明白
731counter attitudinal information.反态度信息。
732This expression is going to be positive if your accuracy goals如果您的精确目标, 此表达式将是正的 。
733dominate.统治。
734If your accuracy goals are the things that matter more for you, then when you get that如果你的精确目标对你更重要, 当你得到它时
735information, you're going to update in the direction of information.信息,您要向信息方向更新.
736But if the directional goals are但如果目标是
737things that dominate, then the effect of that information will be negative.主导事物,那么信息的效果将是负面的。
738That's the claim这就是要求
739of motivated reasoning.动机的推理。
740But I just told you the persuasion and parallel pattern is common.但我刚刚告诉你 说服和平行模式是常见的。
741If you如果你们
742agree with me that the persuasion and parallel pattern is common, then you have to conclude同意我的观点,即说服和平行模式是常见的,然后你必须得出结论
743either accuracy goals always dominate or motivated reasoning theory is not a great model精确目标总是占优势 或动机推理理论不是一个伟大的模型
744of political information processing.政治信息处理。
745I'm not really being honest here.我在这里不是真的诚实。
746None of the motivated没有动机
747reasoning theorists think this.推理理论家认为这一点。
748They don't think that accuracy goals always dominate.他们不认为精确目标总是占优势.
749That's the就是这样
750reason why they built the theory.他们为什么建立这个理论。
751I'm obviously on this side of the argument.我显然站在这一边
752I don't think it's a我觉得这不是
753particularly good model of information processing.特别是良好的信息处理模式。
754But again, I'm not able to show that the whole但我还是不能证明
755theory is wrong.理论是错误的。
756It's just that this particular prediction isn't right.只是这个特别的预测是不正确的.
757You might say, but aren't你可能会说,但不是
758there studies that show that motivated reasoning is right?有研究显示有动机的推理是正确的吗?
759Isn't that what those people did is that那些人就是这么做的
760they demonstrated that those theories are correct?他们证明这些理论是正确的吗?
761And what I want to tell you is, and this is where我想告诉你的是,这里是
762it ties back into research design, that the research designs that those studies used were weak.它与研究设计相关联 这些研究所用的研究设计很薄弱
763So I'm going to just briefly explain how it is that those studies were weak.所以我想简单解释一下 这些研究是如何薄弱的。
764The first one is第一个是
765a paper by Lord Ross and Leper.罗斯勋爵和麻风病的论文
766In 1979, they brought 48 Stanford undergraduates into the lab.1979年,他们把48名斯坦福本科生带入实验室.
767Half of them were pro-capital punishment.其中一半是赞成死刑的。
768Half of them were anti-capital punishment.其中一半是反死刑。
769They showed他们显示
770them a bundle of information and then asked them, how, if at all, did your attitude change on the然后问他们 你的态度怎么改变
771scale from negative eight to eight?缩放从负八到八?
772Proponents said that their attitudes became more pro by 1.5支持者说,他们的态度以1.5比1.
773skill points, and opponents said that their attitudes became less pro by negative 1.7 skill对手说,由于负1.7的技巧,他们的态度变得不那么有利。
774points.点。
775So this is oppositely signed effects, or so it seems.因此,这是相反的签名效果,或者看起来是这样。
776But you can't just ask somebody但你不能随便问别人
777what their effect is.他们的效果是什么?
778You can't just ask for their treatment effect.你不能仅仅要求他们的治疗效果。
779That requires这需要
780like introspection into your soul to know what your counterfactual attitude would have been had就像你内心的回顾 知道你的反事实态度会是什么
781seen the other information.看过其他信息
782This is not something that subjects can do.这不是课题所能做的.
783It doesn't take advantage没用的
784of anything like a random assignment to information in order to figure out what the effect of诸如随机分配信息之类的东西 以便找出什么效果
785information is.资料是。
786So when my co-author Andy Guess and I read this in grad school, we lost our minds.所以当我的合著者 Andy Guess和我在研究生院读到这个的时候 我们失去了理智
787We're like, this is not how you learn the answer to this question.我们想,这不是你如何 学习这个问题的答案。
788So we did a replication study所以我们做了一个复制研究
789where we embedded exactly this condition in a random assignment study so that we could compare我们把这个条件 完全嵌入到随机任务研究中 这样我们就可以比较
790what happens now in 2018.2018年发生的事
791If you analyze the data exactly as Lord Ross and Leper did,如果你分析的数据准确 罗斯勋爵和莱珀所做的,
792we also get that crazy finding.我们也得到了疯狂的发现。
793Proponents say that they became 2.7 skill points more pro,支持者说,他们成为2.7 技能点 更专业,
794and opponents became 2.7 skill points less pro.而对手则成为2.7个技能点 不如专业。
795But that's ridiculous.但这是荒谬的。
796We're not supposed to ask,我们不应该问,
797but when we just analyze it according to the random assignment, we see exactly parallel lines但是,当我们只是分析它 根据随机的任务,我们看到完全平行的行
798again.再来
799So the problem here is this measurement is that people are not able to tell you what the所以这里的问题是,这个测量是 人们不能告诉你什么是
800causal effects of things are.事物的因果关系是。
801Instead, they report the level of their opinion.相反,他们报告自己意见的程度。
802When you ask people,当你问人们,
803how well or poorly do you think this study was conducted?你认为这次研究有多好或差?
804So that's an affective evaluation所以,这是一个感人的评价
805outcome.结果。
806This is where you get an X.这就是你得到一个X。
807This is where the proponents think that the pro study was really这就是支持者认为专业研究真的
808done and the con study was very badly done, whereas the opponents think the con study was而对手则认为
809well done and the pro study was very poorly done.做得很好 专业研究做得很差
810So this is what people were thinking when they're这就是人们当时的想法
811talking about people rejecting information, is that they give negative evaluations.谈论人们拒绝信息, 是他们给出负面评价。
812Yes,
813they do give negative evaluations, but they nevertheless are updated in the right direction.它们的确作出负面评价,但都是朝着正确的方向更新的。
814That's just to say that this study doesn't show what it claims to show, and when you fix it,也就是说,这个研究并没有显示它声称要显示什么,当你修复它时,
815you get the persuasion and parallel finding.你得到说服和平行的发现。
816I'm going to skip this last study, and instead,我要跳过这最后的学习,相反,
817I'm going to sum up.即总结.
818I tried to get three key ideas across in this talk, and the first one is我试图得到 三个关键的想法 在这个谈话,第一个是
819that the persuasion and parallel pattern is common.说服和平行模式是常见的。
820I'm trying to make a general claim that我试图做出一个一般性的声称:
821what normally happens is that people update their views in the direction of information,通常发生的情况是 人们更新 他们的观点方向的信息,
822and it doesn't matter.无所谓
823It just doesn't matter what your background is.你的背景并不重要
824You update a small amount你更新一个小数额
825in the direction of information, and even though you dislike it when it's kind of attitudinal,尽管你不喜欢这种态度
826you still update in the direction of information.您仍然可以向信息方向更新。
827This second key idea is distinguishing between two第二个关键想法是区分
828kinds of treatments, persuasive information and group cues, versus on the treatment side and then治疗方式、有说服力的信息和群体提示,与治疗方面相对,然后
829the outcome side.结果方面。
830I want to distinguish between policy attitudes and affective evaluations.我要区分政策态度和积极评价。
831Keeping these two separate lets you understand that important trade-off that, yes, you can change保持这两个分开,让你明白 重要的取舍,是的,你可以改变
832minds, but it comes at an affective cost.思想,但它来 以情感的代价。
833We all have to manage where we are on that trade-off,我们都得处理好我们的权衡
834at dinner with your family.和家人一起吃晚饭
835You might want to change their minds on something,你也许想改变他们的心意
836but they would be mad at you if you did.但他们会生你的气,如果你这样做。
837We sometimes avoid that conflict,我们有时避免冲突,
838even though it would be a little bit effective.虽然会有点有效
839That same trade-off is happening in the political同样的权衡 发生在政治
840arena.竞技场。
841The last one is this theory point that one theory of mind is called motivated reasoning,最后一个是这个理论点 一个思想理论叫做动机推理,
842and I don't think that a major prediction of that theory holds up.我认为对这个理论的主要预测并不成立。
843It makes me worry about the theory这让我担心理论
844in general, but I am not offering an alternative.总的来说,但我并没有提出一个替代办法。
845There are frustrating research design reasons for有令人沮丧的研究设计原因
846that.那个
847It's very hard to come up with a theory of what's happening in people's minds.于众生心所现种种法界皆难思议.
848All I can尽我所能
849really do is show that when I present people with persuasive information, this is how their真正证明的是,当我向人们介绍有说服力的信息时, 这就是他们如何
850responses change.反应变化。
851Then I'm not drawing extra inferences about what's going on in between.之后我也不会对这两者之间发生的事情做出额外的推论.
852Thank you very much.谢谢
853That's all I've got for you.这就是我给你的。
854I'd be happy to take your comments and questions.我很乐意接受你的评论和提问
855Great.不错
856Thank you so much.非常感谢
857What a fascinating talk and lots of information to process there.多么令人着迷的谈话和很多信息 处理在那里。
858We can open it up for some audience Q&A.我们可以打开它一些观众QQA。
859If anybody has a question, please feel free to raise your如果有人有问题 请随意举起你的
860hands, and we can call on you to have some discussion.我们可以请你们讨论一下
861If you are particularly shy,如果你特别害羞的话
862you can also just enter your question onto the chat box, and I will do my best to moderate those你也可以把问题输入到聊天框里 我会尽力调和
863questions.问题。
864I know people take a while to formulate their questions, so as we're waiting, I will我知道人们要花些时间来提出他们的问题, 所以当我们等待的时候,我会
865throw out the first question, which I was very intrigued by this idea of when you were talking扔出第一个问题, 我非常感兴趣 这个想法,当你说话
866about AOC and how it actually works.关于AOC和它是如何实际工作的。
867You mentioned after that the idea of polarization and how之后你提到了两极分化的想法 以及如何
868politicians or people may not purposely will not say Democrats believe this or Republicans believe政客或人民可能不会故意说 民主党人相信这一点 或者共和党人相信
869this, but it seems like nowadays there are certain people who purposely use group cues to incite不过现在似乎有人故意利用团体提示来煽动
870polarization and to cause that divergent effect.造成这种不同的效果。
871Am I understanding that correctly in terms of我的理解是正确的,从
872the implication for what our political situation looks like now, at least in the U.S.?对我们现在的政治局势的影响, 至少在美国?
873Yes.
874I think that it's just quite clear that many politicians are dividing up the U.S. especially我认为非常清楚的是,许多政客正在分裂美国,特别是美国。
875into camps, and they're saying those Democrats are horrible and stupid and we Republicans are他们却说那些民主党人 既可怕又愚蠢 我们共和党人
876vice versa.反之则曰.
877Their goal is not at all to persuade the other side of their policy positions.他们的目标根本不是说服政策立场的另一面。
878Instead,相反,
879they are presumably trying to seek reelection, and they think that that's a good strategy.他们大概是想寻求连任 他们认为这是个好策略
880Those districts are ones where it's very difficult for one or the other party to win,那些地区是很难赢的
881and so they don't pay the electoral cost of failing to persuade the other side,所以他们不支付选举费用 不说服对方,
882and so they are free to use those group cues to forward other objectives beyond trying to因此,他们可以自由地使用这些团体提示来推进其他目标,而不是试图
883change the minds of other people.改变别人的思想
884Persuasion is not always the goal of elected politicians.劝导并不总是当选政治家的目标.
885With respect to the AOC's comment, it was just poignant for me to hear her say,关于AOC的评论,我听到她说,
886whenever you're out there trying to affect change in the world, when you're successful,当你在那里试图影响世界的变化, 当你成功的时候,
887the haters come for you, and it's not evidence that you're doing a bad job.仇恨者来找你, 这不是你做坏事的证据。
888Instead, it's evidence而是证据
889that when you try to persuade people, they get angry about it.当你试图说服人们, 他们对此感到愤怒。
890That's so interesting.这太有趣了
891With these groups or these people who are purposely inciting与这些团体或这些人 故意煽动
892polarization, do you feel like they actually have this data and are purposely doing this,极化,你觉得他们真的有这个数据 并且有目的地这样做,
893or is this something that they intuitively feel like doing?还是他们直觉上想做的事?
894That's fascinating.这太迷人了
895One thing I can tell you is many politicians have now turned towards我可以告诉你一件事,很多政客现在转向了
896survey experimentation to test their messages.调查实验测试他们的信息。
897It used to be that social scientists were the以前社会科学家是
898ones who were like, oh, we've got random assignment.那些像,哦, 我们有随机任务。
899We can learn about the world我们可以了解世界
900through experimentation, and campaigns would be relying on focus groups or just their own通过实验,运动将依赖焦点小组或仅仅是他们自己的
901intuition or campaign consultants to come up with their messages.直觉或竞选顾问 提出他们的信息。
902Nowadays, they have switched to a现在,他们换成了
903that runs a survey experiment, and then they pick the best performing one in that survey experiment.然后他们选择在调查实验中表现最好的
904One cool wrinkle is that one of those companies made a condition of using their services that一个很酷的皱纹是,其中一家公司创造了一个条件 利用他们的服务,
905the data would be made available to academics.数据将提供给学术界。
906Now we have this huge treasure trove of what现在我们有了这个巨大的宝藏
907those campaign experiments are up to.这些运动实验是值得的。
908That is to say that it is possible that the political也就是说,政治方面有可能
909establishment has learned what we now have learned from these experiments.我们从这些实验中学到了什么。
910I don't think我不觉得
911that really explains some of the comments from Marjorie Taylor Greene or stuff like that.这真的解释了马乔里·泰勒·格林的一些评论 或者类似的东西。
912I一、导 言
913don't think she's thinking that way, but it is true that some campaigns have become the social别以为她是这样想的 但确实有些运动变成了社交活动
914scientist.科学家。
915I see a question here in the chat.我在聊天时看到一个问题
916Hi, since the persuasion parallel is common,嗨,因为说服平行是常见的,
917does it mean that having a proper way to expression, even with different people,这是否意味着有 适当的表达方式, 即使与不同的人,
918can work well as each other?彼此能合作吗?
919That's a great question.问曰.
920That's a really great question.这是一个非常好的问题。
921I understand this question to be, suppose that you believe me that given a particular treatment,我理解这个问题是,假设你相信我 给予特殊待遇,
922everyone responds the same.大家都一样
923My problem is still picking what do I say to people,我的问题仍然是选择我对别人说什么
924and which treatments are more or less effective.以及哪些治疗或多或少有效。
925This book is not about that.这本书不是关于那个的。
926So that's just to say you pointed out here that it's still totally possible that some treatments也就是说你在这里指出 某些治疗还是完全可能的
927are more effective than others.比别人更有效
928Some things that you say won't be effective, some things that you你说的一些事情不会有效 有些事情你
929say will be effective.说会有效
930How can you know which ones are which?你怎么知道是哪个?
931I don't know.师曰.
932I don't know how to我不知道该如何
933tell you that.告诉你
934One thing that I can say is when I was just describing that treasure trove of我可以说的一件事是 当我刚刚描述 宝藏的
935experiments where campaigns have tried out just hundreds and hundreds of messages.实验中,运动试验了数百条信息。
936Now we have现在我们有了
937experiments that test those.实验测试这些。
938The average effect across all of them is about a 0.8 percentage point他们的平均影响约为0.8个百分点
939effect on vote choice.对投票选择的影响。
940So it's very small, very small effect on vote choice.所以对投票选择的影响很小,非常小.
941Then you ask, well,然后你问,嗯,
942how much better is the best one than the average?最好的比一般好多少?
943How much worse is the worst one than the average?最差的比一般的还要差多少?
944The standard deviation is about 0.4 percentage points.标准差约为0.4个百分点.
945An ad that's 50% better than the average广告比一般广告好50%
946is about 1.2 points.大约1.2分。
947An ad that is 50% worse than the average is about 0.4 points.广告比平均水平差50% 约为0.4分.
948That is just to这只是为了
949say that the amount of difference that we're talking about from really good ones to average说我们所说的差别 从真正的好到平均
950bad ones is pretty small.坏的还很小
951The thing to probably think about more is what are the things that you可能更想的事情是 什么是你的东西
952can do to make it so that people will listen to you?能让别人听你的?
953It's not so much the thing that you deliver这不是什么你送的东西
954once they're listening.一旦他们听。
955It's all of the stuff that you need to do in order to get their attention这是所有的东西,你需要做的 为了引起他们的注意
956that that really makes a difference.这真的有区别。
957That kind of stuff is going to depend on what kind of person那种东西要看是什么样的人
958you are.没错
959Different kinds of people will pay different attention depending on what they不同种类的人会视其不同而给予不同的关注
960think about you.想着你。
961Anyway, that's a long-winded answer to say, I don't really know, but the总之,这是一个很长的答案 说,我真的不知道,但
962differences are small.差异很小。
963The main thing that you need to be concerned about is how do you get people你最需要关心的是 你如何让人们
964to listen?听着?
965I'm going to piggyback off that.我要从那上爬下去
966A lot of people in the audience are coming from a more观众中很多人都来自
967business perspective.商业视角。
968A lot of the questions revolve around, most of your examples I think有很多问题围绕, 大多数你的例子,我想
969are more policy-oriented or at least politics or anything.更注重政策,或至少政治或任何东西。
970Does this apply across different这是否适用于不同的
971domains?域吗 ?
972The standard business setting is going to be what is the appeal that will make you buy标准的业务设置将会吸引你
973the product?产品?
974Here, there is extremely good evidence of heterogeneity.这里,有极佳的异质性证据.
975There are ads that有广告
976have different effects on purchasing behavior.对购买行为有不同的影响。
977There's good evidence that if you target your ad有确凿的证据表明 如果你瞄准你的广告
978to the right audience, you will get them to buy, whereas if you were to target the same ad to a给合适的观众,你会得到他们购买, 而如果你是针对同一广告
979different audience, you would not get them to buy.不同的观众,你不会让他们买。
980That's because what the advertisements are doing那是因为广告在做
981is informing you of what your choices are.让你知道自己的选择是什么
982It's only the people who would want that thing只有人们才会想要那东西
983that are ever going to buy, and then what you're trying to do is you're solving an information永远要买, 然后你试图做的是 你正在解析一个信息
984problem.问题。
985I'm not a business school professor.我不是商学院教授
986I'm sure it's much more complicated than that,我敢肯定,这比这复杂得多,
987but that is the essential difference with politics.但这是与政治的根本区别。
988Here, we are not trying to match在这里,我们不试图匹配
989consumers with products.消费者与产品。
990Instead, we've got policies that we're trying to increase or decrease相反,我们有政策 我们试图增加或减少
991support for.支助。
992It's a very different choice setting, which is why, by the way, the advertisements to这是一个非常不同的选择设置, 这就是为什么,顺便说一句,广告到
993which we are all exposed are algorithmically determined.我们都被暴露了 算法上是确定的
994The advertisements that I get are我得到的广告是
995going to be very different from the advertisements that you get, and that's because they make a lot和你得到的广告大不一样 因为他们赚了很多
996more money when they do it that way, and they have learned that.当他们这样做的时候,会有更多的钱, 他们已经学会了这一点。
997They have learned that他们知道
998through direct experimentation.通过直接实验。
999So there's wild heterogeneity in the effects of advertising appeals广告呼吁的效果很不一样
1000on purchasing behavior.在购买行为。
1001The same is just not true for trying to change people's minds about things.试图改变人们对事物的思考,情况也并非如此。
1002Great.不错
1003Any last questions from anybody in the audience?有观众最后的问题吗?
1004All right.好吧,我们走。
1005Well, if not, thank you so那么,如果没有,谢谢
1006much, Alex, for a fascinating talk.爱丽克丝 说得真有趣
1007And I'm sure that people do actually have questions.我相信人们确实有疑问。
1008And so这样
1009please- Zoom is an odd platform.请 - 缩放是一个奇怪的平台。
1010It's totally fine.没关系
1011Thanks very much for listening.非常感谢你的聆听。
1012In any case,无论如何,
1013I really appreciate it.我真的很感谢你
1014It's great talking to you all.很高兴跟大家聊天
1015So be on the lookout for the book,注意看书
1016and Persuasion in Parallel.和平行劝导。
1017And there it is.就是这样
1018And thank you again, everybody, for joining us.再次感谢大家加入我们
1019Thank you, Alex, again, for a fascinating talk.谢谢你,亚历克斯,再次, 一个迷人的谈话。
1020And we'll see everybody next time.下次见大家
1021All right.好吧,我们走。
1022Bye-bye.再见
该视频共有字幕 1023 条。解锁更多字幕为会员功能,请移动到 价格