tv HAR Dtalk BBC News July 2, 2018 12:30am-1:01am BST
12:30 am
i'm babita sharma. this is bbc world news. our top story: the polls are due to close shortly across mexico, in the biggest election in the country's history. it follows a campaign plagued by violence, with more than 130 candidates and party members killed. the front—runner is andres manuel lopez obrador, who has promised to fight corruption. two penalty shootouts see passions run high at the world cup — russia has knocked out spain in the biggest shock of the tournament so far. and this story is trending on bbc.com... french police have launched a huge manhunt after a notorious armed robber was sprung from prison in paris by armed men in a helicopter. redoine faid was serving a 25—year sentence for a failed robbery. this is the second time he's managed to escape. stay with bbc world news. now on bbc news, hardtalk‘s stephen sackur speaks to computer scientist and author, jaron lanier. welcome to hardtalk.
12:31 am
i'm stephen sackur. the internet is perhaps the defining technological advance of the last 50 years. it's opened up a new world of possibilities. but what if it's also representing an existential threat to humanity? that is the alarming possibility raised by my guest today. jaron lanier is no techphobic sensationalist. he is a silicon valley insider who was a hugely influential pioneer in virtual reality and the consultant to some of the biggest tech giants. so in what ways are we sowing the seeds of our own destruction? jaron lanier, welcome to hardtalk.
12:32 am
thank you for having me. you've spent the last three decades and more in the world of technology and it seems during that time you have made an emotional journey from optimism much more toward pessimism. and i'm wondering why. i have to disagree with you. i find that if i look at human history, things generally in the big picture have gotten better for humanity, and i have no reason to believe that that pattern will go away. i think things can get better and i'm an optimist, however i believe that every time things have gotten better it's because a critic said, "wow, things could be better." so to me being a critic is the mechanism by which one expresses optimism. the enemy of the future
12:33 am
is complacency, not criticism. so i absolutely reject the level of pessimist. 0k. well, fair enough. but it does seem to me you're more than just expressing creative, constructive, criticism. you're also expressing fear. yeah and it's warranted, that is warranted. we have done something to ourselves that mankind has never done before, which is we've created a universal system of surveillance and behaviour modification of most of our species through devices, through social media and so forth. now i want to emphasize the problem is not the devices. the problem is not the experience of using social media, per se. i think that can often be extremely positive. the problem is this behind the scenes effort to manipulate everyone. and i think that that indeed is creating a deleterious result for democracy, for interpersonal relationships,
12:34 am
for personal psychological health. it's a very gradual problem but it is very real. i do want to spend time on that notion of manipulation and ask you who's doing the manipulating and to what end. but before we get there, i think it's important to just get to grips with these rather extraordinary story that you bring to this hardtalk table. i mean, your childhood was very difficult and tragic. i mean, you lost your mother in a car crash when i believe you were just ten years old, and your father was badly injured too, and then he took you off to new mexico. and it seems you were sort of living almost off grid for a long time. i have to say compared to many stories in the world, i don't think my childhood was as bad. i had a very unusual mother for her generation in that she was the breadwinner for the family and my father was not.
12:35 am
so when she died, we found ourselves impoverished and we became homeless. and what my father did is, he got the cheapest land available, which was desert land in southern new mexico. and we lived there in tents and gradually built a home for ourselves and he became certified as an elementary school teacher. and over the course of seven years, we built this fantastical house that was made of strange geometric forms and domes and all kinds of things. i think the experience that my father gave me of using creativity as a way to rebel against tragedy has been central and effective. i think creativity is a proper and good response if it's possible. so yes, of course, of course, it's what made me and i am eternally grateful. you're a tiny bit younger but not that much younger than the generation the first generation of tech superstars, steve jobs, bill gates.
12:36 am
you're a little bit younger but you, like them, gravitated to working in california. and i just wonder whether you, like them, were both somewhat idealistic about what technology can do, but were you also driven to create a business, to become a superstar entrepreneur, like they clearly were? not at first. actually, when i first showed up in silicon valley, i had never experienced wealth and i made some video games on the side, right in the dawn of video games in the 8—bit era and made money, and i was actually initially uncomfortable and embarrassed by it. and indeed, when my friends and i started the first virtual reality startup, which was in the early 1980s, we were quite embarrassed by it and uncomfortable with the notion of money in business, and we're trying to make it into some sort of a collective or something. gradually though, there's a funny thing when you're surrounded by a value system in a society, you do start to take it on. and i felt this thing stirring in me, like i should be an entrepreneur.
12:37 am
it's funny how that happens. the social environment is extraordinarily powerful. it's not that i currently think there's anything wrong with entrepreneurship. actually i've come to really love the business side of silicon valley, but it wasn't what brought me there. i'm probing this area of your life and the degree to which you wanted to make money and be an individual success, because coming back to your opening remarks about where the internet and social media are taking us, you seem to have a fundamental problem with with a big decision that was taken quite early on in the development of, for example, facebook or even google, which was to say they got this amazing idea, this new technology, and the owners of the idea decided we'll make it free to the great general public, but we'll monetize it by generating ad revenue. and of course this particularly
12:38 am
applies to a company like facebook. and you seem to be saying that looking back on that decision, it was a fundamental mistake. right. well, you know, the tension that we just talked about between loving entrepreneurship and then also feeling a little uncomfortable with the sort of greed inherent in silicon valley was exactly what caused this all to happen. back around the time that companies like google and facebook were being created, there was a prevailing feeling that everything online should be free, it should be free of capitalism. the notion of the public commons and of opening everything up, a knowledge base for humanity. exactly. so computer code would be made open, music would be free. journalism would be free. everything would be open, but at the same time we loved the hero idea, the cowboy idea of the great hacker or the great entrepreneur, like a stevejobs. and if you try to combine those
12:39 am
two things, it's rather difficult, you know. and so the solution, and really i think the only solution, was what was called the advertising model. but even though it started off innocent enough, computers kept on evolving, the software got better, the customers got more sophisticated, and that's how we inadvertently, i believe, brought about this surveillance scheme and this manipulation scheme. almost every penny made by a company like facebook is earned from customers who believe that the behavior of users of facebook will be modified by the use of facebook. and you do create this society where anytime people connect through the internet, it is financed exclusively by those who wish to manipulate the users. why is that different from tv advertising? because tv advertising isn't watching the person in detail. the reason i call it a behavior modification scheme is that behavior modification, you're watching an individual
12:40 am
continuously and then making constant adjustments in response to how the individual responds to things, to discover the pattern that will alter that individual. that has never been available before in advertising or in any other scheme on such a mass basis. so here we are, you have this notion, that you know and i am focusing in on particular companies, because you do, like facebook can google. you call them behavior modification empires. i do. and that is clearly not a good thing. but let me just you know let me just reflect on what mark zuckerberg says, for example. he says look, the thing we're trying to do at facebook is just help people connect and communicate more efficiently. this is sort of what makes the situation confusing. the direct experience of users and what they do can often be quite legitimate, quite positive, quite authentic. and i'd be the last to dispute that. the problem is that
12:41 am
in the background it's feeding this manipulation machine that's also present. i would advocate is not attempting to destroy the whole thing. instead what i what i'd advocate is getting rid of this background manipulation machine and keeping the good work. to be fair, you know, the book you've written, "ten arguments for deleting your social media accounts right now." i mean that, if everybody reading the book were to take it seriously and act upon it, would be a death knell for companies like facebook. well, facebook has two advantages that make the scenario you're describing extremely unlikely. one is that they've deliberately created an addictive scheme so that large numbers of people are genuinely addicted and will not be able to delete their accounts, and two they have a network effect lock where there's nowhere else to go, because everybody‘s already on their scheme. so therefore when i say this i have really two reasonable hopes. one is that young people who have only known life while they are connected to these things will be motivated to get off
12:42 am
them, at least for a while. for purposes of self—exploration, to get a sense of contrast, what life is like without the manipulation. and then the second thing is if the whole society is universally tied into a manipulative scheme, then it's impossible to have conversations because there's no—one left to give perspective. so if even only a minority of people are off of them then it widens our possibilities, it widens our conversations. it's only seven years since the arab spring in tunisia and then in particular in egypt, with all of the popular street protests that were taking place. they were being described, particularly in egypt, as a facebook revolution. and there was this idea that social, don't just focus on facebook, but social media platforms generally were creating a new sort of discourse which was bottom up rather than top down, which was allowing people to bypass
12:43 am
the normal centres of authority and power and control and create new communities, and therefore actually to empower themselves. are you saying all of that, just seven years on, is now gone? the situation is subtle and i'd like to describe it. what happened with the arab spring was authentic. however the problem is that the algorithms that are gathering data from people and then using that data to drive who sees what in their customized feeds, customized experiences, has to rely on the emotional responses of those people, how they become engaged. now, if i may, there are two general categories of how people respond to things that can be used for behavior modification using social media. they might respond positively to something, which means they start to trust it or have affection for it and so forth, or they might respond negatively, which means they're afraid, they're startled, they're angry.
12:44 am
now the thing is that the emotions that i described in the second batch, the negative ones, come on more quickly. and so the algorithms that are sampling people so quickly tend to amplify the negative ones, and the result of that is that whenever there's a positive movement, like an arab spring, the algorithms gradually start to emphasize those people who are alarmed by it over the people who were part of it. and therefore you start to get a phenomenon like isis, which gets even more mileage from the same social media platforms than the arab spring did, or in the united states. fear is exaggerated. fear and irritation and paranoia, alarmism. and everything you're telling me is actually fascinating and i know it's based on a huge amount of experience and knowledge. but i come back to a simple thought. you made a lot of money out of working with some of these companies. indeed, i believe you sold one of your own startups to google. i'm absolutely an insider, i'm part of the community.
12:45 am
i mean, do you have, now that you see so many potential pitfalls and alarms with the way social media is developed, do you have a sense of guilt or responsibility? well, the responsibility absolutely, thus i am here with you. and guilt, i mean, it happens in my case that i have been warning about this scenario for many years. what is different now is that there's many others in silicon valley who who have also started to recognize the trouble that we've created. i'm not saying i was the only one to foresee it, there were others as well. but it's a much less lonely position. and i think those who should have been aware but weren't or were aware but ignored it perhaps should feel a bit more guilty. but of course i'm part of it, so i share some collective guilt.
12:46 am
just a couple of thoughts on your bleak analysis. you seem to be suggesting that, you know, we talked about that crucial moment when a decision was made to create these services as free to the user but to finance and fund them and make them profit making centres by using advertisements. you say that, in your view, was a mistake but there are some different examples which do tend to suggest that this notion of the public commons really can work, in a way you've told me you don't think it has. what about wikipedia ? what about linux? what about these amazing offers to the general public across the world which are free and which really do work on the basis of a sort of common collective accessible knowledge? i remain a true believer that this can work. i think we still need to work on the concept though. in the case of linux, for instance, the idea was that if you have open source then you'll be able to detect trickery and you won't be fooled by sneaky software. however what's happened is that this linux—based
12:47 am
software is now hidden away. indeed companies like facebook and google often use linux—based stacks of software in their hidden locked away secret giant computer centres, so you can't get access to them. you don't get to see the google algorithm, you don't get to see the facebook algorithm even though they run on linux. and so the linux approach failed to achieve the result that it sought. i think it was a sincere effort. so we just have more work to do to figure this out. but i remain absolutely an idealist and i absolutely believe that this general direction can improve our experience. let me shift focus. you are known as one of the fathers of virtual reality because you were working on virtual reality sets way back in the 1980s. and of course now it's a deeply sophisticated sort of offer to kids who are gaming. oh it's still pretty early and crude. we have a long way to go but it's making progress. you say a long way to go. we've already used this word addiction, and there are increasing of noises coming not only from the british national health service, who just talked about the degree to which they are having to pick up,
12:48 am
as they say, pick up the pieces of kids who are addicted to virtual reality gaming, to all sorts of different social media platforms. and that is really damaging their health. do you accept that there is something going on, particularly with with young people, that is very damaging? yeah, i absolutely accept it. and i think that we have a moral responsibility in the tech community to do everything possible to address it. it's indisputable. so i can only agree. and i want to say about virtual reality, very early on, for me the motivation, you mentioned my difficult childhood and losing my mother, i always saw virtual reality
12:49 am
as a way of potentially overcoming that. i viewed it as potentially a shared dream space that would help reach other people, because i was an awkward kid at that point, and i viewed other people as being these mysterious, distant things. but i also became aware very early, when i was about 15, of this potential for it to be an addictive and manipulative device. you have a child now, how old is...? i have an 11—year—old. yeah. right now, there is a craze going around the world called fortnite. it's a game that kids and older people seem to love but it can be somewhat addictive. some people are playing it for hours every day. if your...your child, a daughter. yeah. if she were to start playing fortnite and started playing it for hours and hours per day, would you be very worried about that? yeah, well, this is such an interesting thing. in the culture of silicon valley it's very typical for parents to have a profound aversion from allowing their kids near technology. they often enroll them in schools that are very hippy, antitechnology places. in other words they're not allowing their own children to use the products that they make a living selling. i've taken an intermediate approach,
12:50 am
where i'm trying to let my daughter learn her own lessons, and find her own way. that might be perilous. i don't think there's any perfect solution to this. i don't think these technologies are all bad at all. you think all of the big companies dominating this space, they should have a statutory duty, obligation, to consider the impacts upon mental health, particularly of children and young people. and should there be some way of putting that concern into a regulatory framework? yeah, so i think this is an area where we have to become more sophisticated as a society, and where the law has to catch up. if you have a continuous feedback system that can manipulate a person without their knowledge, that should no longer be understood as a form of free speech. that should be understood as something more like a drug or something that is intrinsically, perhaps, to the disadvantage of the person. how do you control it? well, i think maybe the people
12:51 am
who operate such schemes have a fiduciary responsibility to those who use them. very much like doctors or lawyers have responsibilities. i mean, we have to discover the right framework. i'm not claiming to have the complete answers. i do know one thing, though. one thing that must be disallowed is a commercial incentive based on manipulating people, because then that encourages the growth of these kinds of schemes. i'm absolutely convinced that silicon valley will make plenty of money without them. i don't think we need them. the future really is going to be dominated by artificial intelligence, machines that can, in a sense, think, or at least take actions which appear to be increasingly autonomous and based upon some sort of thought. how far does that go in your view, and how dangerous is it? well i have a perspective on this that might be a bit unusual but i think it's correct of course, since i hold it. when i was young my most important mentor was marvin minsky,
12:52 am
who is the principal author of the narrative about ai that you describe. i used to argue with him about it when i was very a teenager and they say this is so ridiculous, it's just software we're writing, why do you have to make this whole thing about how it's coming alive? and he would say, oh, gosh don't nitpick, this will be great marketing when we're going forfunding, and it worked. and so it started off as storytelling to make money and that's essentially how it's continued. i want to emphasize that scientifically we don't know how a thought is represented in the brain. we don't know what a thought is. we don't scientifically understand what meaning is. i mean, this isjust completely beyond our reach. so genuine autonomy for machines is a long way away? but here's the here's the key thing. the right way to understand ai, in my view, is as a form of theft. and what i mean by that is that these programs, machine learning programs,
12:53 am
require enormous amounts of data from people and we simply take the data... if you talk to people from google they'll say our realjob is building ai, and we need all your data to do this. but then the trick, the thing that is terribly annoying is that they then turn around and say because we've taken all your data and correlated it and interpolated it and projected it, we're creating this program that will now replace you, you are no longer needed. you're out of work. but the thing is, you are needed because they need your data. so it bothers me terribly that we're talking about potentially putting people out of work when those people are still needed, because their data is needed. when i talked before about a system where maybe you pay for social media, what if you were also paid so you had a chance to achieve knowing dignity by making better and better data ? the other invention over the last 80, 90 years that i'm thinking of is the nuclear bomb. you've talked about the fears you have for the internet. do you ultimately think that we humans, as a species, are more threatened by the bomb or by the malign uses of the internet? there are currently a few existential threats to our species.
12:54 am
uncontrolled climate change is one, weapons of war are another, including biological weapons. but the thing is, to face those clearly, society has to be sane, at least to some degree. and if we make ourselves insane through a scheme of universal manipulation and trickery... make ourselves insane? you see that as the fundamental threat? well, we have to overcome that in order to even talk about the the physical threats of warfare and climate change. and the thing is, in the united states we have our former national security adviserjames clapper saying outright that russian intervention through these internet schemes threw our last election, and if we get to the point where we can't trust our on elections, we've passed the point where we can as a society address our real problems honestly. well, it's a powerful thought to end on. jaron lanier, thank you very much for being on hardtalk. thank you for having me. thank you very much indeed. we turned up the heat
12:55 am
on saturday, 30 celsius, 90 fahrenheit in hampshire. 31 in the midlands. there is going to be more of that sunshine over the weekend. if you are looking for rain you will probably be out of luck. one or two isolated showers but on the whole it will be dry. the first day ofjuly brought some rain to the south—west of the uk from that area of cloud. but those earlier showers and thunderstorms as well pretty much moved away into the english channel to the near continent. probably dry on monday. a little bit of cloud may link in the far south—east of scotland but behind that cooler air. 20s across scotland. widely towards 29, 30 degrees in england and wales and 30 2a south—east wales. sunshine to end the day, overnight we will see a little cloud coming down these coastal areas but it is staying dry and warmest of all across southern parts of england and wales, where for a little while longer it will feel rather humid. more sunshine on the way,
12:56 am
a small chance of picking out a late shower there towards the far south—west, but otherwise it is dry, sunny and hardly a breath of wind around. strong sunshine and best averages beginning to lift a little more for scotland and northern ireland too. high—pressure is in charge of our weather, it is not particularly dominant, it doesn't need to be. nothing much is moving. hardly a breath of wind on wednesday, low cloud coming down through the north sea, but on the whole it is sunny skies and a bit of fairweather cloud is developing. showers towards the south—west and the heat continues to arrive in numbers, 29 or maybe even 30 degrees for england and wales. little bit of a change perhaps, a fly in the ointment as we move into thursday. low pressure to the north of the uk and that whether from there is very weak, bringing a band of cloud towards scotland and northern ireland and squeezing shower out over the grampians, it is likely to be dry and long spells of sunshine, the heat is certainly still there.
12:57 am
temperatures into the high temperatures at the very least. —— high 20s. it looks like it will be a dry first week in london at wimbledon and elsewhere, likely to stay dry with some warm sunshine. welcome to newsday on the bbc. i'm sharanjit leyl, in singapore. the headlines: counting is underway in mexico's elections with polls suggesting the country could elect its first left—wing president in decades. in the world cup, penalty dramas deliver a surprise win for russia and a narrow victory for croatia. i'm babita sharma, in london. also in the programme: the rains stop and divers make progress in the hunt for the boys missing in the cave in thailand.
12:58 am
43 Views
IN COLLECTIONS
BBC News Television Archive Television Archive News Search ServiceUploaded by TV Archive on