tv HAR Dtalk BBC News July 3, 2018 12:30am-1:01am BST
12:30 am
who've been trapped in a flooded cave system in thailand for nine days. the youngest of the group is just eleven years old. rescuers are now trying to work out how best to bring them to safety. they'll need to dive through flood—water to get out of the caves. the most senior catholic priest ever to be convicted of covering up a child abuse scandal is due to be sentenced shortly by an australian court. and a rare glimpse of a new planet has emerged. it's the clearest image so far of a planet being born and it comes from the european southern observatory. it shows a new planet, forming around a dwarf star. no romantic names, though, the star is called pds 70. stay with bbc world news. now on bbc news, hardtalk‘s stephen sackur speaks to computer scientist and author, jarron lanier. welcome to hardtalk.
12:31 am
i'm stephen sackur. the internet is perhaps the defining technological advance of the last 50 years. it's opened up a new world of possibilities. but what if it's also representing an existential threat to humanity? that is the alarming possibility raised by my guest today. jaron lanier is no techphobic sensationalist. he is a silicon valley insider who was a hugely influential pioneer in virtual reality and the consultant to some of the biggest tech giants. so in what ways are we sowing the seeds of our own destruction? jaron lanier, welcome to hardtalk. thank you for having me.
12:32 am
you've spent the last three decades and more in the world of technology and it seems during that time you have made an emotionaljourney from optimism much more toward pessimism. and i'm wondering why. i have to disagree with you. i find that if i look at human history, things generally in the big picture have gotten better for humanity, and i have no reason to believe that that pattern will go away. i think things can get better and i'm an optimist, however i believe that every time things have gotten better it's because a critic said, "wow, things could be better." so to me being a critic is the mechanism by which one expresses optimism. the enemy of the future
12:33 am
is complacency, not criticism. so i absolutely reject the level of pessimist. 0k. well, fair enough. but it does seem to me you're more than just expressing creative, constructive, criticism. you're also expressing fear. yeah and it's warranted, that is warranted. we have done something to ourselves that mankind has never done before, which is we've created a universal system of surveillance and behaviour modification of most of our species through devices, through social media and so forth. now i want to emphasize the problem is not the devices. the problem is not the experience of using social media, per se. i think that can often be extremely positive. the problem is this behind the scenes effort to manipulate everyone. and i think that that indeed is creating a deleterious result for democracy, for interpersonal relationships, for personal psychological health.
12:34 am
it's a very gradual problem but it is very real. i do want to spend time on that notion of manipulation and ask you who's doing the manipulating and to what end. but before we get there, i think it's important to just get to grips with these rather extraordinary story that you bring to this hardtalk table. i mean, your childhood was very difficult and tragic. i mean, you lost your mother in a car crash when i believe you were just ten years old, and your father was badly injured too, and then he took you off to new mexico. and it seems you were sort of living almost off grid for a long time. i have to say compared to many stories in the world, i don't think my childhood was as bad. i had a very unusual mother for her generation in that she was the breadwinner for the family and my father was not. so when she died, we found ourselves
12:35 am
impoverished and we became homeless. and what my father did is, he got the cheapest land available, which was desert land in southern new mexico. and we lived there in tents and gradually built a home for ourselves and he became certified as an elementary school teacher. and over the course of seven years, we built this fantastical house that was made of strange geometric forms and domes and all kinds of things. i think the experience that my father gave me of using creativity as a way to rebel against tragedy has been central and effective. i think creativity is a proper and good response if it's possible. so yes, of course, of course, it's what made me and i am eternally grateful. you're a tiny bit younger but not that much younger than the generation the first generation of tech superstars, steve jobs, bill gates. you're a little bit younger but you, like them,
12:36 am
gravitated to working in california. and i just wonder whether you, like them, were both somewhat idealistic about what technology can do, but were you also driven to create a business, to become a superstar entrepreneur, like they clearly were? not at first. actually, when i first showed up in silicon valley, i had never experienced wealth and i made some video games on the side, right in the dawn of video games in the 8—bit era and made money, and i was actually initially uncomfortable and embarrassed by it. and indeed, when my friends and i started the first virtual reality startup, which was in the early 1980s, we were quite embarrassed by it and uncomfortable with the notion of money in business, and we're trying to make it into some sort of a collective or something. gradually though, there's a funny thing when you're surrounded by a value system in a society, you do start to take it on. and i felt this thing stirring in me, like i should
12:37 am
be an entrepreneur. it's funny how that happens. the social environment is extraordinarily powerful. it's not that i currently think there's anything wrong with entrepreneurship. actually i've come to really love the business side of silicon valley, but it wasn't what brought me there. i'm probing this area of your life and the degree to which you wanted to make money and be an individual success, because coming back to your opening remarks about where the internet and social media are taking us, you seem to have a fundamental problem with with a big decision that was taken quite early on in the development of, for example, facebook or even google, which was to say they got this amazing idea, this new technology, and the owners of the idea decided we'll make it free to the great general public, but we'll monetize it by generating ad revenue. and of course this particularly
12:38 am
applies to a company like facebook. and you seem to be saying that looking back on that decision, it was a fundamental mistake. right. well, you know, the tension that we just talked about between loving entrepreneurship and then also feeling a little uncomfortable with the sort of greed inherent in silicon valley was exactly what caused this all to happen. back around the time that companies like google and facebook were being created, there was a prevailing feeling that everything online should be free, it should be free of capitalism. the notion of the public commons and of opening everything up, a knowledge base for humanity. exactly. so computer code would be made open, music would be free. journalism would be free. everything would be open, but at the same time we loved the hero idea, the cowboy idea of the great hacker or the great entrepreneur, like a stevejobs. and if you try to combine those two things, it's rather
12:39 am
difficult, you know. and so the solution, and really i think the only solution, was what was called the advertising model. but even though it started off innocent enough, computers kept on evolving, the software got better, the customers got more sophisticated, and that's how we inadvertently, i believe, brought about this surveillance scheme and this manipulation scheme. almost every penny made by a company like facebook is earned from customers who believe that the behavior of users of facebook will be modified by the use of facebook. and you do create this society where anytime people connect through the internet, it is financed exclusively by those who wish to manipulate the users. why is that different from tv advertising? because tv advertising isn't watching the person in detail. the reason i call it a behavior modification scheme is that behavior modification, you're watching an individual continuously and then
12:40 am
making constant adjustments in response to how the individual responds to things, to discover the pattern that will alter that individual. that has never been available before in advertising or in any other scheme on such a mass basis. so here we are, you have this notion, that you know and i am focusing in on particular companies, because you do, like facebook and google. you call them behavior modification empires. i do. and that is clearly not a good thing. but let me just you know let me just reflect on what mark zuckerberg says, for example. he says look, the thing we're trying to do at facebook is just help people connect and communicate more efficiently. this is sort of what makes the situation confusing. the direct experience of users and what they do can often be quite legitimate, quite positive, quite authentic. and i'd be the last to dispute that. the problem is that in the background it's feeding this manipulation machine
12:41 am
that's also present. i would advocate is not attempting to destroy the whole thing. instead what i what i'd advocate is getting rid of this background manipulation machine and keeping the good work. to be fair, you know, the book you've written, "ten arguments for deleting your social media accounts right now." i mean that, if everybody reading the book were to take it seriously and act upon it, would be a death knell for companies like facebook. well, facebook has two advantages that make the scenario you're describing extremely unlikely. one is that they've deliberately created an addictive scheme so that large numbers of people are genuinely addicted and will not be able to delete their accounts, and two they have a network effect lock where there's nowhere else to go, because everybody‘s already on their scheme. so therefore when i say this i have really two reasonable hopes. one is that young people who have only known life while they are connected to these things will be motivated to get off
12:42 am
them, at least for a while. for purposes of self—exploration, to get a sense of contrast, what life is like without the manipulation. and then the second thing is if the whole society is universally tied into a manipulative scheme, then it's impossible to have conversations because there's no—one left to give perspective. so if even only a minority of people are off of them then it widens our possibilities, it widens our conversations. it's only seven years since the arab spring in tunisia and then in particular in egypt, with all of the popular street protests that were taking place. they were being described, particularly in egypt, as a facebook revolution. and there was this idea that social, don't just focus on facebook, but social media platforms generally were creating a new sort of discourse which was bottom up rather than top down, which was allowing people to bypass the normal centres of authority and power and control
12:43 am
and create new communities, and therefore actually to empower themselves. are you saying all of that, just seven years on, is now gone? the situation is subtle and i'd like to describe it. what happened with the arab spring was authentic. however the problem is that the algorithms that are gathering data from people and then using that data to drive who sees what in their customized feeds, customized experiences, has to rely on the emotional responses of those people, how they become engaged. now, if i may, there are two general categories of how people respond to things that can be used for behavior modification using social media. they might respond positively to something, which means they start to trust it or have affection for it and so forth, or they might respond negatively, which means they're afraid, they're startled, they're angry. now the thing is that the emotions
12:44 am
that i described in the second batch, the negative ones, come on more quickly. and so the algorithms that are sampling people so quickly tend to amplify the negative ones, and the result of that is that whenever there's a positive movement, like an arab spring, the algorithms gradually start to emphasize those people who are alarmed by it over the people who were part of it. and therefore you start to get a phenomenon like isis, which gets even more mileage from the same social media platforms than the arab spring did, or in the united states. fear is exaggerated. fear and irritation and paranoia, alarmism. and everything you're telling me is actually fascinating and i know it's based on a huge amount of experience and knowledge. but i come back to a simple thought. you made a lot of money out of working with some of these companies. indeed, i believe you sold one of your own startups to google. i'm absolutely an insider, i'm part of the community. i mean, do you have,
12:45 am
now that you see so many potential pitfalls and alarms with the way social media is developed, do you have a sense of guilt or responsibility? well, the responsibility absolutely, thus i am here with you. and guilt, i mean, it happens in my case that i have been warning about this scenario for many years. what is different now is that there's many others in silicon valley who who have also started to recognize the trouble that we've created. i'm not saying i was the only one to foresee it, there were others as well. but it's a much less lonely position. and i think those who should have been aware but weren't or were aware but ignored it perhaps should feel a bit more guilty. but of course i'm part of it, so i share some collective guilt. just a couple of thoughts on your bleak analysis. you seem to be suggesting that, you know, we talked about that crucial moment when a decision was made to create these services as free to the user but to finance and fund them and make them profit
12:46 am
making centres by using advertisements. you say that, in your view, was a mistake but there are some different examples which do tend to suggest that this notion of the public commons really can work, in a way you've told me you don't think it has. what about wikipedia ? what about linux? what about these amazing offers to the general public across the world which are free and which really do work on the basis of a sort of common collective accessible knowledge? i remain a true believer that this can work. i think we still need to work on the concept though. in the case of linux, for instance, the idea was that if you have open source then you'll be able to detect trickery and you won't be fooled by sneaky software. however what's happened is that this linux—based software is now hidden away. indeed companies like facebook and google often use linux—based stacks of software in their hidden locked away secret giant computer centres, so you can't
12:47 am
get access to them. you don't get to see the google algorithm, you don't get to see the facebook algorithm even though they run on linux. and so the linux approach failed to achieve the result that it sought. i think it was a sincere effort. so we just have more work to do to figure this out. but i remain absolutely an idealist and i absolutely believe that this general direction can improve our experience. let me shift focus. you are known as one of the fathers of virtual reality because you were working on virtual reality sets way back in the 1980s. and of course now it's a deeply sophisticated sort of offer to kids who are gaming. oh it's still pretty early and crude. we have a long way to go but it's making progress. you say a long way to go. we've already used this word addiction, and there are increasing of noises coming not only from the british national health service,
12:48 am
who just talked about the degree to which they are having to pick up, as they say, pick up the pieces of kids who are addicted to virtual reality gaming, to all sorts of different social media platforms. and that is really damaging their health. do you accept that there is something going on, particularly with with young people, that is very damaging? yeah, i absolutely accept it. and i think that we have a moral responsibility in the tech community to do everything possible to address it. it's indisputable. so i can only agree. and i want to say about virtual reality, very early on, for me the motivation, you mentioned my difficult childhood and losing my mother, i always saw virtual reality as a way of potentially overcoming that. i viewed it as potentially a shared dream space that would help reach other people, because i was an awkward kid at that point, and i viewed other people as being these mysterious, distant things. but i also became aware very early,
12:49 am
when i was about 15, of this potential for it to be an addictive and manipulative device. you have a child now, how old is...? i have an 11—year—old. yeah. right now, there is a craze going around the world called fortnite. it's a game that kids and older people seem to love but it can be somewhat addictive. some people are playing it for hours every day. if your...your child, a daughter. yeah. if she were to start playing fortnite and started playing it for hours and hours per day, would you be very worried about that? yeah, well, this is such an interesting thing. in the culture of silicon valley it's very typical for parents to have a profound aversion from allowing their kids near technology. they often enroll them in schools that are very hippy, antitechnology places. in other words they're not allowing their own children to use the products that they make a living selling. i've taken an intermediate approach,
12:50 am
where i'm trying to let my daughter learn her own lessons, and find her own way. that might be perilous. i don't think there's any perfect solution to this. i don't think these technologies are all bad at all. you think all of the big companies dominating this space, they should have a statutory duty, obligation, to consider the impacts upon mental health, particularly of children and young people. and should there be some way of putting that concern into a regulatory framework? yeah, so i think this is an area where we have to become more sophisticated as a society, and where the law has to catch up. if you have a continuous feedback system that can manipulate a person without their knowledge, that should no longer be understood as a form of free speech. that should be understood as something more like a drug or something that is intrinsically, perhaps, to the disadvantage of the person. how do you control it? well, i think maybe the people who operate such schemes have a fiduciary responsibility
12:51 am
to those who use them. very much like doctors or lawyers have responsibilities. i mean, we have to discover the right framework. i'm not claiming to have the complete answers. i do know one thing, though. one thing that must be disallowed is a commercial incentive based on manipulating people, because then that encourages the growth of these kinds of schemes. i'm absolutely convinced that silicon valley will make plenty of money without them. i don't think we need them. the future really is going to be dominated by artificial intelligence, machines that can, in a sense, think, or at least take actions which appear to be increasingly autonomous and based upon some sort of thought. how far does that go in your view, and how dangerous is it? well i have a perspective on this that might be a bit unusual but i think it's correct of course, since i hold it. when i was young my most important mentor was marvin minsky, who is the principal author
12:52 am
of the narrative about al that you describe. i used to argue with him about it when i was very a teenager and they say this is so ridiculous, it's just software we're writing, why do you have to make this whole thing about how it's coming alive? and he would say, oh, gosh don't nitpick, this will be great marketing when we're going forfunding, and it worked. and so it started off as storytelling to make money and that's essentially how it's continued. i want to emphasize that scientifically we don't know how a thought is represented in the brain. we don't know what a thought is. we don't scientifically understand what meaning is. i mean, this isjust completely beyond our reach. so genuine autonomy for machines is a long way away? but here's the here's the key thing. the right way to understand ai, in my view, is as a form of theft. and what i mean by that is that these programs, machine learning programs, require enormous amounts of data from people and we simply take the data... if you talk to people from google they'll say our realjob is building ai, and we need all your data to do this. but then the trick, the thing
12:53 am
that is terribly annoying is that they then turn around and say because we've taken all your data and correlated it and interpolated it and projected it, we're creating this program that will now replace you, you are no longer needed. you're out of work. but the thing is, you are needed because they need your data. so it bothers me terribly that we're talking about potentially putting people out of work when those people are still needed, because their data is needed. when i talked before about a system where maybe you pay for social media, what if you were also paid so you had a chance to achieve knowing dignity by making better and better data ? the other invention over the last 80, 90 years that i'm thinking of is the nuclear bomb. you've talked about the fears you have for the internet. do you ultimately think that we humans, as a species, are more threatened by the bomb or by the malign uses of the internet? there are currently a few existential threats to our species. uncontrolled climate change is one, weapons of war are another, including biological weapons. but the thing is, to face those
12:54 am
clearly, society has to be sane, at least to some degree. and if we make ourselves insane through a scheme of universal manipulation and trickery... make ourselves insane? you see that as the fundamental threat? well, we have to overcome that in order to even talk about the the physical threats of warfare and climate change. and the thing is, in the united states we have our former national security adviserjames clapper saying outright that russian intervention through these internet schemes threw our last election, and if we get to the point where we can't trust our on elections, we've passed the point where we can as a society address our real problems honestly. well it's a powerful thought to end on. jaron lanier, thank you very much for being on hardtalk. thank you for having me. thank you very much indeed. good morning.
12:55 am
the summer of 2018 is shaping up to be quite memorable. june may be a distant memory, it looks as though the statistics will make it go down in history. this was glasgow last week, june 28 in motherwell, where we saw a high of 33 degrees. we thought that was the hottest june day on record, but it was the hottest day ever recorded in scotland. quite incredible. it looks as though there is little in the way of significant rain in the forecast not only throughout this week but perhaps into next as well. high pressure stays with us, subtle differences. more of an easterly breeze will bring changes and it does mean
12:56 am
that first thing in the morning there will be a bit more cloud along the north sea coast and it will be a little bit fresher as we go through the day. further west, with a little more shelter we got that warmth and those temperatures yet again are set to respond. highest values of around 27 degrees, a little bit cooler along the east coast. perhaps a little more pleasant for many. as we move out of tuesday into wednesday, the high—pressure releases its grip. there is still unlikely to be any significant rain in the forecast. perhaps a little more in the way of cloud around and the threat of a few sharper showers across southern england. very hit and miss but i am sure there will be welcome news for gardeners and growers out there. as a result of that cloud, temperatures are degree or so down. looking at a high of 26—27 degrees. still a dry story into thursday
12:57 am
for most of us, but a weather front, something we haven't seen for some time, introducing more in the way of cloud across the northern isles into the west and the northern highlands but no significant rain in the forecast. maybe a few isolated showers and the risk of a few showers just threatening across the far south. the highest values still of 17—28 degrees. the wind direction looking likely to change again as we move towards the weekend and that will allow those temperatures to climb, with more of a southerly 29 or 30 degrees not out of the question again somewhere in the south. the high pressure establishes itself as we move out of the working week into next weekend. that means that things stay dry, settled and relatively sunny. if you haven't already got the message, it looks likely that the rest of the week will stay quite sunny, very warm for many with little in the way of significant rain. take care. i'm sharanjit leyl, in singapore. the headlines:
12:58 am
how many of you? 13. 13? brilliant. the moment 12 young boys and their football coach are found alive after being trapped in a vast cave system in thailand for nine days. their families are overjoyed but the boys‘ ordeal is not over yet. they're tired and hungry and rescuers still need to work out how to get them out. it will be a prolonged operation but, right now, this entire country is relishing a happy ending that had become harder and harder to believe in. the most senior catholic priest ever to be convicted of covering up a child abuse scandal is due to be sentenced shortly
78 Views
IN COLLECTIONS
BBC News Television Archive Television Archive News Search ServiceUploaded by TV Archive on