Skip to main content

tv   Smart New World  Deutsche Welle  March 16, 2024 11:30am-12:59pm CET

11:30 am
to dive into the hands of gentlemen who to us with you one day. have you ever wonder we've got a response to an expected size of the up to many, many years later maybe we we recognized that the moment of an every thing change in size use you guys going to need to be in. everything we assume is we have to 1st of all understand that this is going to happen. the many technologists try to solve human problems using technology when actually what we need are human solutions. ok, just to look at it. the question is,
11:31 am
what does it mean to be human? what are the things always to be proud to offer shows? because it said, i find this moment extremely profound because it gets really forced us to think to exactly what pushes. this is what makes humans human scale to reach to see if there's a whole lot at stake here. careers, unbelievable amounts of money and who gets to shape the future calls the and it's already become a global race for supremacy in the age of artificial intelligence. china,
11:32 am
the united states and the european union of buying for economic price, political influence and power. so other be tech companies and style shops, a horse on the hills. those who lose go be no 2nd chances. jonas andrew is founded one of the most influential european companies with his health. the european union could catch up with the world i lead. it's become independent from the us and china, secure press, press future, reduce it side. this is a watershed moment or your allies for over the last it roll of the dice. you. europe wants to decide how to use technology in accordance with european values content. it has to be able to build that technology itself. it's of thomas was because founded housing space. it's a major open source platform. he wants to store one of the most powerful technologies in human history from ending up in the hands of
11:33 am
a few corporations. for point i guess what we need is a multitude of players. the not just one of the times i, i, we don't want a future with such a fundamental technology because in the hands of a single company, there are plenty of food as foundational to the future. of economic and military power, how much i'm good enough to not to produce. we've created an economic and financial system that's based on the assumption that everything's going to keep running smoothly as possible. we get gas from russia, we americans look after us, so we don't need to spend money on our. most of the china is always friendly from google and we've gotten comfortable just kind of and now we have to break out of that comfort and safeguard. and we can go on the political offensive again to keep them up. we can compete, we can create competitive conditions here. and you know, we can make sure that the cool companies we have and also grew and play a role in the global market. and i'm interested that's already be made clear, and it's like the
11:34 am
at the end of 2023 gym and vice chancellor role. the topic made significant progress towards these g, a political goals, alpha alpha, a, gym, and i, i company raised around half a 1000000000 euros from invest it's it was one of the largest around severe pain financing, official intelligence technology. and it was a signal that the european union can produce elite players in the field of a lot of offers founder and ceo is eunice andrew let's he's given priority to investment from jim and industry as a p boss and the shots, quick return supermarket, retail is legal and coughlin, a traveler
11:35 am
telephone go. i was an amateur radio enthusiast with the i started radios together and built my own antennas. we early on and my father had computers at home. so i was able to start programming and playing around with them at a very young age. that's biggest audits in the cops today. when we started out on the term jenner today i didn't exist. hardly anyone had heard of open a i was we were very technical. if you knew we managed to create a category to finding innovations. so we were just nerds, researchers on drums, the deluxe one voice. and there were times when i felt like i wasn't coping with the amount of work and the challenges every night. i couldn't answer emails until i was so tired, i fell off the couch hard for that coach. and there were still things i was neglecting, which i didn't want to neglect just before. the other thing that in spring
11:36 am
2023, the european landscape was a lonely place. with the star shop of alpha, eunice intruders had to be only general cheese allied to, to compete. it's an international level, he'd acquired the expertise from his work as a high ranking research at apple. and suddenly he'd become one of the units great hopes in the global i race of to invest. i'm from east in the law right now. we simply can't cope with the onslaught of potential customers and partners. most of the german stock index companies have been in touch with lots of medium size companies, just committed their a briefings press engagements, events on an unbelievable amount of stuff, and that to me, it's like the cambrian explosion right now. the effects was an incredible amount of new and creative things are emergency visit. we're the only europeans to be involved on this scale or the buyers. the assumption that it was an exciting
11:37 am
develop the we also had things like open yeah. and maybe hours where even cooler looking, what is missing and what i think deserves more attention to you is, is why there are not more domestic companies that actually grow and scale. a lot of company leaders start of innovators end up going to the us and the access to capital is really one of the main challenges in see dozens of, of us via most. this is called long, tasty. but if you look at what we did, i think it's enabling technology almost because what i need for that is a carefully selected effective team of really and researchers most cool. then i need money, a, b, i could add some more money than you normally get as a german started up, make love all of these days. we're talking about billions and them complement and then you need partners to help you to do the kind of help that money can't buy me. i've opened a uh, it doesn't just get 10000000000 for microsoft them. it also gets incredible support
11:38 am
in integrating its technology into all microsoft products and platforms online support. at the time i left off, i had 60 employees at various locations, most for the company's headquarters in heidelberg in southwest gemini. on like open i drew this wasn't doing, he say i towards private uses the draw the industry and the public sector. but they tend to be sluggish. and not easy to. we know that post a challenge for you on a central unless he needed pilot projects to prove his technology works. there must be a huge stand here and you're greeted by a virtual person has on this call on may i help you? where do you want to go? then i can use the screen. we have to keep moving in this direction. that's not good, that's my job. i is this time. i know it is what it is. now i have 4 to 4. very happy to still have you. if you get this, you'll probably be taking her well, earned retirement soon. it's become a standard questions if i,
11:39 am
if i ask if you'd like to stay on little longer, i'm not fired because i need you because there aren't enough skilled workers coming in not to come as a, it's a big issue. as this phone space changed to important for us, so it's out as we done on the solidarity does the tradition. of course the main topic is innovation innovation. how to back is one of the 1st municipalities in the world to introduce an, a us citizen assistant using a language model provided by alice alpha and pock know, and quincy with whom do combines we have a partner, a customer with whom we can look at these new technologies, they also act as a testimonial for us, you agree because anyone can go and try it out with us. that's a huge advantage to that one's on because a lot of our customers don't want to be named right now. what time they don't want people to know exactly what they're doing. so it's great to have a pilot customer with a bit of vision encourage he's in the audience. the hope is that in the long term,
11:40 am
i will improve public administration and speed up services deep. i'm 45, i'm card sets, i just entered the question motor vehicle traffic on the be 37 divide which is a busy road and then i get it to search. or of course, that's a very general question. the see the question now is what a point in time is 75. that's what we're talking today, or annually milan so that it's of course the i has to work out what the user actually wants, basically won't be 30 seconds close between 7 am and 6 pm. sure. do you have now i can ask, how do i apply for trial depending if it's not good? it does why it's on. it just wasn't the right time, sir. you can't find anything. now i'm at them. so the error messages that we get back from the public, i'm from tests we do ourselves get passed on to alpha alpha to figure out what needs to change to make the inputs more accurate. 60, it's always about the accuracy of the inputted. i emailed it so you can always cut down about the technology is still in the test face and not yet liable.
11:41 am
2023 was a delicate time for alpha alpha, eunice and drew this needed fresh money from invest. it's. meanwhile, microsoft and open i, we're getting more of an advantage. in fact, the race starts today and we're going to move, we're going to move fast. and for us, every day, we want to bring out new things. on march 14th, 2023. can i release chat g p t for the most powerful artificial intelligence? today's just at the same time, greatly reduced costs for use it for you in a central us. and his team was a threat to the business model. provide the problem about fly fishing from the district office on the floor. okay. and it goes on file is huge, awhile in the depths west of those we from say in this cool, clear water is,
11:42 am
well i stay, i am the fish for these, the silver 3. why lights a dream or so it seems a whiny being sleek and sly. with ancient instincts to live and die. yeah. goes on it. well, yeah. they see the love i had i went to an apartment with a number of colleagues and we watched on a, on a big project to screen the night spent of 64. someone had a chat to be part of a time so they could use to before we could play with it. and we were like, very impressed and surprised by how good it was. it's not upsetting when someone comes up with a great piece of technology because with researches and building technology and that's how it is. you know, when you a violinist and you go and you watch the amazing saturday by an incredible violent, if you don't feel, you know, i should. it's all get off. you know,
11:43 am
it's inspiring. i was a little stressed out. yeah. i was in the middle of conversations, but potential investors business partners and i knew that and every conversation i was, i was going into, somebody would say it, but they would have wanted to build t v t for mice 2 years ago. got $200000000.00 be the 1st model at that level of capabilities out of heidelberg, out of, out of europe. it costs a lot of frustration of the team. and i saw that that's painful to see the insights comparing open. i was left also was absurd. open i was almost huff owned by chick john, microsoft, which had pumped over $10000000000.00 into the company. you're in a central us head, raise just 28000000 euros. still, he wanted to take them on the stain on the enrollment at oak besides the were all
11:44 am
under enormous pressure. we're fighting for survival. how we've created something, world class with a lot less money, the shopping because we're basically at the forefront on the highest level classes on this now. but we all know that there's now a wave of microsoft and money rolling towards us, and we can't do anything to stop it. even eastern cable. i can come in the way you can just stick and fetch i might find it difficult to make really french without the english words everywhere. yeah. because yeah, well you understand truly this was feeling the heat from industry, top dogs, microsoft and open. i, thomas, who was more relaxed, he co founded hacking face,
11:45 am
which has 200 employees and offices in paris, new york. and to them, the company is built a successful platform with programs and companies can share i models and further develop to defeat. it was a fee, the mission and the values that we push activity very european by some way of being careful about the data. i try to build something responsible, you know, and not just go fast and break it a centrally bit today on like how long they all never. stephanie and the american values and chunk g p take us out of course, and we wondered whether we could set up a project to analyze and document that. the benchmark, for example, is concerned with benchmarks that could show whether a model has. i'm the american, french or german by the and was concerned with the full say what am i able to say, presenting itself with that? it would be interesting to do a comparative study between chat g, p t and bloomed chat wouldn't have to present this if you ask
11:46 am
a question in different languages. how different are the answers depending on the kind of question. so could you do is the approach more american or european so that would be an interesting study success as content i saw the assignment, you don't see, it looks good on these nevada so difficult when i talk about liberalism of values. i mean that every population in the world has its own value system. one that i see that we have a lot of different nationalities here. and we have to ask ourselves, but what are our values, phone to what's important to us, the ultimate text box and you up from like your startups. germany less of size already. i would say it'd be player in you case diabetes, or just the very visible player here in your, in friends. and this is trial is new player if and also in the,
11:47 am
in the almost every open country is us. yet this one all to like, stand up with this. uh, yes, i'm vision to become until to build something big smith as idealistic as thomas and his team from hugging face appear. there is also criticism open sol, so not the end result is that a small release of tech professionals is determining what else future looks like and what risks we're exposed to. 20 business bunkers, welcome to use it. before fall, the business people i need to say we need educational society has to educate itself . we only create the system from could or you could design those systems in different ways. for example, you can make it so that a person can understand what's going on. so at least a little because this could be one of the obligations we impose on the industry that we'd love to do, do do a show cooper, then it was obviously, as i said, this of the machine could you, i lock you into each of these machines and approach to how to control knowledge in
11:48 am
the i'm a created by mathematicians who don't know anything about culture. i mean, what's a bit of an exaggeration? of course that isn't what we have to find ways of explaining this to people who aren't interested in the math. phase one up, they just use the machines as tools, you need 6. they need to understand where the limits on quickly can with the situations on machine will want to walk through mascot team of just like with t p. s devices. yes. before we recognize when they give us the wrong route shipments, you'd be hesitant to sweep up a this isn't a great, that's a huge percentage deal is opening up some service. you know, the, there's also a huge call opening on who's actually responsible me. i don't want you because as a developer or researcher, you have a certain responsibility. it's not about restricting research conflict, but when the applications that are harmful to society, we have to be aware of bathrooms. so in the 1st ship it yeah, and put that there was a huge potential for manipulation. just to think of the influence of track g p t on
11:49 am
election is probably not. i think there needs to be an answer though, and it's just more education. it's almost as a good topic for the upcoming elections. what education do we need to stop us being manipulated to the same type goal is costume because best 2 companies will come on . that's a big question. what happens when people start asking i who they should vote for? because the i only will give them an answer as to with task and the goals. who decides how would jones's? yeah, who should decide that the box right? unfortunately, i have no answer to that as we by the people's processor. generalship is developing a breathtaking speech and take joints. baffling is out in the ring. that's spearing development even more. is a massive new market up for grabs. leading i expect it's more, it's a big tig, and it's egan is to compete,
11:50 am
is creation technologies beyond the control. i think we've made a mistake when my sweetest country man, uh carl funnel in a us brand that our species is homeless. sapient seconds means of thinking, homo, the, the smart one i, we're not going to be the smartest anymore. maybe we should rerun ourselves to homeless sentence. the feeling human. we can feel curiosity, meaning purpose, love. that is what really makes us unique. the wasn't ask, how can we keep the control over the machines so that we can using the tools to build the world or wherever we can really have human flourishing with positive experiences in 2014, when i found that the future life has that it was quite tebow, they even talk about
11:51 am
a safety at all because that would imply that it wasn't covered because it's and a lot of researchers thought that would be bad for funding. and the only weird people worried about this it was very much like coming out of the closet moments to be able to sign this letter and say, oh you too are words, technician slow down a little bit. oh, i didn't know that. and then it suddenly became become socially acceptable. max take mark and his future of life instituted, published an open letter warning, the artificial intelligence post and x a central change it to humanity. civilization itself could be under threats. the letter was signed by hundreds of ivory searches and take industry latest, including tests the boss and x owner, e loan mosque, apple co founder,
11:52 am
steve wozniak and touring award winner. your should have been g o m. it's been quite shocking that once we put this letter out and i'm kind of a who is who of a i research assigned that. and the conversations really exploded might cause significant. we've field the technology industry cost significant harm to the world. i think that having a lot different ways, it's why we started at the company. i think if this technology goes wrong, it can go quite wrong. and we want to be vocal about that. we want to work with the government. i think he was serious about that a i think that's a kind of so he wasn't able to think central risks and i also believe there are
11:53 am
potential risks there also a whole spectrum of other risks and i know some, i talk to him a couple of times about this, you know, she very much recognizes them as well. on the one hand, of course, of these warnings about the major power of this new technology also amplify the significance of the products that these people are building. so it could also have an in direct marketing effect, right? like look at the incredible things that we're building. but also let's make sure that nothing goes wrong. and for that they look to the politicians. the net effect of us could be that if heaven forbid something goes wrong, they could say, well, we warn you, but the politicians did not act or they did not act in time. so i'm looking at a paper here in title large language models trained on media diets can predict public opinion. this is just posted about a month ago that this work was done at mit and then also at google. the conclusion is that large language models can indeed predict public opinion. i'm,
11:54 am
i wanna think about this in the context of elections. should we be concerned about models that can learn the language models that can predict a survey opinion and then can help organizations into these find 2 strategies to elicit behaviors from voters? should we be worried about this for our elections? yeah, i think senator holly for the question is, it's one of my areas of greatest concern that the more general ability of these models to manipulate, to persuade, and to provide sort of one on one, you know, interactive, this information. i'm nervous about it. i think people are able to adapt to quite quickly when photoshop came onto the scene a long time ago. you know, for awhile people were really quite fooled by photoshop images and then pretty quickly developed an understanding that images might be photoshop. this will be like that, but on steroids and the, the interactivity on the ability to really model predict humans. well, as he talked about, i think is going to require
11:55 am
a combination of company is doing the right thing, regulation and public education. the 2024 is the crucial election year, not only in the united states, but worldwide. there will be european parliament's elections. there will be elections in india. i mean, it's a large amount of people in the world will actually go to the polls. and while we're living in this big experiment where it's very hard for independence, researchers, journalist, civil society organizations to pro these models that we may only find out, you know, what the, what the harms and, and malign uses as a weapon against democracy were when it is too late, a spirit. shortly off to some old men at p before the us senate, he co signed the statement along with
11:56 am
a number of high ranking executives from google, microsoft and other tech companies. the fact that it was the companies who themselves were asking for this type of regulation to live with the leading researchers who were asking for the government to get involved. that really was the turning point in the conversation to understand the effect, the generosity of a i was having behind the scenes of global politics at the time you have to travel to a small swedish. so she called lou la, around a $150.00 columbus at south of the arctic circle. when people say that artificial intelligence is going to be like the next industrial revolution. i think they're under estimating its impact. it's not just going to be
11:57 am
a new technology like the steam engine. it's like building a new species, especially if it's much smaller than us. president vipers himself was having meetings on artificial intelligence, in some cases, as often as 3 times per week. and i will tell you that not very many things get on the president's calendar for 3 times a week. may says, he says to train 2223, the sirens, and most of kate's defending on the swedish coastal c. c gave a sense of how much was at stake. lead is came here to discuss nothing less than the house humanity should react to the arrival of this new obese artificial full of intelligence. what role she politicians play? democracy needs to show that we are as fast as technology you. so the 1st and that's a on an ascii flagpole. so 6 months, you, so yesterday, a number of very,
11:58 am
very insightful people signing up to say you need to do something for the very extra central risks. and then you have them non existent, your risk as well. why it's important for the european union to have a common policy with the us concerning a i, and should in other parts of the globe be included in the conversation. your vision important, but this is bigger than your us as important. but it is because i'm the us, but it's the 2 of us take the leads with close friends. i think we can push something that will make us hold much more comfortable with the fact that in order to have a i is now in the world. and is developing an amazing speech that you understand? julius was also invited to the top level meeting in sweden to represent the views
11:59 am
of you, repeating i stuff ups and cold for food, competition, veterans and the name of the above. you know, of course, there are other a companies in europe in the nation, but we're the one that's keeping pace the most with the global leaders. i was just, i assume that's the reason why we're here. not because we're so charming. and so someone's that just trying to change coming in. so i mean this for you, how do you feel about that? we can raise more compet. so yeah, i think we have to 2 weeks ago, i always adds that 5 conference as a piece. that fi conference and kristen klein when he's opening keynote, he kind of said our key partners. fortunately, the i are all of all thought google and microsoft, you know, and then i'll pass events coming up with with it's be with antonio neary. what are you thinking about that?
12:00 pm
i'll call in some of your other i'm here from central fixed rate and latest. let's say 2 minutes. it's seconds. the. oh these are the, the statements on like safety or? yeah the like you yesterday and so on. it's long term, it is possible to conceive and catastrophic events i've had and dresses and bird, and they basically are, are scared me. we will start with us on the list for the founder and ceo of alex alpha. the for is yours and thank you very much for being with us today. all right, thanks for having me. i think we're all like a little bit dizzy. the speed of change like everybody i know that is in the eyes kind of stressed out. and with this technology, we're only even just stretching the surface. i fear that knowledge work is an important part of what is happening in europe. so this is a,
12:01 pm
an opportunity for us to, to build you empires to build new value. but it's also a risk that we're losing a substantial pillar that we're standing on. thinking about how we can, how we can make this a fair playing field. because i think it's in everybody's interest that europe will contribute to a safer future in a i, to me, while the us in a, you were trying to come up with a common strategy on the other side of the world in china. an artificial intelligence ecosystem was emerging with its own set of rules. a high is a key part of china is if it's to become a global power. i always remember my mom and my dad push me in for this all in big school the older to get to specialize in mathematics and also english school as
12:02 pm
like a extra work. it's size, it's a regular schoolwork. so basically you have to take the lessons on saturday, we tend, it makes me a quick learner and then my mom is correct, right? so in order to keep the programs the older, don't keep pushing yourself. you'll have to keep learning. and i always, i always tell my employees also to keep learning, to keep up this fast paced my father was a for pfizer in coming to science. so i, i'm very lucky to get in touch with a guy in the very early days back in 2009 i was trying to use a model is very simple. yeah. models nowadays, if you look from today's large language model perspective, that model is like a very simple, simple, like a small end. i had show has worked in both the east and west. he sell positions that the chinese tech joined 10 cent
12:03 pm
and gym and online retailer salanda. 3 years ago he found that his own company, gina is an i. i stuff help with offices, insurance and, and beijing. but its headquarters are in berlin. oh, well yeah, another another here. why? yes, for the website for the license which have the prism insurance and now this was also like employees experience so people can see how it is to work with. gina is not the only for me i need to respect. yes, i see. i see the telling me of course so from india, isabella from sauls. yeah, from south africa. i lived in from felicia. right. jack moved from malaysia. michelle finally from germany. so this the basically is showing the progress of training. the model is kind of like the stock market, right? i see this model performs relatively good because you can see is increasing over
12:04 pm
time. but sometimes it's not very successful. for example, days when this model will start very high by that the programs kind of stop by is wasting our time is wasting to fewer resources energy. and so i hadn't shown his team a working on optimizing i models for specific applications. for example, linking text, video, and images. the goal is to make communication between humans and machines, more intuitive and natural. a lot of people may recognize this, this guy is, this is a, this has some kind of grandpa, me, right? so it's very popular on social media, right? so if you don't know this picture to the algorithm, it will generate how a storage you can generate a comedy, and you're all take offend se, holler all, all of this kind of story. so we just keep it default and then we just do. it wasn't supposed to be like this. as i was meant for more. he whispered to the room,
12:05 pm
his words echoing into silence. i am more than the lonely man i've become. more than these disappointments, suddenly his eyes glinted. a revelation for me within this might. perhaps it is time i show the world that again, with strength and resolve, arthur placed the coffee down marketing and added to his solitary reflection and the beginning of a new chapter. so um, basically this is what you can do a way to push multi model in twice during, right? so you have to see farm a single image. you are able to generate not only a text description, but uh, emotional audio, sorry, the eventually chinese company wellbeing,
12:06 pm
the medium position in just generally about 2 months ago i was i think that n team this was. busy a congress in shanghai, and during the conference there was a 30 large language models are released in one day, some from big companies like 10 sonata by, by do some also from like a middle sized company is from a different industry even right now for example, if i'm back charges coming. yeah. you are the america, that learning from us come right. so they kind of copycat, what us company and doing and that make it even better. i don't doubt that one day you will see a while as a top models in the benchmarks in their leader board actually from china the question of which companies will terminate the age of artificial intelligence has real geopolitical consequences. china is using the expertise of its tech
12:07 pm
companies to expand its power wisdom nations. meanwhile, a trying to count to this the . my name is jeffrey king. i was a long time journalist and foreign correspondent in china. i wrote a book called the perfect police state and i was an advisor to the us congress, to the house of representatives on sanctions and chinese politics. from what i have seen around the world in china and elsewhere. i am deeply concerned that we do not know how to manage a yet. we do not know what's come in. we do not know how to rein in this technology and put it to the good use of our democracy. china has been leading in bringing technology under state control and in fact,
12:08 pm
using it as an instrument for state power, whether it is for internal control and censorship, and grip on society, or whether it is their global ambition to have digital infrastructure around the world. and to work with or countries for example, i think about the african confidence it is, of course, a vision that is at direct odds with that of democratic societies. in 2017 china is national strategy for artificial intelligence. and this is a public document set out the explicit goal of dominating global technology. and so i think united states has explicitly set the goal that we are not going to assist china in rising as an a. i enabled authoritarian super bowl. i want to create in the past, it's be not u. s. companies that have online the government's policies in order to gain access to the massive chinese markets. foremost among them, microsoft,
12:09 pm
microsoft is the most pivotal edit for each western company. operating in china that has helped the chinese government develop. it's a i this toby, a microsoft set up in office and in china called microsoft research asia. this was a gesture from bill gates back in the 1990 because he wanted to guarantee stronger market access to china. this laboratory has gone on to train the who's, who lists the superstars of the trainings, artificial intelligence world. many of the key people in this laboratory have gone on to found companies such as make the sense time or either either found them or they've taken on very senior roles. and then that was like the thing to base or off the more to try to use things are not all a and that's
12:10 pm
a lot of great people. great researchers start off longer is actually come from microsoft research. and those tenants, i've not become even kind of the very, very big improvisors opinion leaders. i'd really like in temper new york in china. microsoft helped build china's take late. this in turn, has been used by the chinese government to create a gigantic surveillance stage that operates with the help of a i live in china and basie lashonda. you have found the most recent tv camera in the, in the work i saw, and the to be honest, like the general probably get used. so they don't see this as intrusion to their own fibers or heavy or software that idolize their behavior. or, you know, because the kind of the narrative there was to protect it makes us society more secure, provided about protect from terraces to and so on. so in general,
12:11 pm
like the public over the last to years has already accepted the fact that their us are really right now we have like over 500 city, we're in across the country. that means was city. it's just like some high, they have a lot of big data analysis center. they collecting all of this data from different areas and they have the machine, they have the light, centralize it, and do the computation analysis and making all these decisions. the chinese government has use all forms of a i so far they see a i is an extremely powerful tool that they can use for, for the military, for national security, for succeed surveillance,
12:12 pm
police work also the management of cities. traffic may have been selling these same technologies all over the world, especially to authoritarian governments with the promise of total surveillance and a nation free of crime. free of this. it is, it's a brand new world because we have not yet found a solution to this in the west. the china is 14, you hate, the us is pursuing its own interests in the you. it's striving for independence. europeans don't play a pause in shaping this future technology, then it will be american or chinese that will penetration our lives to an unprecedented extent. it will know us, as well as our closest friends and relatives. it will communicate with this around the clock and influence of thoughts and actions.
12:13 pm
to prevent these c e u needs companies that cannot finally program but also build their own hardware infrastructure to keep highly sensitive dosa safe. a training high and a language models requires thousands of high performance graphics costs, which is also why supplies escapes. that's another reason why many smaller players allies themselves with launch tech companies can see the funding use in both eyes kind of difficult either. that's what a lot of the deals in the field of gender to they are in recent months have come at the cost of independence. many companies have partnered with large corporations by accepting restrictions on things like hardware selection via cloud selection of integration. i think we absolutely didn't want to do that as well. and as long as
12:14 pm
the bills kind of from behind was early on, you understand judas, recognize the value of having one's own hardware. he built a dash, was sent to his company in germany for that reason i left alpha is becoming increasingly strategically important for politicians. the been in the media, the media talks about you is germany's answer to chat g p t. so is that right? is this 5 am? as i thought of, i was again to do it. i go to hoped me that's wrong. that's in front of you could say, germany's answer to open a i would do it by chat g b t is a product aimed at the consumers time. it gets really intended to help school kids do their homework or to write a poem for grandma's birthday and things like that. but that's not our target group at all and thoughts we want to go where the most complex and critical processes are
12:15 pm
. for example, in the financial industry, the in administration type and security and health care, that's where we want to build systems that assessment and support that people often . but, you know, i mean is tell you, i'm, we are in the government ministry here, have, i'm public administration could benefit enormously from a i don't think we have an incredible number of processes that can be system a ties and carried out. they've just happened. my not so the focus of my work here, it was a bit like asking how is it public sector could act as a means the consumer and generating work. if you complete it like that above which you create demand for german and european a, i technology, cars in menaces. and i don't, i mean, i mean if i don't is any i company that target, so public sector and we are the public sector. so we only have to see that we generate opportunities for these technologies to be tested and be it through customer experience funding decisions or even permits the,
12:16 pm
the dallas i sent it so far and showed out of office independence comes from us company hewlett packard enterprise to do is pick up the enterprise, the sign in a loose nukes a of hewlett packard enterprise is one of the biggest players when it comes to setting up a computer infrastructure the, they build data centers, they set up internal server rooms. oh us. so it's a lot of the high quality infrastructure in which the modern world runs comes from h b, e n junior secuity strategic partnership with h p, giving him access to hardware without tying him to the company exclusively fuel. so hope that would help him gain a foothold in the us market. you finalized the deal in las vegas with h. p. c,
12:17 pm
a antonio nanny. the odd. and now it's know it's a business. we're announcing a major joint project with h b. today. they'll be a press release going outside multimedia sleek. i'm either like it'll be a big joint market venture to get a boost. that's the important thing. that's not that i'm going to go on a stage with them, but that we're now taking a joint step with a major partner and a booth and my nervous. yeah, maybe a little if i'm nice. we've been working towards this for months. i'm sure it'll go well. so i mean we, we were building off on that. we have an independent tax tax,
12:18 pm
so we offer line when any, you can excel in dependencies, we recently solve explain ability to new ways. so you can also lease the positives . i confirmed source, that's about all disagreeing stories that they share with me an example. yeah, exactly right. how familiar owns kind of speed something business the i'm always here. so because of the condos in the native americans move past what it is they're willing to take risk ease of pop. but of course this partnership also has to benefit h, b, e u to pop at any partnership can come to an end at any time. the units and julie just wanted to avoid becoming dependent on the launch corporation as was open i at microsoft, that strategy brought with the major risk if he's technology doesn't keep up with the competition. he'll be out of the right. so we'll have more money soon. yeah.
12:19 pm
thanks i, i also wanna talk about how i've hoping to yesterday helped a little bit with that. like, oh it's yeah, it certainly didn't, didn't, it didn't hurt to and i've got so kind of feedback from the immediate feedback i, after the show, thank from, from investors on my, on my cell saying, i don't wanna, i wanna kind of put this money to us yeah, um, so i think i think if we can get your help and if you've got, if we could to your help to really say, okay, these are the application. yeah. okay. so isn't hey, we can get that list you know from, from you. and then we can turn around and look at, okay, one, how do we package it to how do we, you know, can we use it internally? yes. i think that would be great. you know? and then and then obviously 3, how do we know, how do we make sure we line up the services offer? thanks again for the partnership grades. the thanks a lot. i think what always attracted us to the relationship was our office mission was to enable enterprise application use cases for for our allowance and multi
12:20 pm
modal models. and most of the customers in the valley are most of the companies in silicon valley were much more consumer oriented. so this concept of a single tenant lamp that can be trained with your data for your application really fits our core customer base. for over a friend and us, andrew, this new, the americans wanted to see concrete results he had to deliver. and foster the english show i have smiled for you. what are you happy with the traits here so far? the spins and so please feel that meant for me. comments all by one calling the dispatch. and it must be most interesting. that's an input attempt. this fitness
12:21 pm
page busy position movies adviser on the some of the cut film such and then on top of the b i race is also a competition for attention. it's about catchy me. i have invest, it's sitting on panels. be noticed, being quoted, the, the majority heard from the few most lines on this topic today from there were still a few more to come on. so if i give you this will be asking to what extent dial itself in control of innovation. you know what's on it, and so this, once nation technology is now the subject of massive hot you in a sudden truest, suddenly in the spotlight he's a guy is being tested in evaluate. it's not always favorably use magazine did size
12:22 pm
accused of of, of allowing it say hi to be provoked into making racist and chauvinistic statements . and truly pointed out, just basic technology has deliberately not seem restricted low hanging fruit fish on this happens at just low hanging fruit or journalists. i took a screenshot as find the model, use the bad word instructs every time i find 2 in the model or 2 in the instruction either does that diminishes it in certain areas, this is for the fees card, it loses capabilities in exchange for me making it more pleasant or safer. and those might be the exact capabilities that i need in an industrial context for automating processes. the
12:23 pm
you know, we want the embedding technology to become a well known brand, just like the iphone. that's the most important thing. don't think about whether it makes sense or not. so so there's a big barrier. we want to become a company like opening on the top provider in the embedding world embedded i was talking to him about the upcoming plan because we, i believe to release of a new product which is uh, kind of a competitor to hold a i, uh, a value uh, platform and uh, so we were just, uh, kind of these costs. what are the, the best way to kind of push the people focused on this product, right? because there is also like to know where the web t with different culture bank was. and uh, sometimes it's very hard to what kind of off nice everybody to concentrate on one
12:24 pm
suit. this is also because a guy is developing so fast on the law of high. so if you're there and people and you don't want to try this all, try to try that all. so i just the top 2 by say to you on, make sure that all they see here. i mean, you're a senior leaders are kinda on the same page where i'm kind of the developer driven company. so most of our customers are user is actually developers a software engineers. so if he's hmo right now, there's a, there, there is a time and don't think he was there. right. and their engineering team is also our customer. the biggest challenge is see is a combination and i, i just between 10, so the investor and i'll still be like a most of the master, especially, wasn't uncomfortable, right? or wrong. investor has a very strict uh, evaluation about this company. so the companies are, we are competing ways such as, you know, how getting phase from phones and uh, uh, co here from us. so those come, yeah, not like, uh, those guy you know, previously were kind of google, you know,
12:25 pm
our graduated from, i meant to use stanford. so that very smart people, the most of the investors, well look at as, as not as a small company, but they will evaluate us with more knowledge based on the hype, but they're based on the performance of the company. right? so that's, that means we own we, we have to show to sales be there is a hyper gross off the user. so we need to grow as a user base a super fast. or we show that by salt lake to revenue news. summer of 2023. thomas wolf is managed to make time for a family vacation in brittany france. is chief scientific officer. he's primarily responsible for research and development housing face. a job that allows him to take a break from time to time to come back. what are you up to today?
12:26 pm
anything special specific? no, we're practicing sealing with the trapeze. i bet you do the has today onto those you so yes, today we'll do something else. more and also, meanwhile thomas's business partner, clement alone, is in the spotlight. he's the ceo of hugging face, the public face of the company. tech industry heavy weights like google, amazon in video, and am d, have invested $235000000.00 into hugging face. the open development platform for i models has become a 1000000000 dollar business. the company gains even more prestige with mach sucker books. meza used talking face to publish its high and language model, lama to say on some of the stuff to you to some about a it's
12:27 pm
a model that was recently published by facebook. so many times if it could simulate chat g p t o, an open source competitive. uh, 3. the difference is that it's free. it's the only purpose you can just install it on your computer down to you don't have to access it through the chat to btn device or pay for it. and it's like a set of lego. everything is open to the next. everything is freely accessible. okay, you can also buy it a pre built at the if someone builds an open source model for you. i believe it's long in that building level. if you fail to get a beautiful sports. com make from like a for value and then it's yours to get for it. you can open up the hood and look inside it. it leaves reserve, they will gather, they will take the greatest advantage of open source. it's free, it's disability. it's also its greatest weakness. what is the model was developed further by criminals, terrorists or other bad actors and used to cause tom. any security mechanisms built
12:28 pm
into a language model can easily be removed? seeing was because to i can say, so that's a big question. we're asking ourselves and how getting face on in the beginning. all right. and was to make this technology is widely accessible as possible. and then, you know, we sold that would help lots of developers, that there are 2 sides to the technology and it kind of has some people who can access it, who really shouldn't be able to access these all. but that the, so there was a guy i met last year who had an a i designed to develop medicines, molecules that are good for your health just as an experiment to put in the minus sign and train them to look for molecules were bad for your health and within 4 hours it discovered a thousands of chemical weapons including the x, the most powerful nerve gas that we have here in the us. i have developed,
12:29 pm
you know, so you of course you shouldn't open source things like that. it's just crazy. i'm a scientist, i love open source, right? and it's a library. if you think about the pace of progress, how do you make sure that there is like the most progress? open source is your friend. having said that, i just cannot completely ignore all the dangerous and of course the argument, the only argument i have seen so far from supporters of open sourcing everything you think, well, we will figure it out since he 1st seen the rest is so quick a on cool, multiple, it's easy to comment from the sideline, was assisting people in that it's dangerous as they own, it's more difficult to actively get involved to try to create something positive on something good. people necessarily be successful, so they'll be mistakes and then fresh attempts additional i'm going to try it's risk, you know, the little some of the pos we think is right. uh, we're gonna do like some of the sequences. the
12:30 pm
mit is one of the most renowned tech university in the world. it has close ties to industry. research carried out here has the potential to change the world. needless to say, m i t is at the forefront of artificial intelligence in addition to his work, but the future of life institution max, take mark is a professor here. the topic of i security is part of his day today. so we want to wrap up the effort from a piece of which we do things and it's also raised by whenever i go to silicon valley and meet with various companies that how quickly they do things often compared to what we do in university is that's totally fine, this department, we have a whole we're lucky to have a whole by 7 of talented people here. so we can,
12:31 pm
we can wrap up take mock and his fellow campaign is going to keep a close eye on the tech stash ups from silicon valley and cover risks. and you saw and to pick methodology to show people just town full time. we have left to counteract the pool of the tech industry. so you've been working very hard to finish your paper and you have a very, very long conversation. now. yesterday i thought i thought the very last part of it of what we talked about might be kind of fun for the whole group. yeah. i, i completely agree. do you want to draw that table? uh, yeah. where's the internet be waiting for the quotes for it? so like we basically, as you know, the model, the conflict between like the movement to replace human livelihoods and maybe replace humans period. uh, versus like the movement to resist this and to preserve the status quote. so this isn't this come, it's not just something peter, pull that of
12:32 pm
a half. it just actually comes from the math. so if you're now he's like, oh, we have a guy that can do everything human can do, but better. uh my life will still be good. so we called at night. okay. uh so, so if a lot of people believe this, then they will not invest personal sacrifices and personal costs to greater unite and being a for the move it to be in a better position to resist as a team. there's um, companies, an open source developers that are working day and night with the goal of, you know, taking people's income streams by creating a model that are better than them at the, their job and their capabilities. so once you lose your income streams on your leverage, like it's too late. so your options are more limited. so he's plus, he thought it the biggest thing john, tony, i'll just to will look back in 20 years and realize that we've all to my to different things because it was so easy to find because it worked and the i all i behaved correctly in 99 percent of the cases approval and sub named we no longer have control of something that's crucial for society done for us. we see that
12:33 pm
the, the process has already begun until now it's been the intellectual and created the abilities action instead of set us apart from other creatures and machines. but what is those qualities? and now being taken away, the, my name is dr. a non go lumber, kasanya o a k, a sam s i am a rapper. i'm a producer, and i'm an assistant professor at brown university of music department. initially, i wasn't sort of tapped into all of the discussions that were happening around a i, of course, peripherally. i was sort of listening watching reading. but i, i really started to tap into these conversations when i noticed what was happening
12:34 pm
at the intersection of hip hop and, and that's when i realize, well, this thing is moving really quickly. i mean, last year we were talking about a sort of a i generated wrapper, and this year we're talking about wrappers like drake and harvest, like the weekend having their voice is actually sort of cloned using ai technologies. and so the speed at which this has become sort of an immediate challenge for working artist is very alarming, ultimately is the logic of capitalism. and as a human creator, what you can do is try not to be left behind. as a chinese, we always view that light technology. if you use it in this model, way you can like push you i've lift you yourself. so become a smarter equator, queen creator in the machine and a,
12:35 pm
i could do the job faster, a cheaper, and they don't have strike. and you know, they, they'll reduced and the light re ridiculous, the mall phone declines all from the bosses. and i can see the chinese companies already like using it to replace human labors. so i think this is very critical moment right now for the creators around the world. so this is something happening and it's gonna be big in the next 3 to 5 years. and so for folks like myself who, you know, i've, i've been able to build a life for myself, but i would definitely not say that i've been the, the sort of like top tier to that music industry. there's a way that i think we're able to skirt under the radar and continue doing work as we're doing it because it's so much about experimentation. it's so much about
12:36 pm
trying out weird things. and a guy is so much about average a, if the people who are invested in play in that space of the anomaly and playing with the unexpected who will sort of continue to thrive the the impact of auto official intelligence. and now society is file reaching and complex. how can we regulate the technology that's developing so quickly and who's potential is almost impossible to gauge? the united states is struggling here in washington. the tech industries influence is huge. and company majorities, a front job back to the matter is that the us government then slowly it is a democracy. that's that slowness is built into the system. the us government is not supposed to be efficient and not supposed to be able to tackle problems quickly
12:37 pm
. because a government that is too efficient, you know, can use that against its own citizens to i think that we've now reached a stage in our society that many philosophers and, and writers in the 20th century war and about which is the inability to govern technology due to the increasing pace of change well i, i certainly would not that against democracies, but it will be a really tough adjustment period. the 1st major piece of legislation and recognizing artificial intelligence on a file reaching scale came from the use. the i act. and i definitely kind of really admired european union for being essentially the during the space they took on this kind of regulation very seriously. before anyone else refer seriously or
12:38 pm
unison trueness has come to brussels together with other staff shop founders. he wants to let politicians know that strong regulation could put smaller. you repeat employers at a disadvantage compared to the competition in the us in china. is 85. so the movie seems to use meetings like this are always a bit difficult because you say your piece and you never really know what reaction you're going to get a few new people with list of these. and of course, it's clear that cooperation within europe and with europe is important, but it's always hard to say how much we can achieve here in now the. ready
12:39 pm
ready of documents as kind of the life of creating i could just talk, i was repaired, something like this. it's your sessions if you can decide where you want to sit. so good afternoon to all of you. i least welcome to today to be in the bottom of this meeting. an important meeting at the right time is something that will happen. and we always see like basically a few steps down the road. is that what's like the cloud like the and the hyper
12:40 pm
scale us has done with, with cloud computing, that will be an infrastructure for genuine intelligence. that all the value creation, all the apps, all the new innovations in the world will build upon. and for, for us there will be no 2nd chance. if we cannot move fast, then we, we won't be able to try again in 12 months. thanks a lot. the andrew, this is repeated. she's message of over again, withdrawn international stages to jim and politicians all here at the european parliament or is it the cost of the networking and lobbying has become 2nd nature to him. ringback as we have money to it, you have
12:41 pm
a as an investment. so i started my career as an investment banker in management consultant wearing a suit and 38 degree weather with no air conditioning. the . ringback ringback the distribution. okay. wonderful. easy for me. i don't think i'd make a good politician. i realize that in my days at apple vehicles, this deal fox specializes kind of what's the probability of success? one is, is it worth investing this time? is it worth fighting this battle? i think so, i think it's a battle worth fighting, but i also have moments when i think that doing something else would be pretty nice of some ongoing concern. ringback ringback shortly after his meeting with the european parliament,
12:42 pm
it passed at the federal, even 5 years down the line. it is just a government structure that will give you the ability to deal with the rapid evolution of the i n 3. the most benefits from it that it would have. well 1st and foremost we shall. busy citizens rights and freedoms. i'm not just respected, but protected in a sense that we don't want to match the values. we don't want social scoring, we don't want to predict is policing. and there can you system the amenities that i most know i can't remember we have been following are presenting very new group. let me be able to come through can parliament, i'm a judge by profession. i was also a member of government in romania, minnesota, visualization, east of interior. prior to coming to parliament. hey,
12:43 pm
i will play very much into the pol balance. why? because it drives our economies, but not only becomes those would you believe affect both in terms of how well phase going to look like. and then also how this technology will play into many of the processes that will keep one part of the world or the other competitive. and therefore, also the way you write the standards and how the standards become global. accept the standards is very important in the all balance as i mentioned earlier. so we're going to see very soon also i think a competition will cost a little flash in terms of global standards. and that is why we have to take measures to protect our interests and also to make sure that again, um, our understanding of the role of technology is one that is shared by as many on the global stage as plus. this is read negotiations. germany, france and is lovely. begin to soften the rules of the eye it to protect domestic players like alice alpha from heavy regulation. but in the end,
12:44 pm
the european parliament prevailed. the mass isn't just your vehicle, you want and gauge. in terms of regulation, we're the economy this leading the way behind. there's a concern that that will take too much creativity. ice in the market activity at austin maximum as well. so in europe, we're better it regulation that preaching technology on the market. unfortunately not. and the truth is, it's ultimately going to be good for the tech industry as well. to be regulated level playing field. even seat belts and cars were viciously opposed by the auto industry at 1st. but not then when we got the last thing, all cars have to have the seat belts. they started to sell much more cars. mm
12:45 pm
. we had sho, has travel sessions in order to keep his team on the same page. the ceo has to visit the various company offices, regulate the, say the, the, those read letters all the, all the view it is that is the, basically our office about so well now that big where just the was small room is as a big building. he wants to take his company, gina, to the next level that will require all his employees to pull, to get as much as possible on this is i'll just put this down in families there. and they had brought some
12:46 pm
levels instead of like items are delicious. and also the style you on monday, the interior of the world. so i told them you have to each know as i make a heavy face for the cover of the flower head. germany, people squeeze you in each other like uh, telling jokes. uh, you know, tons of random stuff. uh, football match yesterday. oh, this kind of thing. here is small introvert as a and the office is more into reverse. its just though i can different a working cultures. both of them are pretty productive under my we are in the start out. everything was very quickly if someone becomes a little bit stressed with me, comes on living numbers because, you know,
12:47 pm
we couldn't use that as long as it is against the other competitors, against marketing, as it's not above. so what we need is about how people perceive us right on, on what we need. in the meanwhile, in germany is addressed also a team, a working on releasing a new large managed models yesterday. and the leaders told me that this model can be ready on monday, but it has been postponed for many, many times. so i have to see like a colleagues those in the evening and show has another meeting with the potential investor on the way he calls his technical director. to ask was the lordship the new language model is going as planned? i have all a but, but you know the names of them then it's a one, not publisher bure imbedding platform has to get into the global best model. those lines that are not police company won't succeed unless everyone does their best to
12:48 pm
know my hearts and all a part in similar. thomas? is there any, is there guides or if you don't get into the top 10, it will be much more difficult to say you use a platform that's not in the top 10, but you're going to be able to accomplish it all you do since you, that's all you need to think more about these practical things for me on that one is the linked in post done. the twitter post is all there needs to be a strategy here for about so uh huh. okay, well that's fine by me. well, why don't the little guy didn't to the top 10 model, a leaderboard armada is getting to the top 10, but you know, the team just told me the german team just told me they probably cannot get into that help to. that's why i got a little bit like a little impose on my, on my conversation. because that sir, this is something that we promised to ourself. you know, is this word is very,
12:49 pm
very occasion based word. and if you can knock guys into the top 10, it's just like a, even if you'll get into like november 11th, right? nobody cares prize. so this is a why, and i'm telling the teams ad it is not eyeball engineering, at least you also have the sing along the whole come see like some marketing sales . that all depends on the number 10 to the top. 10 models of this lead up on the
12:50 pm
right notice. hi, grace. hi, grace lou works for chinese investment bank. the 2 1st met a couple of years ago during the star shop phase of hon. charles company, a sill phone thing and how you are just starting to bring a i generated content to people variety, you don't want huh. them on how to do those multi modal a i do not. i think we're working on 2 things right now. no one is prompting technology and the other is embedding technology dining, which is me to say thursday this year will be quite a challenge for you and i, for the whole of it's only gonna run, you know, we've made a new software with prompt, perfect one of getting the developers part, we've already got 200000 registered users will say, oh boy, you are strong. oh, that means there's a lot of demand for them. i,
12:51 pm
i don't think i kind of jumped to my conclusion yet. but kind of mentioned is something very interesting to me about face new throughout some to new products, actually the most inconstancy if the c o. okay, ma herself. right? and why though he is so good entrepreneur, not only assigned seats to all a good developer meetings like this one, put oppertunity, she's on the table for her and shows company both in china and in the west. and there's good news about his important project. the new develop a tool performs just as well as the equivalent technology from open i the, by the end of 2023, eunice. andrew says plenty to celebrate. he's completed a major around the financing. the company prevailed and convinced enough invest is to raise half a $1000000000.00. that's money and truly is going to meet because competitor open i
12:52 pm
is over the triggering a new phase in the race for a dominance. the we did a lot of things that smaller people told me 4 years ago they would be impossible. built deep tech, i already out of germany. impossible fun this with mostly european capital impossible. build our own data center. impossible. continued category, defining research, impossible. and now we're entering into a new era and i'm super happy to have you all with us now. and thanks for being here and help us make this the best party, the title book, a service and
12:53 pm
for thomas wolf, quiet holidays may suit the sing. if the post hocking face is now the huge $4500000000.00, thanks to successful style shops and the i act, the e u at least has a seat at the table alongside the us in china. for now, for humanity at large, the question remains. what kind of world are we building right now for ourselves? and for our children? i was holding a little baby leo, you know, he just turned 9 months old. and looking into his eyes and thinking even, you know, right now, his language abilities are much worse than check c, p for and he's never going to catch up. but i never, i have 2 kids that are in middle school and i'm thinking that cable, that's what i should teach them about. so they kind of prepared for the
12:54 pm
a if use future, how do we teach our kids to kind of been so think like unique and individuals. the machine is all something. it's all the bar this all assist us. so we're working together. so i think that's that's how i feel the and then they'll sit down. you're shopping. yeah. that they'll sit down. complicated. even in these pivotal moments in these complex times, people always find a way the creative and results whole on these uh, my son is already learning to colored. yeah, he's really interested in. i was, he wants to understand things and create things using i see our children will probably create to, well, that's completely different from us. but i'm not for 8. the end of the day. i'm an optimist suite to process the
12:55 pm
the
12:56 pm
shift your god to life and it did to to you know, all the latest online trend, navigate your way through the digital jungle global perspective. we'll be your guide and show you what's possible. you decide what really message to you in 15 minutes on dw, we love us. does anything
12:57 pm
unusual? no mountain is too high. the road is too long. in such a faith, ordinary we have a specialist of lifestyle 0. you are in such a minutes. on d, w, the conflicts try see every single connection mapped out shows that you can disagree odyssey be on the board is what makes things the way the way all the solutions mapped out. navigating a changing world. now on youtube,
12:58 pm
old friends, mean friends and nature defend itself in case of an emergency. we cannot guarantee that we could protect munich frankfurt. berlin sandwich faced with rushes for or against ukraine. the rose grace, this military alliance shows weakness. can nato offer its members suspicion protection? europeans security basic kinds depends on 90 percent on the us basic were attacked . what the millions really close rang out to pot document nation starts april fools on dw the
12:59 pm
this is the, the news live from braylen. germany carries out as fast as drop of aid to gaza. this comes as the fast aid is unload it from a ship off the gas on coast you and now says one set of young children and our wrist in the territory. meanwhile, these are als prime minister benjamin netanyahu approves military plans to attack rafa in the south and gaza strip. that's despite warnings from the us. and now this w oppression could be disastrous. on the 2nd day of votes and as on the way in russia as presidential election.

10 Views

info Stream Only

Uploaded by TV Archive on