i click i like i shop online and that produces huge amounts of data but who analyzes it one culprit is the advertising industry i look for a curry recipe online and suddenly ads for indian cookbooks pop up everywhere big data is it a blessing or a curse i will focus today on shift. i'm always online my smartphone is always connected wherever i go along the way i leave digital footprints and help create a pot of what's known as big data. researchers have analyzed close to a 1000000 apps from the google play store they found that 90 percent pass on user data and many of these apps send data to several companies that sounds unsettling

but does big data have a really affect on my life well it does let me know if i need my umbrella tomorrow . this vaguer rocket has a new kind of weather satellite on board at an altitude of 320 kilometers will collect data that will help meteorologists create better weather forecasts. for the 1st time a satellite will be able to measure wind speeds using laser range. it even works in locations that are normally inaccessible like over oceans there's a perfect storm brewing out there big data can help us predict the weather. insurance companies also use big data for instance to estimate the impact of natural disasters like flooding and car insurers set their rates according to the risk of theft where the policyholder lips so you might pay more or less for your

policy depending on how many cars have been stolen in your neighborhood. big data can also make your sat nav more useful and precise in a las vegas pilot project an onboard computer tells drivers how fast to drive to catch the green light. and in estonia the port of talent is a digital showcase project trucks and goods are checked in electronically they did a better logistics and shorter waiting times. so big data is big business companies are investing. in software that analyzes it in 2018 more than 6000000000 euros were spent on big data applications in germany alone here's a stunning application from the field. message predicting flu epidemics with the help of twitter data researchers at university took 500000000 tweets from around the world and had them into a watson computer system once and found the relevant tweets was more it recognized

what they were about for instance if the writer got a flu shot or already had flu symptoms this process is known as cognitive computing the digital simulation of human thought processes. watson for example he was like you know and put information into the right context even berlin sorry day hospital is using big data to diagnose illnesses more quickly and treat them more effectively. this is a tumor cells which has specific molecular markers no 2 chambers cells are the same and ideally therapies will be targeted to the decision medicine hopes the term in which therapy is likely to be most effective researchers identify the tumors genetic characteristics to select a targeted treatment. dr claudia fall break from berlin charity hospital is using big data to improve cancer treatment she's collaborating with the molecular health

data analysis company. did it is generated worldwide through various clinical studies and research experiments and then collected in databases for example molecular health checks these databases regularly on a daily basis and compares the results with those from the patient samples and after that to get such results tumor cells molecular markers are analyze the process called sequencing doctors at the sheraton they send the results to molecular health. molecular markers or compared with those of thousands upon thousands of others stored in the company's database. the database also contains information about therapies a report is produced or provides doctors with a recommended treatment tailored to the specific characteristics of the tumor cell . that this is what we're looking for it's the direction we hope things will go in the future we'd like patients to receive personalized treatment based on molecular

changes we can identify during sequencing. the idea behind the project is revolutionary but using data from so many people as the basis for medical decisions and possibly superseding diagnosis of the patients doctor is also. is at the dozen in germany people are still quite cautious we're afraid to give others access to our data which is understandable as a researcher i'd like to manage my own data and know exactly what's happening to it . but i think we must do away with this idea of keeping it all to ourselves the amount of data is just too large for that. big data has already allowed berlin's charity hospital to identify individual therapies for some 30 cancer patients. treating illnesses with the help of big data that's real progress and it shows that ai and humans can work together for the benefit of mankind. another thing that big

data has done is make human behavior more predictable that's especially interesting for companies who want to target us online with personalized advertising that can still be hit or miss just because of research diving expeditions doesn't mean i want to buy a wetsuit right away but data analyst paul monk from from thailand are working on ways to optimize at targeting when you play when you like when you stop to see you've already been audited that will go to whatever. we are the technology to help the brand to know how to talk the right way to the right consumer with. mung problem and his fellows andrew co-founders have been actively collecting data since 2013 today the firm employs more than 160 people and mainly analyzes data from the asian market they help authorities and companies to control their image

there's been little criticism about how they process the data our job is not on the data but our job is that it father brand to understand it so in the end we help it to understand it. but data security specialist cash to normal is more critical he believes that the global trade in data is a multi-billion dollar business from which only a few players profit. google alone earns over $100000000000.00 a year with online. and of course not $100000000000.00 has to be recovered somehow through the products that are being advertised so a single company earns hundreds or thousands of dollars a year from each internet user. then there are the data brokers who profit from collecting and analyzing this flood of data using special software we try to find out who's tracking user behavior the. triangles here represent the trackers the

circles the web sites visited. even users who don't log in aren't surfing anonymously with every click the trackers network grows in this test there were close to 20 trackers for every web site visited. big data analysis helps link that information and produce a digital profile of the user. profile like this describes a person in their fears their needs and possibly their financial situation allowing for advertising to be tailored to meet their budget or to be described as better than even our best friends could want to come. so companies might know me better than my friends do even very sensitive data like that used by health apps as often passed on to data collectors without users knowledge the legal basis for this is sometimes highly questionable. massive amount of data is generated every day it

comes from a variety of sources not just the internet. whether on facebook instagram or net flix every day we humans generate 2500000 terabytes of data but not all of it on the net visit the doctor and your symptoms and diagnoses are stored in servers this state is often anonymous the person on the market researchers when you found someone the collins location and contact details are scooped up and become part of big data brokers encyclopedia defines big data as a monster so large change so fast or so very that they can't be process with standard software. exactly how much data counts as big is hard to say as it's not stored to analyze centrally i see analysts estimate that in the next 6 years the global data spirit will rise to 175 bytes per year one set of byte is equal to

$1000000000.00 terabytes one trillion gigabytes one quadrillion megabytes in comparison a 3 minute m p 3 track is a real 3 megabytes in size so one is that the point can store real 333 trillion songs processing such monsters of data isn't easy there are 3 aspects to consider. there is the hardware aspect what hardware can handle it. second is the software that processes the data directly. there's the algorithms which glean information and knowledge from this data. hardware software algorithms it's a big business big data is analyzed using software platforms called frameworks they divide data between several high performance servers where it can be processed

simultaneously processing that data quickly is key that's where data artisans burden based startup comes in they analyze very large amounts of data very fast using an open source platform called apache flink they help create it processes incoming data in real time and can simultaneously analyze data has already been stored stream processing is a big new thing so it's no surprise that chinese complement alibaba snapped up designs for an estimated 90000000 euros earlier this year that's great for the startup founders but is it good for society when healing. poses a risk that the data could be compiled on unaligned in such a way that for instance human behavior becomes more predictable and transparent. and that should end up limiting individual freedom with the if i had this i instant i felt honestly that i'm pretty generous when it comes to my personal data if i

look into a service and like it i'm willing to pay for it with my data but maybe the prize really is too high as trading your personal data for free apps or services a fair exchange all will big data turn into a surveillance nightmare what do you think join the discussion on facebook on the w dot com goodbye until next time. the time to entice current i ask him to resign or dealing with any method i killed many civilians to mean that coming including my father was something i was a student i wanted to build a life for myself at least a totally each but suddenly life became hellish tenets of. providing insights

global news that matters d.w. made for mines. what secrets lie behind these moments. find out in an immersive experience and explore fascinating cultural heritage sites . d w world heritage 360. 13 women. 21 stages. 3480 kilometers. and one. driver tour de force for women because so far it's a mental make up edition. we want to show.