it is not tracked to the nsf. that is question one. the other is measures of effectiveness. you refer to the lack of measures of effectiveness being issued. the fact is, a lot of the measures we are using do not really make any sense, like education data, which ignore the actual computer spread and the gap between those data and reality. you have gdp data in your report, but obviously, nobody checked to see if the gdp per capita data you are using tracks between international organizations, which had a two to one difference. if we do not track the effectiveness, does it do any good to have measures of the effectiveness? >> ok, where we start? [laughter] let me try to deal with the first question. and then i will get to the multi part question. on the intangible benefits, yes, we do recognize there are some. but what i was trying to say benefits for a program or policy, they should be articulated. we should find out after we go into the audit. i recall an instance where we were doing an audit the guy said, oh, our purpose is to do this and this. and we said, we ask you when w

it is not tracked to the nsf. effectiveness. issued. the fact is, a lot of the measures we are using do not really make any sense, like good to have measures of the first question. and then i will get to the multi part question. on the intangible benefits, yes, we do recognize there are some. but what i was trying to say benefits for a program or policy, they should be articulated. we should find out after we go into the audit. i recall an instance where we were doing an audit the guy said, oh, our purpose is to do did the audit were your reasons work and you gave them to congress. applied it. we say, this is your program,we do recognize there areplease articulate why. in response to the other questions, i should just say, planning. out what kind of planning is go people into -- we hope you are doing the planning and we hope you keepwe assume they are there. we have been told they are. we have not demanded them. overall to read instruction. is the planning good? that is far want to highlight clock strikes 12. that is my fear, that we ar

when you look at the milestone rating definitions for the nsf, one is that they are unable to -- that they have -- the department should not exist, but they can accomplish the mission. the second one says that they cannot accomplish the mission with a significant coalition assistance. that one affects many of the entities within the ministry of defense and interior. i guess my question is, have you looked at the downward trend which is providing assistance and whether as you move toward 2014 many more of those entities without assistance will be unable to accomplish the mission and therefore unable to provide the security that we can structure requires. >> the second question is over here. >> hi, sir. i return from afghanistan a few weeks ago. >> please identify yourself. >> sonship. i don't wish to announce by affiliation because this is a question based on experience. you have termed results and impact, but it is not clear whether your running and the difference between that and the ultimate impact on how the afghans perceive the legitimacy of the government which i think is our ult

it is not tracked to the nsf. that is question one. the other is measures of effectiveness. you refer to the lack of measures of effectiveness being issued. the fact is, a lot of the measures we are using do not really make any sense, like education data, which ignore the actual computer spread and the gap between those data and reality. you have gdp data in your report, but obviously, nobody checked to see if the gdp per capita data you are using trucks between international andization, which have a 2 to 1 different. -- tracks between international organizations, which had a two to one difference. if we do not track the effectiveness, does it do any good to have measures of the effectiveness? >> ok, where we start? [laughter] let me try to deal with the first question. and then i will get to the multi part question. on the intangible benefits, yes, we do recognize there are some. but what i was trying to say that if there are intangible benefits for a program or policy, they should be articulated. we should find out after we go into the arctic -- into the audit. i recall an

>> so the nsf, for example, is investing in the center for wits and atoms. -- bits and atoms. >> yeah. >> but one area that i think is interesting is this intersection between engineering and biology. we traditionally have not thought of biology as a platform for manufacturing, but in the same way that we've had this huge improvement in our ability to read dna, we've gone from $100 million for the first human genome to rapidly approaching the thousand dollar genome. the same thing so occurring in our ability to write dna. so the notion of being able to program single-celled organisms to take sunlight and co2 and turn that into renew bl chem -- renewable chemicals that reduce our dependence on foreign oil, i think, will be one early application of that. >> and what stage would you describe a that as being? >> there's a fair amount of start-up activity that is already starting to happen, so you see a lot of activity that is at the pilot plant. so this is not, you know, 10, 20 years out. we're really seeing activity. but there's a lot of research that remains to be done in this area. >>

it isn't tracked to the nsf. that's question one. the other refers to measures of effectivenesses. you refer to the lack of the measures of effectivenesses being issued. the fact is a lot of the issues were using -- we're using don't really make any sense like education that, which exnear the computer spread and the gap and dat and reality. you have gdp data in your report. but obviously nobody checked it to see if the gdp per capita data -- [inaudible] so if we don't actually check the sources for our measures of effectivenesses, does if goo do any good to have -- measures of effectivenesses? [laughter] >> okay. where should we start? >> microphone, please. [inaudible conversations] >> okay. [inaudible] let me try to deal with the first question. i'll get to the multi-part questions. i'll try to do that. on the tangible benefits, we recognize there are some intangible benefits. excuse me. but what i was trying to say if there intangible benefits for program or policy, they should be articulated. we should find out off the we go in the audit. i recall one instance we were doing it

>> the nsf is investing in the center for bytes and at toms.ne area that is interesting is intersection between engineering and biology. we not thought of bilge as a platform for manufacturing. in the same way we had the huge improvement of our ability to read dna we have gone from $100 million for the first human genome to rapidly approaching $100,000 genome. .. but here is the deal in terms of what we do. half of the pointers that we saw today and that's been true for the last two years going to direct manufacturing applications. where and how are they being apply to you day. server f-18 and service today are printed and have been printed for the last 10 years and we are now working with air force and they have 35 suppliers to turn this should the same technology to cf 35. every invisible line minor u.k. and 65,000 miners manufactured daily or printed. >> those are the dad told -- >> in this line braces. the 65,000 daily. stsn of mass customization are being printed have been printed for a decade and is growing. most dental restoration if you

his research has been funded by the nsf, the department of education, and the gates foundation, amongmany others. his research involves evaluating the corporate tax credit scholarship program, the largest school voucher program in the united states, conducting large- scale study of school accountability in florida, and following children from birth to school career to study he questions of any quality. -- of inequality. david taught economics from 1998 until 2008 and the university of oregon and stilton and 1998. he'll earn his ph.d. from the university of wisconsin, madison in 1995. welcome please. [applause] >> thank you for coming out tonight. it is a real pleasure to be here at the university of florida. i spent 10 years here on the faculty. i am always thinking of reasons to come back here. i am looking at the audience and seeing friends from the community who have now i have grown to know and love over the years, so it is especially wonderful to be here for this event. i was urged we will start on time and and on time, so let me tell you an outline over what i am going to try to

his research and social policy has been funded by the nsf, the department of education, the gates foundationmong many others. david's currently funded research involves evaluating the floor of the corporate tax credit scholarship program, the largest school voucher program in the united states conducting a large-scale study of the school accountability in florida and following children from birth early childhood quality. prior to joining a northwestern faculty in 2008, david taught at the university of florida where he was a professor of economics from 1998 to 2008 and the university of oregon from 1995 to 1998. he earned his ph.d. in economics from the university of wisconsin madison in 1995. so, help me welcome david, please. [applause] >> welcome thank you for coming out tonight. it is a pleasure to be here at the university of florida. as mentioned, i spent years on the faculty and i'm still always thinking about reasons to come back here. it's fabulous to look out at the audience tonight and see not only colleagues from the university so it's wonderful to be back here for this event. so