about privacy big data security
we covered
material the laying out some confessions some lessons a prediction or two
I we're gonna have time for questions at the end so this is usually a pretty
engaging topic
how technology impacts our society so up
compile them at during the talk and what we set up quite a bit I'm at the end
to go through them I my name is in either on
Michael said the product not X I
meh did not exist quickly give you I from now love
how and where we're merging were about the next generation big data to really
understand data supplied things within the enterprise and across enterprises
I to really discover the date that you have and
compete with that efficiently and easily were slowly emerging at a stealth mode
company was founded almost a year ago
us a statement a lotta more interesting things coming out about organ
not act up first confession I am NOT an attorney
I'm an engineer I I have back on signal processing cryptography
software I my under rousing like coins in the ring so I'm certainly more
a geeky nerd and then-attorney although
policy really does intrigue me I started early in my career
designing advanced avionics system for launch vehicles I did a stint in about
10 years developing online voting systems in the crypto protocols that
were
that are involved in that that was an amazing ride
and now most recently I been the I was the first few privacy officer added
hell yes i an off around their big 18
so a that we've been doing the last
for five years up which will be
the the crux if the talk will be talking about what is
the personal data supplied chain I we were at Intel is that the ended that day
to supply chain
we had about 20 billion public records we saw about 30 million visitors a month
the company been around since 2003 the company lifetime is sold about $50
million reports
I we powered a power now only a few months
my lap ob people search for AT&T
a previously for ya who so usually for looking for someone online
if they are very common and you can get away with Google search
if they have a minutes or more common we're gonna find yourself and tell you
for one of our
proper wanna their properties I you know
people asking joint ellios they were a
data broker which is I usually interests have term
I I when I joined they had a Better Business Bureau A+ rating up a nap they
were
I engaged in several investigation by
investigation by Attorney General across the country by the Senate Commerce
Committee was investigating them
up I had to be there
stupid or naive to jump into that but what I really found I really thought was
that
public data is an important element other stab with
establishing trust between people and I felt there was a need to do it right
and I thought I could do more from the inside an organization like that
and just throwing rocks I I
at them from the outside so during my tenure we improved our better business
better business
your rating from a nap now B-plus I
I'm proud about the investigations are over I
we've established the industry is something that I i
is reputable and trustworthy I least in some
eyes and but I didn't do that alone are far from it
I when I first joined in Tally s I data
privacy listening or of our toughest critics actually
it was a much more modest or up
we r look at people that we're really at risk
for the kinda data that we provided in an hour risk groups included folks like
victim
victims of domestic violence and elected officials and police officers and judges
those are the folks are often up the subject some stocking
I and and offenders would use our data
sometimes for odd those ill-gotten
or are ill purposes I
so I want to talk to families folks I the first on my list was
the national network to end domestic violence I victims of domestic violence
for typically stock
typically when and I really wanted to understand what we can do
I as a provider of personal information
to these women and so I went to talk to Cindy Southwark
who's an executive at the from there and messing around and I said
what can we do better here and few pretty straightforward get my women out
of your day
and I I think that was a pretty clear
directive and I think great in the lessons about 50,000 women
United States that are victims of domestic violence would give us a lesson
out and she went and tried to go compiled let's
an she came back and women
really don't like to be on anyway that's the last thing they want to be honest
less I said okay haven't we get my pen and they could
login opt out the record in that kinda
kinda stopped that forbidden she came back you know what really be helpful
why can't these women just suppressed their
leaders contact information they don't want to opt out their entire profile
Mike why because offenders will know that the women are proactively managing
your profile
and send them even more leave your incentive fender even more
in San under more and so
what would be nice if the trail different call the most contact
mo safety sensitive information is the contact information just like that
as a great idea I thought it was a just
not as a good idea for at risk group as a good idea for our custom
and so I really start to cook this idea that
wanna be nice to be able to have access to your own background check and be able
to manage
privacy profile around your own background check
and I started think about this more deeply and then I talk to another
up privacy advocate side one by the name Sally happen
is an anthropologist and a product designer design
bill Gertz years ago as they look like bananas and
so kids you know we love bananas so you put your grandson look like a banana and
of course
over 30 for I know they were for our boys
they let go birds and so I ass out what you think a
you know our product like working with same question is:
sandy and she said you know the prominent LES
you guys are all about voyeurism and not enough about narcissism
Mike and it's the same
no that's in the echo
show me my own background check and so
we did there's a site now culture Rep dot com
it's a free site I you can look at your own back on track
after you're properly authenticated through a knowledge-based authentication
you can execute privacy controls on
on that side you can suppress the latest contact information
you you something that no one I in
domestic violence community outreach group a private meeting after by I
I was a really interesting idea came from a buddy of mine
I when I started at Intelli as he looked up is back on track in
the a criminal charges on his record
in the charge was criminal trespassing
as a criminal trespassing offense on my record
all I did was jump the fence at a con at a concert
in college somebody broke into a
change I said well that's how the county reports
we can't we don't we can change we change it
I why can you at least let me comment on it give
give provide my side of the story for so someone sees that record
they will know my side of the story at a good night
we could do that and so this I like to do that too you can actually comments 21
that pulls your back on track
well actually see your comment right next to
any charges so I think
this is maybe a little ahead of its time I
I think there's going to be more and more up access your own information and
the ability to manage
affectively it's public information you should have
a voice in I so that its perceived
I correctly II and I think it's your responsibility
i'd to manage and and you're right your own public data
so popping up 11 for looking at data generally
up not a big surprise is a lot of it
I between the time in I have some you may know this
from the time that the first cave people her on wall still about 20
up to there's twenty exabyte up data
transfer credits toward moved around that kinda thank
four times that was moved around created
stored in February this year
ever by more than
up hardest active data I wanna be stacked with a date with personal data
and this is the public data supply chain that
we were privy to Antalya and this is
sorta where the data come from and where it goes come from three sources:
predominately the headwaters of the supply chain
are government typically
vital records I property records
licenses things like that I
there's commercial record which come from
businesses hi businesses that you actually to business where
so when you get there really expensive oil change
and you sign documents when you pay for
your you may be signing away the data that you provided that
oil change company and it'll be sold into this data supplied
the last element of this is self-reported data that you put up and
blogs that you might
but in other public warrock I Twitter
Facebook if your privacy settings on clampdown I
so there's a lot of data I
there's a analyst for the data that's in that comes in the state supply chain
I and then it gets crimes together these big data engines
and its use for a buncha stuff I in the risk environment its use for
credit reports II and credit tax
housing employment screening marketing behavioral targeting feeds this
I is fed by the state supply chain ID background facts
I as well directories that Intel is engaged in
people ask white
uses the people after this data I
most of them are not regulated some of them are regulated by the Fair Credit
Reporting Act the most of these are not regulated
I they run from the mundane to the obscure up
I someone put together Union and they wanna
altogether addresses the people that they went to school with
up love is actually a big used for consumer
background checks check out today
parents checking out a fiance I
is a big use pro there some profound uses people
adopted kids looking up there lot their birth parents
is a common you up the one that is the most obscure i think is in
sorta 3 o'clock fine owner up dog relative for trans
this actually was use up an analyst at work for me
and we always when are Alice interviewed with that we always have them
look at our site and give them a critique are they would give us a
presentation
what they found with the site and she came in to do not use the site a couple
years ago my dog needed a trans bone marrow transplants when you define
my dog siblings we had find the owner Mike Dogg sibling when using tell you to
do that
i'd you are our service
up so lots uses
let's talk a little bit about how we I
do all how do we do this linkage how do we
accomplish this linkage problem up
we take billions records that fifteen billion record cell
and we have in this inning United States typically will
and we have to take billion record after Maxim
to the hundreds of millions of people United States
and soul ocular same name I
clearly Carol Brooks for example there's about 1300 people named Karen Blixen
United States might have about 10,000 records
for people named Carol Brooks and you have to find the right Carol Brooks
records
for the correct hell Brooks people I for me
others about 200 records for the 35 yr sodium Adler's
in in the country and so we do this record linkage problem
and what comes out a bit of a cluster of record so you see at the bottom right
there is this cluster
records and up you see the gym now for about
ten o'clock that an ambulance facing lawyer
from Houston Texas who is the bane of my existence because he really punches
records out there and he always shows up higher than Lauren
I'm I'm the lame NABARD about 8 o'clock
up from now Mountain View Calif
I so these are all this is the cluster ball the gym abner
up that are that exist
and so these are available for purchase at places like Antalya
other sites we can get these profiles
we also offer opt out you can opt out not to suppress and relays contact
information
but for free you can opt out a profile and people ask
when someone knocks out you delete the record believe the profile
confession no we do not and there's
something called the fair Information practice principles
that talk about data minimisation and minimal use
and things like that fair use a beta and people ask why don't you delete the data
I because we feel that there we certainly suppress it
we certainly honor the opt-out would be in big trouble with the Federal Trade
Commission
within on the opt-out I
but sometimes you can do better by not pull the race in the day and here's an
example
so here's to record his a profile with a few record Jane Hampton
from Peoria Illinois we have to record for
one has our date of birth about
just turned 15 years old a minor
might ask why minor data in your in your information
cash at all sometimes he gets in
I as much as we don't want date on minor some time to get into the state supply
chain and
we don't went nowhere comes from we are races are entices and other data brokers
are gracious acquires a date and sometimes
data from miners getting there and so
we put it together we put these two records together one records data for
the other records not the day to Berkeley link them
you're like me then and then we would opt out
because we don't serve profiles on minor
so then if if we did follow the data minimisation principal
a affair the fam made from practice principles
we would then a race this profile but we've got another record the next month
but had no data for it was the same Hampton Inn there's her
email address if we hit totally
a race the opt-out profile we would be we have nothing the match against
wouldn't know that Hampton is a minor and we would end up serving the profile
with your email address
however if we kept that we would now
have two records in a profile for a minor
and the new record would snap into that profile because we build a maximally
by now and now we can opt out the entire profile
and now no information on vein Hampton the minor
would actually leak out onto the site so I think
there sometime sometimes there are reasons why
you if you follow the letter from the principal the end up delivering poor
service
and I think that's where up a little
innovation a little thought for a objective
reasoning comes into play so that's a little bit
detail on on the
personal data supplied let's get some altitude on the history of this
I at least how I've been thinking about it for a while
up while ago under fifty years ago or so
house are pretty small I love this Oscar Wilde quote quote quote the only thing
worse than being talked about is not being talked about in this is a a
painting by
Norman Rockwell call the gossip and II spent about a
couple years my you think greensboro alabama
and I think the population now 2500 I think when I was there
i play like 1200 the town is small everybody knew everybody else
and when you cut school the whole town knows by dinner literally
dinner you cut you cut school there
there was the reasonable expectation of privacy which is actually legal term
was very low up a friend
a minor op Monroe I whose was secretary stay in Washington for a lot years
he grew up in Bainbridge Island nada party-line
doubt the harbor the only phone line this is i think in the forties
and everybody was listening always listen to the party line
I telephone from Bainbridge Island there was no expectation of privacy
it was a different different I'm
through the 19th century I
urban populations grew along with anonymity and
you ended up with I arising
a expectation of privacy something try to capture
II in this order notional diagram where
you had this order rockwell ara where urban density furlough
personal and intimate with lower than you had this with the industrial
revolution through the 19th century
you had the sort of March higher and I in
urban density in anonymity I public good fences are and then
around thirty years ago you had this order when I'm gone the privacy vertigo
our
which is where you had on line density sorta drop really fast and personal and
Amy drop really fast
and these big data supplied things are just pull the rug out
and the four out from underneath and everyone is getting their 15 minutes of
fame
and others are just getting completely freaked out by this level of exposure
I there are incredible
advances around personalized I
medicines and communications and energy great things coming out of this
I white one thing that I I thought is really interesting how
I'm in space is shrinking here I
I grew up in Miami Florida I have been
back I'm live there hi 30 five years
I get a facebook friend request from a buddy from high
Adam and I'm this is a few years ago
and so across 35 years and three thousand miles I get this friend request
and use a good body I kinda roughneck
I certain parts mind here are less savory
than others and I really I my kids on their
on the side my family all the pictures like
really accept this friend request from this guy
so what what what you think I did a background check
I as I could I and he had prior
actually but nothing violent I think
hi so I have II said
okay I'll get a rough time in the nineties he got married had a kid
is act-up a little drug trafficking okay
is the nineties I so I accept his friendship
and it's been fun and and you know
no ill II no cautionary tales to tell
up but I think this level love
information it's all public record public information
and let me make an empathetic decision about
someone's life and whether to include them in my
up and I think that's it it's a new world
there there is no there's no physical proximity there I
return temporal proximity I so it's it's fascinating and
I and when you look at privacy from the contact the culture and history really
interesting and
want it things I i it's interesting to look at is sorted this
EU verses US privacy model
it's deeply cultural the United States we value
disclosure above discretion I values
%uh speech and Prasanna sample really value
disclosure where your opinion really value
discretion more than disclosure they value privacy and due process and equal
protection
not that we'd I'll it's an issue balance
I you know the EU views asses as as somewhat
reckless and we you them a somewhat conservative and stodgy its
my view that George Carlin quotes never know is there one driving faster than
you is a maniac anyone driving slower than you is an idiot
up I think that's what the in the Wii the EViews ice
as maniacs and we view them as idiots and
and I don't think anybody's right here I think it is where you sit
where you stand everyone is not like you are doesn't think like you
is wrong in some sense and I think that's true at all I think it's as we're
just grappling with these
these values that our intention and they come from
an interesting background up
the EU has in viable right dignity
this write a personality I
that based dates back in the nineteen 1902
really solidified I after world war two
and the Nazi abuses up the right a personality
a really I came to embrace privacy rights
in the US in 1890 Bryant a Brandeis Warren
I'd created their in from this I right to be let alone doctrine
I and so that really is all-encompassing privacy
doctrine whereas in the US we're really about harm
I especially with respect to I individuals and corporations everything
except
government and citizen which obviously have Fourth Amendment privacy
protections
between people and and and corporations
it's really about harmon in 1960 up
a a Prosser put out these these the sports
and this forum I it's pretty straightforward
there's the peep in court don't look at a private information are private
I don't filing with private space don't assume
anybody's identity don't blab
don't blab private back I and don't flatter
the United States privacy regime is pretty much built on those for torts
and there's a set of sectoral privacy law that goes with those ports
I things around like there's health care privacy
and there is financial privacy and there's employment privacy
there's no overarching privacy
which really makes it difficult United States to figure out when this Privacy
matter and wanted
when doesn't it especially when you're designing products
and so I came up with this thing I got on actors think
I when I was an Intel is my guys always calm with these great ideas
they thought were great ideas how about we let people search by picture
you take a picture somebody and then you can really see their back on track
and I'm like oh god awful I
you know be all over the press and not a good way
I but what I want to do is figure out how to tease apart
so that this becomes actionable and
there's sorta 3 axes that that this
the privacy turns on I at least
I for this formulate a formulation its
places players and parapsychology the places are
is a private place for a public place think that's an important access
I there's a a story
%uh me leaving America's game a couple years back in we're going up the ramp in
this girl is like taking pictures
everybody coming up the ramp and I was with somebody cuz I'm a privacy guy some
people say
Wiley prime and I said really
I'm in a public place I can expect that picture would be
I there be facial recognition %uh
me and will be uploaded on Facebook everyone known that the game
well how differences that from 150 years ago when they might have
the time I decided the game not a whole lot of different
I so it's important understand when you're in public and when your private
sometimes it's hard to take part it out with a look at in a minute
the second accesses players are they I these powerful players
or is there a big power difference between the players
like a like a citizen and a government or is it are they peers
fundamentally what can go wrong I think that is a big issue
what are the perils the players
I disparity actually Bruce Schneier came up with that
a few years ago I that privacy is really about
a power equalizing power I think that that
was a brilliant insight looking this a couple examples around this if you look
at
the places pay sometimes there in a public place when you think you're in a
private place through the nineteen
I 2009 study by MIT
gaidar project where they were able to I
discern someone sexual orientation by just their friends on Facebook
even if their privacy saying a clampdown and how able friend who's a professor
there
hates no point in having controlled information is all out there anyway
I and I think he makes appoint I
the RP there are things that people are going to derive I
from public data that is private
and I think that is it really important I
issue that we're going to talk about it a little bit
here's one that I i really I really
behavioral targeting me prolly and we have
decide I
if you look at up social media
services on the web what we're paying with our money
or paying with their data I I did this post a couple years ago called
your privacy is worth five bucks a month and the way I came up with five bucks a
month
Facebook market cap with the user base is what the investor expectation on
return would be and I kinda backed up by bottom I'm
it's actually much less than that because market valuing
Facebook's revenue quite a bit higher I maybe a pokémon
I by the fact is I
you can pay with your dating to pay with your money and I proposed at that time
I two-and-a-half years ago the Facebook should have a tracker charge of
you either pay them there but you're you pay them a pokémon
or they can use your data however they like
I someone gotta pay for the service is no free lunch here
and actually based on winner came up with a similar
propose a few months back I do think that the end the day we gotta figure
have charged for these products
I sure we love the service by if we're not careful
we're gonna be on the menu
talk about power a little bit I would add to this low bat I
this is this notion of graph privacy rights for our disparity
so peer to peer there's not much privacy they're not not have any privacy rights
incorporation into and a customer and employee there are certainly
statutory protections second five the FTC Act says a corporation's
certainly I can be unfair unfairly or deceive
the Fair Credit Reporting Act says that there's certain
procedure the company must go through when they're doing a background check on
a prospective employee I between government and citizen
I there's constitutional protection
between you and your God 9
up between an example of this was like Target
remember the target anybody remember the target now you're pregnant
I this is pretty interesting it's a very simple machine learning problem
because up women had a %uh baby registries
so they would say hey I'm pregnant I and people to register to get the baby stuff
they would see what those customers
who were registered I for Babies R
what they bought so they wanted had buildup in training data
around what pregnant women purchase and then they extrapolated that to the
restive they're
their their customer base I
the challenges they really think about power applications about because there
was a
I Teen Mom you start to get coupons in the mail
saying hey we know you're pregnant combine unscented lotion
server now betting and I and the Father
this teen call park inside
is not pregnant until the dotted
and that was that there's a huge there's a power disparity between parents and
children
I and that were really was a respected by Park
and and that only one
abuse of power consider that if an employee employer new
headed time that their employees with pride
might they not give them I certain assignments
I might be not promote I insurance
I might be delivered hand more expensive great
so people in powerful positions and exploit
II my can exploit this information
and is only one up to equation back
by I there is a a correlation between
chain idea the difference and in power between players and the secrets the
and actually uses when I look at teams I and whether they
how much they trust each other and trust me your trust their leaders
I very if they have a lot of secrets there now are trust
and you can use this as a signal I get the sense there's a %uh
secrets running around that the team that means is not a lot of trust and
and that's not a good thing for prop productivity team
I wrote this post while back why employees why
name they lied because as the boss of all the boss is in the position I love
some power
if they can engender trust with the team the team is going to do whatever they
can typically live
because lie I levels the playing the PowerPoint feel
that's what they happen and there's no there's no you know it's a man that
that's what weaker players need to do that to level things out
putting this all together this place is players pareles
cases up if you look on the vertical more powerful players on the vertical
more private places on the horizontal and
I on the on the right are are are
on the you're on the right or the most private up places and on the laughter
the more public place and powerful players on the top and weaker players on
the bottom
and then you could do things like take
paid cases like soap in the press and plopped a monograph like this
and the the sphere the side the spheres how perilous
I the outcome could be so I took a few
actually I sorta collect fees as a hobby is only like have higher
fifty or sixty other by would make their
the chart even noisier than it is i right now so let's walk through this a
couple
up so there was a case where the US supported
a buncha breadth for because they tweeted that they're going to destroy
America
and really what the man was just gonna party really hard and so the TSA saw
that
and the board I and and so
certainly public data but in the a very powerful player
can really exploit that and the point deportation
is a major deal I mean incarceration execution deportation
those are things that only governments can do up
there was a case %uh actually pain in Georgia where'd she posted pictures
a a of her vacation for a fuse and Ireland
drinking something I she shared those on Facebook and somehow the
school board got when those pictures and the
her for drinking I and I
this is anything case because Ashley Payne said I felt violated like someone
stole the pictures at my house
I and I think she got that far wrong it's not that
no one stole the pictures share the pictures and and sharing is this store
gateway drug between private and public its order the slippery slope is there
something in the office and
out there the abuse happened
by the school board muster contract said you cannot drink at all
while you're under contract whether it's on our time or yours
the school board abuse that information and I know she had filed suit on
Havasu came out but it's clear that was a clear abusive information
not inappropriate accessible information
up I like this one too I the FBI
put a GPS transmitter on and fun
car you drug kingpin in maryland
I hadam that right he was a drug
and he was convicted and by
the FBI put the GPS transmitter on his car without a search warrant
tell them from and obviously all that information
clearly showed he was guilty the supreme want this case when the Supreme Court
this this supreme court voted nine to nothing
in Aug 09 nothing anything that
that this was inappropriate search violation
%uh and punt on 4th amendment vacated vacated the conviction
I clearly a very proud the
clearly a private place but before this is
this case not so clearly because the your house is clearly private but is
your car private
and the judges rule that your car actually is a private place
which I think was a a victory for privacy advocates
I did something on the up the pier side
love the spectrum I if you member Tyler Clementi
I a web cam
captured I'm having sacked II and
and suicide public same
and so I its isn't just
large our disparities that and in Para without sometimes
violation of privacy even by peers and in parallel outcomes
so its important got understand
I this this order framework and figure out
if you're designing products certainly where
I'll where does your product I lawn on
and if you're doing it now what's important who are the players
yeah what is the space for your gathering the data and what potentially
could go
wrong so now I i switch to a way
I from policy for a second and talk about technology a little bit
I there's a lot to date out there
this is a %uh study I
fourth track cockeyed
earlier this year I actually did last fall
and I wanted to
or understand what if we want to take the capacity of the human brain
rented at Amazon what would that cost
and so Chris westbury universe Alberta
a prop third gas and that
human brain has 20,000 teraflops compute capacity and
2.5 had a bite storage in in
estimate I O network but if you're just the by that Amazon will cost you twenty
seven million dollars a month
today however the good news is in 20 years at a cost you less and
seven thousand dollars a year about fifty three thousand dollars
which in the reason I kinda did this analysis
was we're doing all these inferences
outside over on brain I were decide we're making inferences
outside have being
in the same room as someone I for example some comes in an interview for a
job
you know you can guess their age guess it and there you can guess the race
I see your making your you're thinking all this stuff
and use it that's okay course you know you know what if they're showing you
know they're pregnant
I if you act on those sorts of things you have a problem
and so now the next question is well if a big data engine somewhere is making
some inferences
should that be allowed even if those inferences are like way creepy
and very objectionable should that big data engine still be able to
the ride those inferences so this was motivated by
reminding a conga line the I
he's the Hadapsar Chatwing and and we were doing I was on a panel with some
privacy advocates and
we're talking about the riving up public
I or private back from public data and Daniel
raise Haney said you now if you can derive private fat from public that it
sounds like you guys are trying to decide
fine and you category of thought crime not just seems wrong
and I was really good question the prime I we'll look at ourselves
like yeah that's right question I gotta go think about
and so I did a and so I started I went back to the source
thought prime George Orwell and said the promise thought crime
and the reason if feels up bad it's because
all everything else leave from thought and point six hundred years ago louts
who said the same thing
that's become words words become action back to become habits habits become
character
your character becomes your destiny everything starts with aw if you could
stop
why you can stop all these have things might stop
good things up
so if you look at the thought
and speech and access we know that actions of in our criminal
sometimes speeches actual criminal I in the case
libel or slander like we talked about with process sports
conflict with a legitimate interest I think it snowed in
is having trouble with publishing I think he's in a published
I but got down we are not crime
except in the case really weird cabron case conspiracy
theory or conspiracy a crime and using that comes outta
societies sorry existential response to it rat
that is for to be on NEC conspiracy crimes around
organized crime and terrorism typically
but I anything out are every other time
conspiracy is not a crime so this is for the ideology around a stock prime
up a real crime or not and big data engines do inferences
that the conclusion is yes of course big day
can do can perform I
so I so that was the theory of it so then I decided to
really test this theory and if I design a felon classifier
because we had all this great criminal dated lesi said
well let's how to put on this little bit and say well okay thought isn't a crime
what if I try to predict third or figure out if someone's a felon or not based on
from there so is actually a piece in today's Bloomberg
news on this town class are there is the link I the talks to this
in in some detail by I'll go through it a little bit with you
I I can tell you is we have criminal data for everybody
United States 150 million defended I
which if you think about that number for many you know that's gotta be wrong
not $250 million people with a criminal record United States
there's a lot of duplication that they usually
that they describe down to about forty million dependence
in the United States and then what we did
during this exercises week Wednesday we weaklings the data we link today and we
sampled state
Kentucky not to become Kentucky by it was this there was this
it was a small enough data so that we can release it
this state is up now get a I under I know my known as the Big Data engine
that
that hours and Talia so you gotta get having I got
well down the data up and we to find some features
and train the learner and and so here's how the
the learner work is an alternating decision tree
I here's a few of the features gender I colored how many tattoos
up whether I'm a criminal offenses they had with
I they weren't so as you walk down the stairs to records here
one male one female and this is all trained on this Kentucky data
and so I if you're female with hazel eyes
and I to more or more tattoos and have
for your misdemeanors you start adding up these
score three feature and you end up with 4.4
and its above a threshold 3.5 with with makes a binary decision
whether you're found or not the top record I
doesn't have a high enough ordered to be classified as a now I'm
so so you can actually check this out I have
widget actually I might on my blog where you can actually go
up putting you can actually answer the questions at all decide whether you look
like
early like a pallet you would think
so up so
at some point the technology ends and the policy begins
and this is why I wanted to how to take that departed for technology then come
back to
the policy so this is a a a false negative
fall versus false-positive her that I
defines the performance at the the classifier
and so that line is that the performance of the classifier based on what wrestle
you want to choose and the best classifier
would be that line would go through the origin is that where you would have no
false positives
you have no false negatives are evidently and
obviously our classifier stock much were
in the ideal classifier but if you look at the extreme fear
they tell you lock because you have to pick a threshold
in the previous why we picked the pressure 3.5
up in this country your you're innocent until proven guilty so you want
the class started not be that aggressive because if you're a very aggressive
aggressive at all you start to bring in a classified people as
sounds that are not found for example if you look at the far right there
the the false positive rate is nineteen percent
yeah I don't miss any Fallon's your false negative rate is zero
by nineteen percent the PV classifies are not now
not cool although if you're hiring its cool
so the resort is anarchy Terry trade-off
you doing a policy determination on where the threshold
be if you if you wanna going for the anarchy side
I I think the most lenient I
spot on this her is ninety-one percent false negatives
the only catch nine-percent the actual Fallon's
but you don't miss identify anybody so it's Thunder Down right no one is about
I and and so policymakers have to choose where you want to be
on this car because this is
effectively and other technologies like it
our computerized informants or computerized
tipster and if you don't couple good policy with
is kinda technology now problem
for placing a problem is in court I because reason suspicion or probable
cause
is usually our mechanism for vetting out that police work
I however States courts have upheld
profile it was the case with USB Sokolow where this guy comes in from
a wide Tampa two days
today ticket paid ass used an assumed name
I they profiled him %ah this guy looks like drug trafficker and sure enough he
was then
the ruling was upheld but
this predictive information had live all alone by itself
ask actually be corroborated with other information
I as the particularized be efficient to get
I think most importantly needs to be detailed enough that it doesn't identify
I everybody identifies
just the target and I think that's important based on
and there's more you can look at more references there
I just on Monday I V I saw the news
i New York City's stop and frisk ruled unconstitutional
they've been doing it for about 10 years I
six hundred percent increase I
and stop and frisk over the last decade doesn't 2011 684 thousand people
we're stopping rest I
so I in this is a a quote from the judge
I and she said the city police the blackness back to be stopped the same
rate as a proportion
the local criminal suspect population
that sound like a baseball problem to me I
and I said okay well let me put on this a little bit and see
and I don't know for those their unfamiliar with
basically says that I can you adjust
a a probability based on a a general statistics to something that
uses prize some even additional information
so in this case we want in our the cop wants to know
given that someone's a minority what's the chance that that we should arrest
that's the art that's the money on on on the left
and the arrest raid is the PSA on the right
and that the the
ratio I in the middle there is
given that someone is arrested
where they might are they a minority and what's the minority population
and so the plug in some numbers very rough numbers and I don't think furtive
movements
with for it movements are I I'm assuming that just based on
race alone what what's going on here
so if you say that New York City assumes that
87 percent I love people that arrested
are minorities and 50 percent as a minority population in New York City
with
boxes pack I and the the general
arrest rate is five percent
so given that you're minority should you be arrested
is about 10 percent which is twice the amount
I love the general population and so if you're on the from the city
or conservative blogger within a few I'm saying
it is a hundred percent greater chance that a minority stop is justified
overran
like 100 percent but then if you look at
this probability what's the problem someone's
a minority and should not be arrested
that number is ninety percent and the general population
it's 95 percent so my question then is
if it's not okay to stop and frisk ninety-five percent of the general
population
for nothing then why is it okay to stop and frisk
ninety percent minority population for nothing
it's almost as if like it at the airport
you walk through and certain people get to go through without getting to act and
other people get to go after
get checked that's a problem
so going to the national stage this is back to our
are places players Parel framework and and
if you notice before I nor the NSA I
citizen surveillance up
this is an important one because we are really grappling as the country
where the trade-off between security and privacy
and security and there's a lot of 30 people here right now
I security is probably at least 10 years ahead a prime
I I think generally security
easy to formally it's really hard to execute well
but privacy is this it's hard to even formula
and so typically security loses out
our Privacy loses out to security it's sort of like in the
you know the old adage where with effective breakfast the pics are
committed but the chickens are involved
security is about commitment and privacy is really about involved
and that's why privacy typical loses out to security
however I think that's that's potentially long-term disaster
and is a a quote by Alex Howard
a a talked about their quite a bit and
I think cafe pretty well ones that were being affect ross
without being able to verify and I think that's it a big issue
around as a democracy how do we find the right balance between security and
privacy
and soap President Obama is actually calling for more transparency
in five record them for balance laws to be reviewed
I which i think is great I think we need more of that as in SF to be the day that
the fis the core rules but soon after we should be in the know
what actually was decided and and why
this was really though kinda disturbing the NSA chief announced plans to replace
a thousand system administrators with machines I
you know as snowden and what's known is a with a system administrator
I and so I guess since the leak is stopped
the obviously need your is get rid of everybody who
as active that and replace them with machines
I think that's a problem and and I think that if you look at sort of his pyramid
update a least information information now now
least the wisdom we usually don't get to the wisdom part
we're very good at being in amber with our tools in our toys
I we usually don't think about how they and
I impact our society substantially profound way
as they got these things like government doesn't trust people they trust me
you know much transparency know what they're doing and wisdom is come hard to
come by
and then you have the sentient Brian the cloud in less than 20 years possibly
I I would be alarmist but break
you know i mean are what are we walking ourselves into
I that might be hard to walk ourselves out a up
Henry Mason as is you're amazing II chief scientist at Bentley I think
meredith is great at it I think I I really like witches
map with code is awesome and yes it is really awesome
but it's not always awesome I sometimes it's not so awesome
I think we'll realize in 2008 that map as was not so awesome
I where we had financial weapons of mass destruction that almost brought down the
World
world economy I so
like any good equation be improved by a well
place television I why we
try to look at what are the values that
we in dow with our great technology in pools
I to make map with code awesome the values are
negative their its powerfully negatively awesome
but if they're good values then maybe they can really help things the problem
is that values are not very exact
I they are often in conflict like security and privacy
and security and liberty and and restraint and openness and things like
that so
we have to figure out how to get there from here
I one last story
I when I got out of school
and now I I'm ready 5144 lock
what now Lockheed Martin at the time with dynamic spaces systems in San Diego
and I was gonna work on the space shuttle and we're gonna put our
upper stage in the shuttle so I saw for work
January 27 1986 the next day
the next day the shuttle blows up
and so we were like we on this government contract to work on our heels
for about six months while they did
the the investigation why this happened
and it turned out as we all know that the Rogers commission was
form and richard fineman I you
I i think I love you should now I
Nobel laureate in physics actually came out with the reason why
this happen and it turns out it's very cold for the morning and the O-rings
lost their last the city and
and gas II ghastly I
ghastly and and and punctured
the me and so
funny thing is fine really was able to be on the Rogers Commission
right his wife actually convince them to be on the commission she said you know
this and eleven guys
and and women I think I was on active up
me eleven people in this not running around from meeting to meeting
presentation presentation
me one mosquito buzzing around looking for the answer now is
Richard and she cannot be right because William Rogers secretary say during the
commission at one point was
quarters you know saying its fine guys really got me crazy
and and and yet he found the answer and he wasn't
in aviation expert he was in the space industry is why I
I like to think I've as an eclectic general
and aquatic generalist are these technologies that actually can endow the
technology with the value the culture
and Steve Jobs is famous for this obviously I love is quote I
1996 he says I
nonprofit Microsoft is there just have no taste
and not in a small have no case in a big way
I in that they don't think originally and they don't in dow
their their products with the diver the culture
and I think that's really important if you look at I
Norio guy up who is president of Sony in the seventies
he oversaw the development %uh compact disc player
and he required that it had 74 minutes
a body y7 for me
there you know 53 beethoven's ninth
74 minutes and he didn't want to change the CD
and so he drove the teams to get seventy four minutes
%uh audio on that CD and
I just love that story because it really shows that this cultural value
music and art was in doubt into
I something that was critical for the aging something rely upon our
built on I into what what we take for granted now in
music on demand and you see that I
important dynamic over and over and over again
because quite honestly I would argue we are making this stuff up as we go
anyone who tells you differently to the following you were following themselves
and I think they're sorta four stages that that we go through
I friend in my eye sign through this of an element
by your bike out beer they will do anything I
and so he and and I think there's evolution of technology you go from
in a sense which is sorta deny like there's no problem and then you get this
frontier stage
in privacy certainly we r we're in this for a while with this yr
just get over it privacy dad promulgated by a lotta technology leaders
I meant we often have the sort of I over rotation for regulation like there's all
these ongoing
every delays in and I think regulations a very blunt instrument and its
sometimes it's like scratching your back with a chainsaw
yes you get yes but there's a lot well collateral damage
and then you get to this innovation stage right thank you have
smart regulation or smart policy connected
to innovation and so the question is really
how you get there from here and our targets not
how but it's more who is important
and I talked about geeks suits and long
for a while now and I think those are the pillars responsible innovation
I I think if you have only two of the three
you don't really have what's necessary and sufficient to
I get to the right answer I
I think if if you look at because raw making this up as we go
there's a sort of Overton Window let you must you must have tension on either
side
I in order to find the right answer so you have to have this push poll
tug-of-war to find the right answer cuz honestly we're just kicking around in
the dark
really don't understand where we're going and we need this dynamic
a a debate and experimentation to get there
because I think the cycles really important I think we invent things and
then we
question them in scrutinizing criticize them I
this crew clearly does that and embraces that I think that's really important
and then you need to do it again life lesson learned do it again
I wanna the objective I'll
not it's the new companies really understand data flows in like
companies understand the data they have been I compete with that efficiently and
easily and I'm really excited about that because I think there's a lot
knowledge and wisdom out there that's that needs to be understood
so that's all I have I really appreciate the attention
I i think we have I'm question to
with the bay thanks
I wanted to make a comment about slide
you know how much people your privacy
back in Iraq where you known
very small number of people and you could move somewhere else and no one
would know anything about you
there's a difference between someone seen your license plate
in public and having databases
have your license plate with GPS coordinates an times
info in so there's there's a
it's not quite just which public lot more
i would i would agree I but I the world is
my point is the world is shrinking and these datasets are shrinking it
and there is we are going my point is not that
it's all its I'm not saying get over it i'm saying that
these technology are shrinking the world and we need to use the values that we
had then
love respect and empathy in order to live in a world where you just can't
hide behind anonymity
and so yes there are certain abuses around access to data that we
we should curtail I certainly health data and other
other kinds of data need to be protected but when those
when that they'd invariably gets out how we gonna be
with it are we gonna II behave responsibly and respectfully
and not abuse that that information I think
work we're headed down that that road in this can turn off all the data
you have to act responsibly back
problem ike for a regular person
how would you even know who's collecting information on you
let alone can you go there opt out correct
sector how do you even know I think I think it's coming one reason we put out
that through our products the least you could now
at least you can see what's out there nears there's actually
legislation in Congress now to give you access to the information
about that's publicly available and even private L
and I'm I'm a big supporter that because I think without transparency
we don't know what's going on so I think once we know then we could take
appropriate steps
are you control it how you corrected you comment on it
make sure the record's clear
sir I I'm moving this with as a ride
really like this talking thing was great lots of questions but I'll try to stick
to
to just two so one is comment about the power disparity
sort of hinted at in beginning when you talk about
stalkers and victims can I think I think isn't and recognize that power disparity
because as an
law-abiding individual you're kinda powerless just any crazy person out
there
and actually because my work in security I had a mentally unstable stopper for a
while and was
by talking to realize how easy they can find out where well it
so that's one thing I think you should add to that a question
the other thing is whether consumers really have a choice today
is there a 20-year-old who can choose not to be on Facebook
not have a cell phone be off the grid and still have a social life
that really a choice I agree I don't think it's a choice and that's why I
think we are in this round
new policies to deal with that inescapable reality the
just can't get off the grid in so how do you
to the ladies previous question is how do you know when information is out
there
how you make sure the people act responsibly with
that's the error that we ran and its gonna i think is gonna be this
reemergence love a of manners
and and empathy and better behavior in order to
deal with right the previous lady's question now that
your village is actually the world that's right
thank you I'm keep
Park so I just one question for you
you belief that uses have right to view the profiles that you have created for
them
and should they be able to change
what the thing might be wrong about them
yeah absolutely i II that's one reason why talk about their product
if you that transparency I so there's always
to questions and and you you now both
which is what information's out there and then can I correct
and the challenge with correction that we have today which i think is a
same is that a company like & telly it sits at the very end to the data
supplied thing
their retail and there's this tremendous
data sucking machine that is they supply chain
upstream that retail and so
what you really want to do if you really want to correct it at the headwaters
that supply chain at all possible I
and that's not possible today unfortunately I think it's changing
and I think more more public pressure around
that will will take a obvious ultimately
if you look at the Fair Credit Reporting Act which i think is important to the
fair card bring act was
established in 1970 and
it basically says that someone's going to use information for your lively
where you live when you get a job and I
no matter where they get the data they have to share with you whether there's
any
adverse information and what that says is
and resided at it because if your name is John Smith the chance that you're a
victim of mistaken identity
issue and there's a lot of John Smith's out there that are criminals and their
son Ubuntu Johnson is that are law-abiding citizens
and if someone pulls wrong back on 2nd decides not to hire you because it
that's not fair you're not that johnson et and so
access information I to the
previous element point is the world is shrinking and
date is available we can't abuse it and
FCRA says release important
survival I'm Contax housing why men
concern you have to abide by these rules
how do we get there with these
less vital uses the day that's the question I think that
we as a society figure out
sorry tyson he said now works for Facebook so I definitely enjoyed the
stock
I had to kind related questions first would be
do you see as we move forward as technology gets better and we
have more and more information that is
being gathered created about people even indirectly
tells the story morning agreeing on innovation tax where
you things can be inferred about you will the value transparency
go down as the information about you out there
just grows and grows with time yeah I
really good question that's why I ultimately have great faith
and regulation are
or at least policy around abusive the data itself because
at the end of the day doesn't matter where I got the day weather was inferred
or not or private or public
am I gonna use that data against somebody
I and for an abusive use wetherbee
completely criminal like stocking and and other kinds offenses that are
harassment those are the things or my to use it in a very subtle way
I to discriminate I know that
insurance companies know who are back there now they know who are bad risks
are they using that to like based on social the
media a no is a bad wrist
I don't think they're at the point using that data to
allow or disallow policies when you call to cancel
in a fight you less if you're a bad wrist
and so you start to see the sort of insidious use of this information
and are those uses all appropriate or not I think youth based policy
is where we're going because access based policy
is you really can't you don't know where they came from
so there's its it's gonna be
a growing problem where you space is very
although difficult at least track
yeah I I think you can answer yeah addressing was there which was that
UN Security we've said for a long time that security through obscurity is
is not a practical approach I've been seeing a lot of people in the press
more recently dealings rights issues anti-media
privacy through security but again it's for those things were as the technology
grows
that to seems to become licensed practical rights yeah i i agree
I don't think that I don't think that there
i think is a short term thing with this Floyd they're they're worth companies
out there that which is floyd
the net with stuff about in order to cover-up
the other stuff I don't think like an arms race to me
thanks I for
such from you this authentic neatly so
I like your comparison between europe and the US so there was something
probably usually know there's a big debate in Europe on the right
to be forgotten so I would really like to hear your opinion on this
yeah that's it that's a good 1i actually I hate them like my post but I will post
on that
I harm that talks about the right to be forgotten
and the problem that I have with the right to be forgotten
it is is really at the crux of this disclosure discretion
I debate if you look at disclosure close on the heels of disclosure is the right
to an accurate history
and if you up if you have a right to be forgotten
where is history gonna go from there and in the exam I like to use is on
the public Twitter fight so I've been involved in some Twitter fights
you know are and there's been a lot of water fights
so the thought experiment I like that provide
is I'm in for a fight with you we both say things that we regret
and we both agree that we just like
a racist because we both embarrass ourselves
knows unfortunate got it would only say
a a racetrack I don't think that's right
and the reason I don't think it's right it's because other people were watching
the Twitter fight
and there's a public value to that and they're gonna take some lessons from
that
may be good lessons may be bad but there's a public record their
up and the fact that he should be able to
erase public history i think is really dangerous
up I think on the flip side or the argument I often hear is
yeah but the internet never forgets can't there be
some tailing off I love
up the historical record and every heart I
yes I drop you want I think the problem is not really
tweets but things is more
it's a serious offense like your criminal record for essence
in particular for his been acquitted I think
a certain point the problem with Google in Italy one guy was
first inflicted or persecuted for something he was completely acquitted
right expired so expungement of records should be possible
I agree I agree with that and there are certain circumstances but I think
they're
the key word there are certain circumstances that
warrant that kinda that country we
Intel is expunged record all the time to a criminal records and I think that's
important
and but I think they are very particular rise assert certain classes
that are the most egregious that really should have a shelf life
up but I think when you say right to be forgotten
its could be a interpret very broadly now all the sudden
you know the internet is for getting every seven days and obviously
you know that's hyperbole but if it's hard to find that balance
Scott Hensley with the science and tech for DHS
during the talk it seems very western centric you talked about
implicitly things here in the US and Europe it seems to me that
we're headed down a slippery slope where this is you know social control
capability
thought about what men are dicks in your Chinese here you can be doing with your
technology in say 10 years to
facilitate things and make people like Joseph Goebbels proud in terms of
controlling everything that's going on in our society
thought about that side equation sure I mean
I think that I think I mean is your point that
if you understand more the information I that is therefore more easily
you can more easily exploited that affair
I was struck by the movie some years ago the lives of others which is an east
european documentary that looked at
citizen spying on themselves all across Eastern Germany which was one of the
ways that the country was so tightly controlled
finally came apart but somebody's technology some
this stuff when you look at it from the perspective
state-run societies that are interested in controlling
all their society the implications are not particularly good
yeah I i'm not I think when para disparities
large the law must
curtail those kinds of abuses now yeah on certain
per pallet Erin societies there's no law
and so therefore people need to keep their secrets in order to
to balance the power disparity I'm not
I'm ap I absolutely believe that of course I mean that
as the only to you hack I I don't necessarily think that
the way forward is to up stop
turn of the day to turn up tools I because
up the abuses I'd I think it's important to deal head on with the abuses
I think white I mean I'm surprised that's the at work known question
away for I by I I think yes
you know every cool can be used for good or for ill
and I think the law is often white
prepare what we're prepared to society to get the most out of a technology
yeah and it could be a view hi I think that we are running an experiment but I
don't think the way forward is back
name we disagree agreed
thank you very much excellent talk about a dozen years ago there was a
guy promoting big data before it became very popular but basically
he said that om the worst thing you can do
at the time now was in terms of giving up
who you are was basically go to the same supermarket at that time ANP supermarket
was very big
and basically over a month go in there
him pay with your credit card because from their data and they were getting
about a terabyte of data from the cash registers
every day so basically they knew how many toothpicks you
wat if you bought pampers all kinds medical
so basically they had a profile that was obviously was internal
to their own data move servers but my question is
is that information shared and is that legal and it was when I go into a credit
card and i buy something
is that legally doable today
terms of what I bought that's not true is it legally terrible are
arts can someone go by that date is that correct no words if I bought
a hundred dollars with the groceries and I bought everything from soup to nuts
my question is is that information currently
on the market on the market sold ob no it's not
at least I mean we were races buyers information and tell you
I we never saw those datasets I think those datasets that they were made
available
I would there be a huge try again that's what the guy I mentioned the point that
he made from it with Anissa going back a dozen years
is that he was saying is that if people knew how much information
because from it you okay what books did you buy at the supermarket
you know arwood political leanings you have any kind of you know
social interest you have or don't have and that is that they said well if
koko's down by 10 cents you buy pepsi right miserable this type of thing
which was me scared everybody but that sorta follows up with
do you think that we're going to go to legislation and I think with the prior
questioner asked was that I am the owner
up some pieces of digital data whether it's my face
my search a log my public record my non public records that really don't need to
be public
arm do you see that really we need to define that because really at some point
people could say well my
DNA sequencing is my property is in it
yeah I thank you yeah II greats a question I think that
the question the the number the question is what is private and what is public
and I think there needs to be in there is right now
they did that private is generally private except when we
give it away and so supermarkets don't have
re are the the pain
affair in that information fireplaces is much much greater than the game
I online services the quaint little different
I would argue that your private
where online behavior is pretty pride
and yet we're giving away in exchange for services all the time
and you know that that worries
because I think that the supermarkets have and the change have
a much bigger vested interest in keeping your private information private
because it is so a revealing band
summer the online service and and the problem that I have with the online
service is really the
we you know we as users other because we like it we love
of free stuff great but it's not really free
and there's really no business model yet that summers at Wal
allow me to pay for services with money
instead of data and I think that's a problem
II center for last three years Facebook should at
a charge me option I
I think it's at odds with with I think the current business model online with
other online services
coming to pick on Facebook at all I but many online services are free
but they're not free and I think
unfortunately I people like to
up they don't like the privacy violations by they hate
paying with their money more and as I alluded to earlier
if you look at sort of the the present cost for the future privacy disaster
its 0 for most people equation they do is like well
twenty years ago block my faith but I really wanna
check out this new service online and I'm gonna do it
and so their that I think that dynamic has grab hold the bus
and there hasn't been anything that is shaking
I think the the latest I
government trespasses have helps advertisers that
to that a little bit I and maybe they'll be more drum beat around
backers may be over rotated for openness we're gonna guys iraq to back
for defining private spaces and a more comprehensive way
I do think we're going to get there privacy is not dead
this is a new technology I anyway
you've read II Jeff Jarvis writes about this the right about gutenberg in the
present burden to figure out
you know half millennia ago then even know what the printing presses point for
fifty years later after was invented
we are white and year maybe
20 up the Internet and so we're figuring this out as we go
we need to have you know ask tough questions
a the services that we use in an hour governor
and the of so if there are no more questions
at I about snow I after
after up so
I as I alluded to i you know
so I think we're all II don't speak for anyone I'm a little next month
on the one hand I feel like he clearly broke the law
I but he clearly
gave us some information we need and I'm
is a great quote from Martin Luther King
the cold front the jet just a bit is
I highest form respect for the law is to break the law banning face
your accuser and and he did
the first part but he didn't do the second part and
he would be much more hero its second part faces accuser became
I because I but I I do feel like we do need to have this national debate
about the security privacy tradeoff for making
I and where our society is going to be long term
because it's important that for democracy for work we need to know why
the people that are acting on our behalf are doing and so he gave us a glimpse
into what
they're doing and its I think its
its their hearts are in the right place to try to protect us
but it's a slippery slope Italian karen is Mike
here brought up I and the only way democracy I think operates
efficiently is education and transparency and
debate thanks everybody I think the speaker again please