ZeroHour
Schneier on Securitypublished ()ingested

Extracting Secrets from Machine Learning Systems

lowResearchimportance 30
Full article96 words · extracted from schneier.com · click to collapse

This is fascinating research about how the underlying training data for a machine-learning system can be inadvertently exposed. Basically, if a machine-learning system trains on a dataset that contains secret information, in some cases an attacker can query the system to extract that secret information. My guess is that there is a lot more research to be done here.

EDITED TO ADD (3/9): Some interesting links on the subject.

Tags: academic papers, data mining, secrecy

Posted on March 5, 2018 at 5:20 AM10 Comments

Sidebar photo of Bruce Schneier by Joe MacInnis.

Text extracted automatically; images, tables and formatting may be missing. Original: https://www.schneier.com/blog/archives/2018/03/extracting_secr.html