On the relation between identifiability, differential privacy, and mutual-information privacy

This paper investigates the relation between three different notions of privacy: identifiability, differential privacy and mutual-information privacy. Under a privacy-distortion framework, where the distortion is defined to be the expected Hamming distance between the input and output databases, we establish some fundamental connections between these three privacy notions. Given a maximum distortion D, let ε^∗ _i(D) denote the smallest (best) identifiability level, and ε^∗ _d(D) the smallest differential privacy level. Then we characterize ε^∗ _i(D) and ε^∗ _d(D), and prove that ε^∗ _i(D) - εx ≤ ε^∗ _d(D) ≤ εε^∗ _i(D) for D in some range, where εx is a constant depending on the distribution of the original database X, and diminishes to zero when the distribution of X is uniform. Furthermore, we show that identifiability and mutual-information privacy are consistent in the sense that given a maximum distortion D in some range, there is a mechanism that optimizes the identifiability level and also achieves the best mutual-information privacy.