Bivariate Partial Information Decomposition: The Optimization Perspective

Bertschinger, Rauh, Olbrich, Jost, and Ay ( Entropy, 2014) have proposed a definition of a decomposition of the mutual information MI ( X : Y, Z) into shared, synergistic, and unique information by way of solving a convex optimization problem. In this paper, we discuss the solution of their Convex Program from theoretical and practical points of view.