It has recently been proposed by Gunasakaran et al. that allostery may be an intrinsic property of all proteins. Here, we apply Schreiber's transfer entropy formulation to the non-allosteric protein Ubiquitin and show that there are indeed systematic pathways of entropy and information transfer between residues that correlate well with the activities of the protein. We use 600 nanosecond molecular dynamics trajectories for Ubiquitin and its complex with human polymerase iota and evaluate entropy transfer between all pairs of residues of Ubiquitin and quantify the binding susceptibility changes upon complex formation. Calculations show that specific residues act as entropy reservoirs in Ubiquitin and others as entropy sinks. Using the plausible conjecture that extracting entropy from a residue makes it more susceptible for interaction with a partner, we explain the ternary complex formation of Ubiquitin in terms of entropy transfer. Finally, we show that time delayed correlation of fluctuations of two interacting residues possesses an intrinsic causality that tells which residue controls the interaction and which one is controlled. Our work shows that time delayed correlations, entropy transfer and causality are the required new concepts for explaining allosteric communication in proteins.