This thesis deals with a range of current topics in information theory and statistics. It consists of five distinct contributions: Chapter 2 focuses on the statistics of single-regression Granger causality estimators. ...