Laying the theoretical foundations of learning and intelligence across distributed agents with heterogenous computational capabilities, diverse and private datasets, and limited communication links.