Keynote Abstract Machines powered by artificial intelligence increasingly mediate our social, cultural, economic and political interactions. Understanding the behaviour of artificial intelligence systems is essential to our ability to control their actions, reap their benefits and minimize their harms. This talk presents a broad scientific research agenda to study machine behavior. It then summarizes a number of studies of human-machine behavioral dynamics, as well as human perception and expectations of machine behavior.