The concept of machine learning with action and observation history involves predicting the next observation based on past observations and actions taken. Another interesting aspect is trying to predict one's own actions.