The use of utility function in robotics can help to determine the optimal behavior of the robot in achieving its goal. By simulating the behavior in the lab, the final output will still be optimal according to the original objective.