Caesar's strategy during the Siege of Gergovia involved nibbling on terrain features and building camps, but he was faced with the challenge of having to deal with compromised supplies and a lack of troops. He eventually devised a plan to faint an attack on one side while attacking on the other, leading to victory for his army.