Kershaw was to cover this retreat.

At dark we began our march through long ponds and pools of water, and
mud up to the knees, in the direction opposite Gloucester Point, and
near a point opposite to the enemy's fleet of gunboats. Through mud
and water we floundered and fell, the night being dark. Mile after
mile we marched at a snail's gait until we came to a large opening,
surrounded by a rail fence. This was about midnight. Here we were
ordered to build great fires of the rails near by. This was done, and
soon the heavens were lit up by this great stretch of roaring fires.
Some had spread their blankets and lay down for a good sleep, while
others sat around the good, warm, crackling blaze, wondering what
next. Scarcely had we all became quiet than orders came to "fall in."
Back over the same sloppy, muddy, and deep-rutted road we marched,
retracing the steps made only an hour before, reaching our old camp
at daylight, but we were not allowed to stop or rest. The retreat had
begun. Magruder, with the other of his forces, was far on the road
towards Williamsburg, and we had to fall in his rear and follow his
footsteps over roads, now simply impassable to any but foot soldiers.
We kept up the march until we had left Yorktown ten miles in our rear,
after marching a distance of nearly thirty miles, and all night and
day. A council of war had been held at Richmond, at which were present
President Davis, Generals Lee, Smith, Longstreet, Johnston, and the
Secretary of War, to determine upon the point at which our forces were
to concentrate and give McClellan battle. Johnston favored Richmond
as the most easy of concentration; thereto gather all the forces
available in Virginia, North Carolina, and South Carolina around
Richmond, and as the enemy approached fall upon and crush him. G.W.
Smith coincided with Johnston. Longstreet favored reinforcing Jackson
in the Valley, drive the enemy out, cross the Potomac, and threaten