Programming non-volatile storage system with multiple memory die

A non-volatile storage system, comprising:

• a plurality of memory die, each of the memory die including multiple non-volatile storage elements;
• and
• one or more control circuits in communication with the non-volatile storage elements, the one or more control circuits program multiple sets of data to different memory die;
• for each set of data:
• the one or more control circuits obtain a copy of nearby data already stored in intended non-volatile storage elements, combine the obtained copy of the nearby data with copies of data from other memory die, if the set of data does not program properly then the one or more control circuits recover at least a portion of the nearby data from the combined copy of the nearby data with copies of the data from other memory die and store the recovered nearby data at a new location.

A process for programming non-volatile storage, comprising:

• programming a first set of data into a first set of non-volatile storage elements on a first die of a plurality of dies that communicate with a common controller;
• and
• prior to programming the first set of data;
• obtaining a copy of nearby data already stored in intended non-volatile storage elements on the first die, combining the obtained copy of the nearby data with copies of data from other of the die, recovering at least a portion of the nearby data from the combined copy of the nearby data with copies of the data from other dies and storing the recovered nearby data at a new location if the respective set of data does not program properly.