Method and system for estimating a deflated lung shape for video assisted thoracic surgery in augmented and mixed reality

A method, implemented on a computing device having at least one processor, storage, and a communication platform capable of connecting to a network for surgical procedure assistance, comprising:

• obtaining a first volume of air inside a lung of a patient based on a first image of the lung captured prior to a surgical procedure, wherein the lung has a first shape on the first image;
• capturing a video image of the lung during the surgical procedure;
• generating a model to estimate a deflation parameter based on a plurality of laparoscopic images;
• computing, via the generated model and the video image, a second volume of air deflated from the lung based on the deflation parameter;
• estimating a second shape of the lung based on the first shape of the lung, the first air volume inside the lung and second volume of air deflated from the lung;
• updating a surgical plan based on the estimated second shape of the lung;
• and
• registering, the estimated second shape of the lung on to the patient in a mixed reality view.