# US 2023/0264709 A1 · System and apparatus for on-demand, feature focused data collection in autonomous vehicles and autonomous driving systems > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0264709 A1 - Document ID: US20230264709A1 - Status: Published application - Kind: A1 - Application number: 17/679,388 - Filed: 2022-02-24 - Published: 2023-08-24 - Earliest claimed: 2022-02-24 - Assignees: GM Global Technology Operations LLC - Applicants: GM Global Technology Operations LLC - Inventors: SHIGE WANG; Wei Tong; Donald K. Grimm - Web page: https://patentgrep.com/patent/US20230264709A1 ## CPC - G06F 16/113: {Details of archiving (lifecycle management in storage systems G06F3/0649; point-in-time backing up or restoration of persistent data G06F11/1446)} - B60W 40/09: Driving style or behaviour - B60W 60/001: {Planning or execution of driving tasks} - B60W 2420/403: Image sensing, e.g. optical camera - B60W 2540/30: Driving style - B60W 2555/20: Ambient conditions, e.g. wind or rain - B60W 2556/45: External transmission of data to or from the vehicle - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT ## Abstract An on-demand, feature focused data collection system of an automobile vehicle includes at least one data collection device provided with an automobile vehicle. A data collection unit receives data from the at least one data collection device in response to a data collection request submitted by a user. A data scene group combines portions of the data received by the data collection unit and stored in the data collection unit of the automobile vehicle or at a remote server. A control logic device receives the data collection request and activates collection of the data. The control logic device includes: a data collection strategy which differs if different types of the data are available; a reference algorithm loaded or deployed; a storage capacity allocated for the data; and a storage policy employed to save the data. ## Claims ### Claim 1 An on-demand, feature focused data collection system of an automobile vehicle, comprising: at least one data collection device provided with an automobile vehicle; a data collection unit receiving data from the at least one data collection device in response to a data collection request submitted by a user; a data scene group combining portions of the data received by the data collection unit and stored in the data collection unit of the automobile vehicle or at a remote server; a control logic device receiving the data collection request and activating collection of the data and having: a data collection strategy which may differ if different types of the data are available; a reference algorithm generates a reference output which is compared to the data from the at least one data collection device and initiates the activation of the collection of the data; a storage capacity allocated for the data; and a storage policy employed to save the data. ### Claim 2 (depends on 1) The system of claim 1, wherein the storage capacity includes a lock-free wait-free storage management feature sized to store the data. ### Claim 3 (depends on 2) The system of claim 2, wherein the lock-free wait-free storage management feature is configured as a modified ping-pong buffer mechanism including two buffers defining a first buffer having a first buffer size and a second buffer having a second buffer size being the same size as the first buffer size, wherein at any time one of the first buffer or the second buffer is flagged for a read function, and the other one of the first buffer or the second buffer is flagged for a write function. ### Claim 4 (depends on 1) The system of claim 1, further including a logger device triggered by the control logic device when a predetermined data condition is met. ### Claim 5 (depends on 4) The system of claim 4, wherein the storage capacity includes at least one of a local storage device and a remote storage device located in the remote server; wherein the logger device is responsible to write the data to either the local storage device or to the remote storage device; and to manage storage of the data. ### Claim 6 (depends on 1) The system of claim 1, wherein the data collection request defines a predetermined format indicating which of the data to collect and a level of collection. ### Claim 7 (depends on 1) The system of claim 1, wherein the data received from the at least one data collection device is collected to a target feature on an “on-demand” basis or as requested by the user, the user including an occupant of the automobile vehicle, the data collected using one or more data collection strategies defining at least one of an activation condition, a data selection, a collection duration, and a data storage. ### Claim 8 (depends on 1) The system of claim 1, wherein the data scene group includes multiple data scenes, some or all of the multiple data scenes being retrieved on an “on-demand” basis from the remote server and returned to the data collection unit via a first remote request forwarded to the remote server via a wireless device which also transfers a second remote request to the remote server. ### Claim 9 (depends on 1) The system of claim 1, wherein the data defines at least one of a snow event scene, a night-driving event scene, a rural driving event scene, an urban driving event scene, a vehicle accident event scene, a residential street scene and a highway scene. ### Claim 10 (depends on 1) The system of claim 1, wherein the at least one data collection device includes at least one of a forward-facing camera, a rear-facing camera, a radar or a laser imaging detecting and imaging (lidar) device. ### Claim 11 An on-demand, feature focused data collection system of an automobile vehicle, comprising: at least one data collection device provided with an autonomous automobile vehicle; a data collection unit receiving data collected by the at least one data collection device in response to a data collection request submitted by a user; a control logic device receiving the data collection request; an executor of the control logic device executing a reference algorithm to generate a reference output; a comparator of the control logic device comparing the reference output to the data collected by the at least one data collection device; a logger device of the control logic device triggered when a predetermined data condition is met and activating collection of the data; and a lock-free wait-free storage management feature sized to store the data. ### Claim 12 (depends on 11) The system of claim 11, wherein the control logic device includes a data collection strategy which differs if different types of the data collected by the at least one data collection device are available. ### Claim 13 (depends on 12) The system of claim 12, further including a signal generated by the control logic device to deactivate data collection according to the data collection strategy. ### Claim 14 (depends on 11) The system of claim 11, further including a storage policy employed by the lock-free wait-free storage management feature to save the data collected by the at least one data collection device. ### Claim 15 (depends on 11) The system of claim 11, wherein the reference algorithm includes an object detection feature detecting and recognizing objects in a scene in real-time. ### Claim 16 (depends on 11) The system of claim 11, wherein the reference algorithm defines an individually deployable application. ### Claim 17 (depends on 11) The system of claim 11, wherein the reference algorithm has a unique identifier and a structure including inputs required by the unique identifier, types and sizes of the data collected by the at least one data collection device, output types and output sizes, and an execution environment defining a service, an available memory, and a type and a frequency of a processor of the control logic device, the executor executing the reference algorithm when the inputs and the execution environment are loaded. ### Claim 18 A method to perform on-demand, feature focused data collection, comprising: providing at least one data collection device with an automobile vehicle; receiving data from the at least one data collection device in a data collection unit in response to a data collection request submitted by user; combining portions of the data received by the data collection unit as a data scene group and storing the data scene group in one of the data collection unit of the automobile vehicle or at a remote server; and transferring the data collection request to a control logic device and activating collection of the data. ### Claim 19 (depends on 18) The method of claim 18, further including: employing a data collection strategy which differs if different types of the data are available in the control logic device; and applying a reference algorithm to the data after employment of the data collection strategy. ### Claim 20 (depends on 19) The method of claim 19, further including: allocating a storage device for the data; employing a storage policy to save the data in the storage device; and retrieving the data from the storage device on an on-demand basis upon receipt of the data collection request from the user.