What’s the difference between ‘Bulk insert with batch size’ and ‘Use single record insert’ Data Load Options in Database Table destinations?¶
Both ‘Bulk insert with batch size’ and ‘Use single record insert’ options are used for inserting records in a database table. The ‘Bulk insert with batch size’ option is used when you want the whole dataset to be loaded in batches of a specified size. Typically, larger batch sizes result in better transfer speeds. However, performance gains may be less with relatively large batch sizes. On the other hand, the ‘Use single record insert’ option inserts one record at a time which is relatively slower. However, any errors or warnings during the transfer are identified immediately as they arise during the data transfer.