The Jet Data Manager has the ability to split an INSERT statement up in batches during data cleansing, i.e.
when copying data from the transformation view to the valid table. This saves log space on the SQL Server which gives you better performance on large tables with millions of rows.
Enabling Batch Data Cleansing
To enable batch data cleansing, follow the steps below.
- On the Data tab, in a data warehouse, right click on the table you wish to use batch data cleansing on and click on Settings.
- Click on the Performance tab and select Enable batch data cleansing.
- (Optional) Enter the number of records you would like each batch to contain in Batch size. The default is 100,000.
- Click on OK.