[patch][ccla]batch API for gears to improve performance

[Adam Peller]

Julian produced a patch that implements get/put Multiple methods much like he did for dojox.storage. Crossing the native boundary fewer times seems to have a huge performance impact, as well as the potential to avoid extra expensive sql operations.

[Adam Peller]

from Julian Cerruti (IBM, CCLA)

[Adam Peller]

some rough measurements to show impact -- does not include overhead

===== test_FlashMultipleItems: Start filler.put: howmany = 1, this.howmany = 0 test_FlashMultipleItems: Adding 8432 bytes of data took 14ms filler.put: howmany = 1, this.howmany = 0 test_FlashMultipleItems: Adding 11 bytes of data took 10ms filler.put: howmany = 100, this.howmany = 0 test_FlashMultipleItems: Adding 100 items of 11 bytes of data took 568ms test_FlashMultipleItems: Adding 100 items of 11 bytes of data with putMultiple took 19ms test_FlashMultipleItems: Reading 100 items of 11 bytes of data took 72ms test_FlashMultipleItems: Reading 200 items of 11 bytes of data took 141ms test_FlashMultipleItems: Reading 200 items of 11 bytes of data with getMultiple took 138ms test_FlashMultipleItems: Deleting 200 items of 11 bytes of data with removeMultiple took 20ms test_FlashMultipleItems: Deleting 200 items of 11 bytes of data took 152ms test_FlashMultipleItems: End =====

[guest]

Cleanup of last comment:

===== 
Adding 8432 bytes of data took 14ms 
Adding 11 bytes of data took 10ms 
Adding 100 items of 11 bytes of data took 568ms 
Adding 100 items of 11 bytes of data with putMultiple took 19ms
Reading 100 items of 11 bytes of data took 72ms
Reading 200 items of 11 bytes of data took 141ms
Reading 200 items of 11 bytes of data with getMultiple took 138ms
Deleting 200 items of 11 bytes of data with removeMultiple took 20ms
Deleting 200 items of 11 bytes of data took 152ms 
=====

Note put 100 items: 568ms -> 19ms and remove 200 items 152ms -> 20ms

[bradneuberg]

Julian, thanks for the patch. Applied to the Dojo tree August 15th, 2007. Ran the dojox/storage/tests/test_storage.html page after patch, which still works. However, I don't have any code which uses putMultiple/getMultiple, so didn't directly test those functions. Everything is in SVN now.