google apps script - Large data set exceeding maximum execution time -



google apps script - Large data set exceeding maximum execution time -

i have script loading contents of spreadsheet scriptdb spreadsheet has around 15,000 rows, 9 columns , keeps giving me "exceeded maximum execution time" error.

i'm using function given in google's documentation load data:

function loaddatabasefromsheet() { var spreadsheet = spreadsheetapp.openbyid(spreadsheet_key); var sheet = spreadsheet.getactivesheet(); var columns = spreadsheet.getlastcolumn(); var info = sheet.getdatarange().getvalues(); var keys = data[0]; var db = scriptdb.getmydb(); (var row = 1; row < data.length; row++) { var rowdata = data[row]; var item = {}; (var column = 0; column < keys.length; column++) { item[keys[column]] = rowdata[column]; } db.save(item); } }

is there way speed things or going have break chunks of few thousand?

calling db.save(item) 15000 times causing slowness. instead, utilize bulk operations if you're going saving much data.

var db = scriptdb.getmydb(); var items = []; (var row = 1; row < data.length; row++) { var rowdata = data[row]; var item = {}; (var column = 0; column < keys.length; column++) { item[keys[column]] = rowdata[column]; } items.push(item); } db.savebatch(items,false);

calling save operation 1 time @ end saves of round-trip times, should speed code lot , finish before exceeds maximum execution time.

google-apps-script

Comments

Post a Comment

Popular posts from this blog

web services - java.lang.NoClassDefFoundError: Could not initialize class net.sf.cglib.proxy.Enhancer -

web services - java.lang.NoClassDefFoundError: Could not initialize class net.sf.cglib.proxy.Enhancer - when trying request rest service @ time of response getting exception.. feb 21, 2013 2:34:49 pm com.sun.jersey.spi.container.containerresponse mapmappablecontainerexception severe: exception contained within mappablecontainerexception not mapped response, re-throwing http container java.lang.noclassdeffounderror: not initialize class net.sf.cglib.proxy.enhancer @ org.hibernate.proxy.pojo.cglib.cgliblazyinitializer.getproxyfactory(cgliblazyinitializer.java:117) @ org.hibernate.proxy.pojo.cglib.cglibproxyfactory.postinstantiate(cglibproxyfactory.java:43) @ org.hibernate.tuple.entity.pojoentitytuplizer.buildproxyfactory(pojoentitytuplizer.java:162) @ org.hibernate.tuple.entity.abstractentitytuplizer.<init>(abstractentitytuplizer.java:135) @ org.hibernate.tuple.entity.pojoentitytuplizer.<init>(pojoentitytuplizer.java:55) @ org.hibernate.tuple.e...
Read more

Accessing MATLAB's unicode strings from C -

Accessing MATLAB's unicode strings from C - how can access underlying unicode info of matlab strings through matlab engine or mex c interfaces? here's example. let's set unicode characters in utf-8 encoded file test.txt, read as fid=fopen('test.txt','r','l','utf-8'); s=fscanf(fid, '%s') in matlab. now if first feature('defaultcharacterset', 'utf-8') , c engevalstring(ep, "s") , output text file utf-8. proves matlab stores unicode internally. if mxarraytostring(enggetvariable(ep, "s")) , unicode2native(s, 'latin-1') give me in matlab: non-latin-1 characters replaced character code 26. need getting access underlying unicode info c string in unicode format (utf-8, utf-16, etc.), , preserving non-latin-1 characters. is possible? my platform os x, matlab r2012b. addendum: documentation explicitly states "[mxarraytostring()] supports multibyte encoded characters...
Read more

javascript - mongodb won't find my schema method in nested container -

javascript - mongodb won't find my schema method in nested container - i trying access method of schema stored within mixed container. here situation : have cases model can many different things, have schema each of these things stored in "casecontent" mixed property. var caseschema = mongoose.schema({ casecontent : {}, object : {type:string, default : "null"}, collision : {type : boolean, default : false} }); the casecontent property filled model of 1 of schemas, 1 exemple : var treeschema = new mongoose.schema({ applecount : {type : number, default : 3} }); treeschema.methods.dostuff = function (data) { console.log('hey, listen'); homecoming true; }; then, want utilize method of schema original container : caseschema.methods.dostuff = function (data) { if (this.casecontent.dostuff !== undefined) { this.casecontent.dostuff(); console.log('it worked'); } else { ...
Read more