php - Which of these three options would be fastest to populate my DB table? -



php - Which of these three options would be fastest to populate my DB table? -

i have (huge: 6.4 1000000 rows) database table 3 columns follows:

url title description

right url column populated, various urls around web. have add together title , meta description url in each row. there 3 ways see can this:

option 1: utilize php , curl go each url , grab title , meta:description. (even using options 2 or 3 i'll have @ to the lowest degree part of urls).

option 2: have dmoz xml file has several 1000000 elements this:

<externalpage about="http://animation.about.com/"> <d:title>about.com: animation guide</d:title> <d:description>keep developments in online animation skill levels. download tools, , seek inspiration online work.</d:description> <topic>top/arts/animation</topic> </externalpage> <externalpage about="http://www.toonhound.com/"> <d:title>toonhound</d:title> <d:description>british cartoon, animation , comic strip creations - links, reviews , news uk.</d:description> <topic>top/arts/animation</topic> </externalpage>

etc.

i can utilize xmlreader compare url in every externalpage-about see if matches 1 of 6.4 1000000 urls in table, , if does, add together title , description.

option 3: can write above dmoz info separate database table (again using xmlreader), take time, , somehow utilize joins , selects on 2 tables info need.

would alternative 2 or 3 quicker urls using alternative 1 urls? if yes, of 2 options faster?

assuming "faster" means less time update url table, alternative 3 seems best option.

you can populate table records xml , using bring together update main table.

php mysql curl xmlreader

Comments

Post a Comment

Popular posts from this blog

web services - java.lang.NoClassDefFoundError: Could not initialize class net.sf.cglib.proxy.Enhancer -

web services - java.lang.NoClassDefFoundError: Could not initialize class net.sf.cglib.proxy.Enhancer - when trying request rest service @ time of response getting exception.. feb 21, 2013 2:34:49 pm com.sun.jersey.spi.container.containerresponse mapmappablecontainerexception severe: exception contained within mappablecontainerexception not mapped response, re-throwing http container java.lang.noclassdeffounderror: not initialize class net.sf.cglib.proxy.enhancer @ org.hibernate.proxy.pojo.cglib.cgliblazyinitializer.getproxyfactory(cgliblazyinitializer.java:117) @ org.hibernate.proxy.pojo.cglib.cglibproxyfactory.postinstantiate(cglibproxyfactory.java:43) @ org.hibernate.tuple.entity.pojoentitytuplizer.buildproxyfactory(pojoentitytuplizer.java:162) @ org.hibernate.tuple.entity.abstractentitytuplizer.<init>(abstractentitytuplizer.java:135) @ org.hibernate.tuple.entity.pojoentitytuplizer.<init>(pojoentitytuplizer.java:55) @ org.hibernate.tuple.e...
Read more

Accessing MATLAB's unicode strings from C -

Accessing MATLAB's unicode strings from C - how can access underlying unicode info of matlab strings through matlab engine or mex c interfaces? here's example. let's set unicode characters in utf-8 encoded file test.txt, read as fid=fopen('test.txt','r','l','utf-8'); s=fscanf(fid, '%s') in matlab. now if first feature('defaultcharacterset', 'utf-8') , c engevalstring(ep, "s") , output text file utf-8. proves matlab stores unicode internally. if mxarraytostring(enggetvariable(ep, "s")) , unicode2native(s, 'latin-1') give me in matlab: non-latin-1 characters replaced character code 26. need getting access underlying unicode info c string in unicode format (utf-8, utf-16, etc.), , preserving non-latin-1 characters. is possible? my platform os x, matlab r2012b. addendum: documentation explicitly states "[mxarraytostring()] supports multibyte encoded characters...
Read more

javascript - mongodb won't find my schema method in nested container -

javascript - mongodb won't find my schema method in nested container - i trying access method of schema stored within mixed container. here situation : have cases model can many different things, have schema each of these things stored in "casecontent" mixed property. var caseschema = mongoose.schema({ casecontent : {}, object : {type:string, default : "null"}, collision : {type : boolean, default : false} }); the casecontent property filled model of 1 of schemas, 1 exemple : var treeschema = new mongoose.schema({ applecount : {type : number, default : 3} }); treeschema.methods.dostuff = function (data) { console.log('hey, listen'); homecoming true; }; then, want utilize method of schema original container : caseschema.methods.dostuff = function (data) { if (this.casecontent.dostuff !== undefined) { this.casecontent.dostuff(); console.log('it worked'); } else { ...
Read more