c# - Fast union of two big lists -

-

i m using union on 2 big lists (over 1 million entries) , s quite slow (a few minutes) need feature remove duplicates cannot use concat , lists not sorted. there faster way? maybe using plinq?

you not saying items in list, 1 option use proper data structure task - want keep unique items - definition of set, use hashset.

var hashset = new hashset<int>(list1); hashset.unionwith(list2);

also measured time code above vs linq.union:

var list3 = list1.union(list2).distinct();

and here timing ( hashset.unionwith works twice faster):

hashset.unionwith real    0m4.111s user    0m3.890s sys 0m0.132s  real    0m4.562s user    0m4.074s sys 0m0.170s  real    0m4.052s user    0m3.851s sys 0m0.129s  real    0m4.003s user    0m3.814s sys 0m0.125s  real    0m4.058s user    0m3.858s sys 0m0.126s   linq.union.distinct real    0m7.579s user    0m7.014s sys 0m0.428s  real    0m7.498s user    0m6.965s sys 0m0.419s  real    0m7.596s user    0m6.994s sys 0m0.412s  real    0m7.446s user    0m6.917s sys 0m0.416s  real    0m7.452s user    0m6.928s sys 0m0.403s

Comments

Post a Comment

Popular posts from this blog

SVG stroke-linecap doesn't work for circles in Firefox? -

-
i've got problem svg stroke-linecap attribute. i've got circular progress bar in angularjs , set outer circle (blue one) have rounded "ends". @ fiddle . <svg ... height="130" width="130"> <!-- ngif: background --> <circle ... ng-if="background" fill="#fff" class="ng-scope" stroke-width="13" stroke="#cc3399" r="57.5" cy="65" cx="65" stroke-linecap="round" /> <!-- end ngif: background --> <circle ... fill="none" stroke-dashoffset="36.12831551628261" stroke-dasharray="361.28315516282623" stroke-width="13" stroke="#432db3" stroke-linecap="round" r="57.5" cy="65" cx="65" transform="rotate(-89.9, 65, 65)" /> </svg> how can that? ...
Read more

routes - Laravel 4 Wildcard Routing to Different Controllers -

-
realizing i'm going take beating this, have several questions "best practices" when constructing laravel route. do laravel routes run "first come first serve" top bottom? if route found, pass control controller (or perform action) , terminate? i have part of application acts url shortner. so, route looks this: route::get('/{id}', array('as' => 'home.text', 'uses' => 'homecontroller@text'), function($id){ //make sure id exists before pushing controller. if (storage::where('shortcode','=', $id)->count() > 0) { // route found } }); how can improved? one, i'm not sure how pass processing on controller conditionally.. sort of controller::make() ..? 3) there better way in laravel check if record exists versus doing mode::where('column','=','value')->count() 4) have legacy urls http://url.com/?...
Read more

cross browser - XSLT namespace-alias Not Working in Firefox or Chrome -

-
i transforming xhtml xhtml, need xslt stylesheet part of resulting document (the stylesheet contained in <script type"text/template"> element. using the xsl:namespace-alias instruction, works fine in ie, fails in both chrome , firefox. here relevant code: <xsl:output doctype-system="about:legacy-compat" omit-xml-declaration="yes" indent="yes" method="html" media-type="application/xhml" encoding="utf-8"/> <xsl:namespace-alias stylesheet-prefix="wxsl" result-prefix="xsl" /> <xsl:template match="head"> <!-- code omitted clarity --> <script type="text/template"> <wxsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/xsl/transform" xmlns="http://www.w3.org/1999/xhtml" xmlns:xhtml="http://www.w3.org/1999/xhtml" xmlns:eli="local"> ...
Read more