Speed up Python MongoDB query -


I am new to mongodibi I am trying to read data from several collections. I want to do some statistics on GHTorrent, so I am trying to print .csv with the data that I am interested in. The problem is that my query is now running for some 30 minutes and I'm sure my search is less effective than it is, I'm not sure how to improve it.

First of all, I 

  close_issues = ghdb.issues.find ({"state": "off"}, # query criteria {# projection "id": 1 1, "number": 1,}   , "created_at": 1, "closed": 1, "comments": 1, "repo": 1, p> Then, after opening a file and typing in the headlines, I do  
  to issue in closed numbers: countMentioned = ghdb.issue_events.find ("problem": issue ['Number'], "repo": issue ['repo'], "owner": issue ['owner'], "incident": "outlined"}). Calculation (); = "Ghdb.i ['number'], "repo": issue ['repo'], "owner": issue ['owner'], "incident": "subscribed"}). count (); counted Issue ['rep'], issue ['repo'], "owner": issue ['owner'], "event": "assigned": "assigned" Time_created = parser.parse (issue ['created_at']) time_closed = parser.parse (issue ['band_at']) timediff = time_closed - time_created; + +, "+ str (issue ['id "+ str (issue ['number']) +", "+ str (issue ['repo'])," + str (issue [+ "," + str (timerfitable_seconds ()) + ", "+ Str (m Dada ['Comments']) + "," + str (Guaranteed) + "," + str (count membership) + "," + Str (countAssigned) + '\ n')   < P> As you can see, I use three out of four criteria for three different searches per problem. What is the most effective way to search for a combination of  issue_id ,  repo  and  owner  and calculate for each three different codes > Event    
 
 
 The Mongoode Aggregation Framework is a great tool for those queries that generate collected data I do like it -  
 I will start there and I would like to play with it a little bit. In this case of usage you can usually start from there and as a result you can wrap some extra code as a result of exporting the data in the format you want.

Comments

Post a Comment

Popular posts from this blog

c# - ASP.NET MVC - Attaching an entity of type 'MODELNAME' failed because another entity of the same type already has the same primary key value -

In brief, the wrapper module is inserted during posting and the status of an entry is changed to 'modified' . Before changing the state, the state is set to 'separate', but calling attachments () causes the same error to be thrown away. I am using EF 6. Model / wrapper class public class avi model {public A is a {get; Set; } Public listing & lt; B & gt; B {received; Set; } Public cc {receipt; Set; }} Administrator edit public functioning (int? id) {if (id == null) {new HttpStatusCodeResult (HttpStatusCode.BadRequest); } If (! Conveyor Access (id.Value)) new HTTPTitus code result (HTTP status code. Forbidden); Var aViewModel = new AViewModel (); aViewModel.A = db.As.Find (id); If (aViewModel.Receipt == zero) {return HttpNotFound (); } aViewModel.b = db.Bs.Where (x => x.aid == id.Value) .Oolist (); AViewModel.Vendor = db.Cs.Where (x => x.cid == aViewModel.a.cID) .FirstOrDefault (); See Return (aViewModel); } [HTPFost] [Valid AntitiferousTeacon...
Read more

jasper reports - How to center align barcode using jasperreports and barcode4j -

I use iReport 5.5.0 . How to align a barcode component to the center The relevant piece of my jrxml is below & Lt; JR: Code 128 xmlns: JR = "http://jasperreports.sourceforge.net/jasperreports/components" xsi: schemaLocation = "http://jasperreports.sourceforge.net/jasperreports/components http: //jasperreports.sourceforge Purge / xsd / components.xsd "textPosition =" bottom "& gt; & Lt; Jr: codeExpression & gt; & Lt; [CDATA [$ F {number}]] & gt; & Lt; / Jr: codeExpression & gt; & Lt; / Jr: Code 128 & gt; & Lt; / componentElement & gt; "Text" itemprop = "text"> Create a style after this, it is called "barcode", like: & lt; Style name = "barcode" fontName = "Helvetica" fONTSIZE = "10" hAlign = "center" valign = "center" /> and set the property of your barcode element to "barcode".
Read more

django - CommandError: You must set settings.ALLOWED_HOSTS if DEBUG is False -

I use Django 1.6.5 with settings in my program txsite: DEBUG = true I set the lie to debug, but when I get the runner , I get the following error: CommandError: You have to set the settings. OLOWOWHESTS If DEBUG is False I ALLOWED_HOSTS = ['127.0.0.1', 'localhost'] but I get the same error. Does anyone know this address? Try ALLOWED_HOSTS = ['*'] Less secure If you are not on a firewall or public LAN, but what I use and it works. Edit: Interestingly enough, I have to add some of my 1.8 projects, even if DEBUG = True . Why so very uncertain
Read more