python - Scrapy - Load a yaml file with a relative path inside the spider -


I am trying to implement my scrapy crawlers , but the problem is that my Pass yaml file is that I am trying to load from inside the , it works when the spider is loaded from the shell: scrapy crawl & lt; spider-name & gt; . But when the spider is deployed under scrapyd , the path of the yaml file should be complete .

The relative path for code> has been posted on on scrapyd : 

  scrapyd-deploy default -p & Lt; project-name & gt; Curl http://127.0.0.1:6800/schedule.json -d project = & lt; Project-name & gt; -D spider = & lt; Spider-name & gt;   
 and the  yaml  file is loaded as:  
  open ('../categories.yaml', 'r') F: Pass    
 
 The 
 relative path is relative to the current working directory (the directory that started with your script). If you want to load a file from a path relative to the current script location, then you can try the following:  
  root_dir = os.path.abspath (os.path.dirname (__ file__) ) yaml_pass = OS path.join (root_dir, '../categories/categories.yaml') with open (yaml_path, 'r') f: pass

Comments

Post a Comment

Popular posts from this blog

Verilog Error: output or inout port "Q" must be connected to a structural net expression -

I get the error every time, I try to compile. I'm not sure why anyone can help is? I'm new to verilog. Module D_FF (clerk, d, reset_n, q); Input D, Clack, reset_en; Output Q; reg Q; lab4_gdl f1 (.lk (~ clk), d (d), .q.m (qm)); lab4_GDL f2 (.Clk (Clk), D (QM), .Q (Q)); Always start at @ (posedge clk, neggeous reset_n) (Reset_n == 0) Q & lt; = 0; Other questions & lt; = D; Edit End: The problem is what we are asking to do: In this section, you apply the memory / registration circuit on the AlterEdie 2 board. will do. The circuit has the following specifications: The present value of swift SW15-0 on the D2 board should be shown in four hexadecimal four sections of HEX3-0. This part of the circuit will be combination logic. To use an active-less asynchronous reset and KEY1 to use KEY0 as the clock input, you must store SW15-0in in a 16-bit register in the value The register should be enabled to have a 16-bit positive edge, which uses the embedded D flip-flo...
Read more

Installing croogo for cakephp -

I'm new to the keyboard, I want to install Crogo in KKPP 2.3. My question: The way to extract the file is: - Changing cakephp2.3 / app / plugging / folder in app (do not work. Error admin controller not found) or - CakePP-2.3.3 / app / (Not working ). Sorry for my bad english language: (please help me and thank you.) crogo a cms by kcfp has been developed ... meaning kkfp is already there .. just Croogo Download and read their documentation ... and try Google about some CMS ...
Read more

c# - ASP.NET MVC - Attaching an entity of type 'MODELNAME' failed because another entity of the same type already has the same primary key value -

In brief, the wrapper module is inserted during posting and the status of an entry is changed to 'modified' . Before changing the state, the state is set to 'separate', but calling attachments () causes the same error to be thrown away. I am using EF 6. Model / wrapper class public class avi model {public A is a {get; Set; } Public listing & lt; B & gt; B {received; Set; } Public cc {receipt; Set; }} Administrator edit public functioning (int? id) {if (id == null) {new HttpStatusCodeResult (HttpStatusCode.BadRequest); } If (! Conveyor Access (id.Value)) new HTTPTitus code result (HTTP status code. Forbidden); Var aViewModel = new AViewModel (); aViewModel.A = db.As.Find (id); If (aViewModel.Receipt == zero) {return HttpNotFound (); } aViewModel.b = db.Bs.Where (x => x.aid == id.Value) .Oolist (); AViewModel.Vendor = db.Cs.Where (x => x.cid == aViewModel.a.cID) .FirstOrDefault (); See Return (aViewModel); } [HTPFost] [Valid AntitiferousTeacon...
Read more