Multi threading URL requests in downloader

Multi threading URL requests in downloader

chaz
2011-11-16 06:06:28

HI QS,
I've go well working downloader but it is single threading ie next url request is started once previous is completed.

My script is using QS functions:
Functions.AddURL("http://www.nasdaq.com/aspx/nlstrades.aspx?symbol=&selected=DB"," Loading DB");
Functions.AddURL("http://www.nasdaq.com/aspx/nlstrades.aspx?symbol=&selected=DE"," Loading DE");
.
.
.
Functions.AddURL("http://www.nasdaq.com/aspx/nlstrades.aspx?symbol=&selected=DO"," Loading DO");
Functions.AddURL("http://www.nasdaq.com/aspx/nlstrades.aspx?symbol=&selected=DD"," Loading DD");

resident in Downloader->Settings->Create URL-Script

I increased value of "Maximum number of threads to allow" from 1 to 8 in "Download Setings" but it has no effect.

Should I use different function or different dwnloader section?
Example of piece of script would be best.

Thx in advance,
Chaz

QuantShare
2011-11-16 06:33:32

Best Answer

You should add the URL in the "Update Download Item" form.

Example, add the following URL:
http://www.nasdaq.com/aspx/nlstrades.aspx?symbol=

Create a new field:
Field: selected
Value: AA (This value is updated later with the selected symbols in the downloader control)
Type: Symbol

Get more messages

No more messages

Back


Trading Items Metatrader Historical Data Downloader Quandl.com Universal Downloader Economic Series Downloader Tiingo IEX Intraday Downloader CryptoCompare Daily Downloader	How-to Lessons How to automatically start a downloader every few minutes? How to debug a downloader How to download EOD quotes for active and valid stocks only How to download historical quotes of indices How to automate the data downloading process
Related Forum Threads Unable to use Symbols.GetSymbols() in a custom downloader URL scr... Downloader for delisted symbols Finviz Downloader Problem with the "Individual stocks put and call volume" download... Downloader ISSUES- NO ERRRORS REPORTED	Blog Posts How to download the history of dividend payments for stocks in th... How to Automatically Import Local Data Into QuantShare German Stock Exchanges: 5 free ways to download historical EOD/In... Getting Accurate Backtesting Results: Survivorship bias-free S&P ... Step by step on how to get free realtime/delayed data for stocks,...