Importing large csv - Trading Software

Importing large csv

Trading Software
2010-06-07 08:33:32

Hi,

I have tried to import a large csv file (230 mb). This seems to freeze my computer. I believe the import process use too much ram (~ 1GB?).

The solution I found was to split the big file into smaller chunks, which works fine, except that I have to import each one manually.

Is there a way to import multiple individual files automatically, or via script?
*Note that adding all the files to the 'import list' will cause the same freezing issue as having one big file. *

cheers.

QuantShare
2010-06-08 13:59:53

Best Answer

Hi,

We have made a change in the code and you should be able to import a 200mb file now.
The change will be available in the next release

Trading Software
2010-06-09 05:49:41

Cool!

The same problem also occurs with a large number of small files. Will the change also fix this?

cheers.

QuantShare
2010-06-09 06:53:47

Yes, it will

Get more messages

No more messages

Back


Trading Items Large Block Ratio Indicator Portfolio Statistics to CSV File Large price and volume gain after consolidation Ratio of Small Cap to Large Cap Stocks MICEX Index - Market Data	How-to Lessons How to import trading data from CSV files How to export trading data to a CSV file How to quickly select stocks based on the last value of a databas... How to import trades into a portfolio How to add trades from one portfolio to another one
Related Forum Threads Custom Date Format When Importing Data from CSV How to import Bid, Ask and Trade ticks from CSV file? importing sectors and industries Export to CSV the whole database including symbols update a new symbol from a csv file	Blog Posts 10 ways to download historical stock quotes data for free Real-Time Quote Sheets with QuantShare How to Automatically Import Local Data Into QuantShare Running QuantShare on Amazon's EC2 Cloud & Automate Strategies Si... 6 ideas to implement in your portfolio to reduce your trading ris...