Click here to Login





                                                   Rules manager - comparing results - back testing vs rules analysis

  1

0
GS
2012-09-02 08:19:46


Hi,

I am trying to analyze the performance of rules using rules manager and trying to compare it with the one I see using "Simulate/Backtest". This is because, using simulation/backtest, I will not be able to see:

A) total how many signals are generated using a given rule/strategy
B) out of these signals, how many were having highly successful trades (in terms of % return)
C) had I executed all the signals, what would have been the percentage of successful trades

I also observed that the performance of back testing highly depends upon when we are starting the back testing. For example if I am starting the back testing on 1st of a given month and compare it with that when I start on 15th of that month, the performance would very and it is natural and reason is obvious. However, for an individual it is important to know what percentage of his rules are always profitable and overall returns should not have too much of dependency on entry time.

Therefore using rules manager, how do I understand A,B and C? Also, in "simulate/backtest" do we have any way to automatically change the date and time of entry and see how is the performance of a strategy?

For that I tried the following:

Optimize("dd",1,31,1);
SetSimPeriods(2012,1,dd,2012,9,2);

But I could not see any change in the output for different values of "dd". But if I manually change "dd" from 1 to 2, 3, 4, 5 etc., there is difference. Why so?

Within "Optimize" of "simulate/backtest" I could see " buy/sell/long/short timing decalage", what exactly is this function? I could see huge variation in output during its optimization.

Thanks,



John Lyons
2012-09-02 19:34:52

  0

Great question. I will be watching for replies on this also.


QuantShare
2012-09-03 11:27:02

  1

Best Answer
-> how do I understand A,B and C?

Unlike the backtester, the rules manager executes all signals generated for a given security. If at a given date there are 100 signals then they are all considered.

-> In "simulate/backtest" do we have any way to automatically change the date and time of entry and see how is the performance of a strategy?

You can use the money management script for this. I will upload a script that performs exactly that.
You cannot optimize values of the "SetSimPeriods" function.

-> Within "Optimize" of "simulate/backtest" I could see " buy/sell/long/short timing decalage", what exactly is this function?

This is the number of bars to wait before executing an order (Close at market, tomorrow + N)




GS
2012-09-03 11:59:59

  0

Thanks a lot, I now look forward to use the money management script you are referring to.

Best regards.



allan nathan
2012-09-04 02:16:40

  0

Hi,
that was really helpful.I didnt fully understand the rules manager till now.Is it possible to run the rules manager on the various money managemnt scripts you have provided??



QuantShare
2012-09-04 10:25:26

  0

No, money management scripts work only with the backtester. The rules manager performs simple calculations. It takes a security on signal date (when rule is true), calculates the output value for each signal then calculates the average.



Seeker
2014-12-02 02:52:53

  0

"You cannot optimize values of the "SetSimPeriods" function" - it would have been extremely handy if this was optimizable as quite often during backtests, we have to manually do for various periods. For example, Nov 2013 to Nov 2014 and then Nov 2012 to Nov 2013 going back one year each.


QuantShare
2014-12-03 03:17:10

  0

This will be implemented soon.


No more messages
0




Reply:

No html code. URLs turn into links automatically.

Type in the trading objects you want to include: - Add Objects
To add a trading object in your message, type in the object name, select it and then click on "Add Objects"










QuantShare

Trading Items
DeMark DeMarker Trading Rules
Trading rules using the VIX Index
Price Channel Trading Rules
The Best trading rules for the ADX technical indicator
Simple pattern detection rules using close and open prices

How-to Lessons
How to create trading rules based on Put and Call volume data
How to perform a basic quantitative analysis using the S&P 500
Difference between the watchlist and the screener tools
How to create a screen
How to set order type of a trading system programmatically

Related Forum Threads
Regarding rules manager
Testing Rules with AI Optimizer
Rules Manager, Calculating Statistics
Request: Example of Custom Metrics addition into Rules Analyzer
Add'l Fields in Rules Analyzer Output

Blog Posts
How to use date components in your trading rules
Optimization of trading rules
How to create and backtest thousands of trading rules in less tha...
Rules performance for different volatility regimes
Introduction to the trading rules analyzer









QuantShare
Product
QuantShare
Features
Create an account
Affiliate Program
Support
Contact Us
Trading Forum
How-to Lessons
Manual
Company
About Us
Privacy
Terms of Use

Copyright © 2024 QuantShare.com
Social Media
Follow us on Facebook
Twitter Follow us on Twitter
Google+
Follow us on Google+
RSS Trading Items



Trading financial instruments, including foreign exchange on margin, carries a high level of risk and is not suitable for all investors. The high degree of leverage can work against you as well as for you. Before deciding to invest in financial instruments or foreign exchange you should carefully consider your investment objectives, level of experience, and risk appetite. The possibility exists that you could sustain a loss of some or all of your initial investment and therefore you should not invest money that you cannot afford to lose. You should be aware of all the risks associated with trading and seek advice from an independent financial advisor if you have any doubts.