Difference when testing Tick Data Vs 1min forexrite
-
- Posts: 60
- Joined: Tue Aug 10, 2010 8:39 pm
Difference when testing Tick Data Vs 1min forexrite
Hi Guys,
I recently purchased premium tick data from my FT2 - and problem is, that when I ran the systems I built with the tick data, the result vs the 1min historic data (forexrite) is completely different. So much so that a winning system becomes loosing. I am concerned because I am live trading 2 systems that I have built over a year ago each.
My systems are not sensitive , i.e stoplosses = 20 pips. so that shouldnt be the problem.
I am confused as to why this would happen - anyone else had this experience.
I recently purchased premium tick data from my FT2 - and problem is, that when I ran the systems I built with the tick data, the result vs the 1min historic data (forexrite) is completely different. So much so that a winning system becomes loosing. I am concerned because I am live trading 2 systems that I have built over a year ago each.
My systems are not sensitive , i.e stoplosses = 20 pips. so that shouldnt be the problem.
I am confused as to why this would happen - anyone else had this experience.
-
- Posts: 60
- Joined: Tue Aug 10, 2010 8:39 pm
MIKE-
Ok - SO I wanted to quantify the difference for you:
First of all - I used FXDD tick data (FXDD)/ Forexrite 1 min data (FXR) / Dukascopy historical tester tick data (DUK).
The system is basic logic - on FXDD and FXR the system code is identical. The logic of the DUK code is the same, different code (java).
All three were set to Jan 2011 - Jan 2012 (365 days)
NUMBER OF TRADES
FXDD - 84
FXR - 78
DUK - 141
% return
FXDD - -54.93%
FXR - 1124.93%
DUK - -56.9%
So what I can see is that the forextester data is completely different to the broker backtest. Also the 2 forextester backtests are totally different - same system settings.
The forexrite data was just imported (no timeshift, just download and generate ticks). This is the same for the FXDD data (no timeshift, just download and generate ticks).
I am expecting slight differences between data & platform - but not HUGE differences. This completely invalidates my LIVE systems. Also this creates trust issues with the forextester software - I no longer know if I can use your tool to develop trading systems accurately. It looks as though the FXDD and DUK results are similar - however there are 60 TRADES difference!!!!!!
If this is an issue with how I am downloading the data - let me know (should I timeshift & ignore weekends?)
Please guide me!
Ok - SO I wanted to quantify the difference for you:
First of all - I used FXDD tick data (FXDD)/ Forexrite 1 min data (FXR) / Dukascopy historical tester tick data (DUK).
The system is basic logic - on FXDD and FXR the system code is identical. The logic of the DUK code is the same, different code (java).
All three were set to Jan 2011 - Jan 2012 (365 days)
NUMBER OF TRADES
FXDD - 84
FXR - 78
DUK - 141
% return
FXDD - -54.93%
FXR - 1124.93%
DUK - -56.9%
So what I can see is that the forextester data is completely different to the broker backtest. Also the 2 forextester backtests are totally different - same system settings.
The forexrite data was just imported (no timeshift, just download and generate ticks). This is the same for the FXDD data (no timeshift, just download and generate ticks).
I am expecting slight differences between data & platform - but not HUGE differences. This completely invalidates my LIVE systems. Also this creates trust issues with the forextester software - I no longer know if I can use your tool to develop trading systems accurately. It looks as though the FXDD and DUK results are similar - however there are 60 TRADES difference!!!!!!
If this is an issue with how I am downloading the data - let me know (should I timeshift & ignore weekends?)
Please guide me!
- Attachments
-
- forexrite1min.jpg (410.11 KiB) Viewed 26659 times
-
- FXDDtick.jpg (393.71 KiB) Viewed 26659 times
-
- dukascopyhistoricaltic (1).jpg (85.24 KiB) Viewed 26659 times
-
- Posts: 60
- Joined: Tue Aug 10, 2010 8:39 pm
Now I have imported 1m Dukascopy data, same year - same system - same setting. Different Results!
The variance between data is too big. I am confused as to what I can do to fix this issue.
So.. I guess the question is - what do I have to do to get a reliable result I can trust?
The variance between data is too big. I am confused as to what I can do to fix this issue.
So.. I guess the question is - what do I have to do to get a reliable result I can trust?
- Attachments
-
- dukascopyimport.jpg (444.46 KiB) Viewed 26644 times
-
- Posts: 60
- Joined: Tue Aug 10, 2010 8:39 pm
Hello FXHelper,
I'll send you my strategy via PM - regarding the Data - for a start use the FXDD VIP tick data (year 2011-2012) vs the standard forexrite 1min data (year 2011 - 2012).
Also is there a way I can import tick data from dukascopy? This is most probably the data I want to use as this is my broker
I'll send you my strategy via PM - regarding the Data - for a start use the FXDD VIP tick data (year 2011-2012) vs the standard forexrite 1min data (year 2011 - 2012).
Also is there a way I can import tick data from dukascopy? This is most probably the data I want to use as this is my broker
-
- Posts: 1479
- Joined: Mon Apr 01, 2013 3:55 am
-
- Posts: 60
- Joined: Tue Aug 10, 2010 8:39 pm
Hello FXHelper,
Thank you for your response - I have changed the system so that it isnt using POINT but definined as 0.0001 - I have tested again across FXD and FXR and the results are still polar opposite. This is the same case with MANY of my systems - hence why it is such a big issue.
I will PM you the modified system code - please help explain why there is a huge difference between different data sets.
Thank you for your response - I have changed the system so that it isnt using POINT but definined as 0.0001 - I have tested again across FXD and FXR and the results are still polar opposite. This is the same case with MANY of my systems - hence why it is such a big issue.
I will PM you the modified system code - please help explain why there is a huge difference between different data sets.
- Attachments
-
- FXRa.JPG (73.26 KiB) Viewed 26614 times
-
- FXDDa.JPG (77.43 KiB) Viewed 26614 times
-
- Posts: 1479
- Joined: Mon Apr 01, 2013 3:55 am
Hello,
Your strategy is too sensitive to the small price changes and small difference between price and Envelopes indicator. Here is an example (on the screenshot below):
Forex Tester with tick data opened an order because the price nearly crossed Envelopes_bottom_line and crossed in terms of your strategy (current bar Close was smaller then previous Envelopes_bottom_line value). And with Forexite data order wasn't opened because the price didn't cross the Envelopes_bottom_line. And there are many such differences during the long test and this is the reason why you see big difference in testing results.
So there is not a bug of Forex Tester but this is how this particular strategy works. Forex Tester just performs the algorithm and there isn't its fault.
Your strategy is too sensitive to the small price changes and small difference between price and Envelopes indicator. Here is an example (on the screenshot below):
Forex Tester with tick data opened an order because the price nearly crossed Envelopes_bottom_line and crossed in terms of your strategy (current bar Close was smaller then previous Envelopes_bottom_line value). And with Forexite data order wasn't opened because the price didn't cross the Envelopes_bottom_line. And there are many such differences during the long test and this is the reason why you see big difference in testing results.
So there is not a bug of Forex Tester but this is how this particular strategy works. Forex Tester just performs the algorithm and there isn't its fault.
- Attachments
-
- example1.png (14.21 KiB) Viewed 26431 times
-
- Posts: 60
- Joined: Tue Aug 10, 2010 8:39 pm
Yes - agree with this system it is too sensitive. I've just ran through another system - Forexrite vs Dukascopy 1m data - very large difference again. This system is not so sensative - 15min data, 20 pip stoploss.
Do you want me to send that to you also - or..
I guess the alternative is - to build everything in dukascopy data, and stay away from anything which is towards scalping or fast indicators?
Do you want me to send that to you also - or..
I guess the alternative is - to build everything in dukascopy data, and stay away from anything which is towards scalping or fast indicators?
-
- Posts: 905
- Joined: Sat Jul 11, 2009 10:54 am
Who is online
Users browsing this forum: No registered users and 25 guests