Home › Forums › Trading System Mentor Course Community › Performance Metrics & Brag Mat › Selection bias – how much is too much and general MOC discussion
- This topic is empty.
-
AuthorPosts
-
May 27, 2017 at 5:25 am #106982ScottMcNabParticipant
Found Said’s positionscore formula again..please ignore above post
May 30, 2017 at 12:00 pm #106983ScottMcNabParticipantSorry for rambling on group call…will try and explain it here…(with more rambling)
When thinking about selection bias , I tested using open<=buylimit (would require a limit on open order) The first impact is a significant reduction in selection bias by dropping the number of possible buy orders each day. The second impact on system metrics, which I did not explain well, was not in reducing the selection bias further but looking at the potential impact of selection bias on backtest results. This type of entry (open <=buylimit) may make the backtest results more closely aligned with live results on those days when buysignals outnumber positions available. In currect MOC systems, my understanding is that a random selection of possible stocks are selected by Amibroker when in reality (as per Nick's posts and modules) this is not the case when using buylimit orders with EOD data. If a limit on open order is used, then the live results and the backtest results should both be selecting stocks on a "random" basis on these rare days when buysignals outnumber positions available. Going forward, the two results (backtest v live) should be more closely aligned (I think ?) The reason I brought it up in the online call in the first place was I thought it may be of interest to some who had tossed out some of their MOC systems due to problems with selection bias. Try changing entry to:
LE = Ref(buysetup,-1) AND open<=Ref(buylimit,-1) AND NOT OnLastTwoBarsOfDelistedSecurity ;
LEPrice = open;Maybe some of those discarded systems can be resurrected ? For those not on the call, Nick mentioned there are hurdles trying to trade this way (gap down on open) so it may not work live still
Clear as mud ?
May 30, 2017 at 3:33 pm #107025SaidBitarMemberClear
but for this to be aligned with reality in your trading you should cancel all the orders that are not filled on the open
May 30, 2017 at 7:58 pm #107026ScottMcNabParticipantYep..limit on open order does this for you
May 30, 2017 at 9:37 pm #107028Nick RadgeKeymasterYes, this would be a Fill or Kill order.
In essence the system is a little different in my opinion, i.e. the buy limit price is not really the buy limit – its a hurdle where the actual but price must be below…semantics is all.
Essentially the system is buying on an opening gap below that hurdle price. If no buy activated, all orders are immediately cancelled.
I like the idea. Would stop indiscriminate fills on a large trend day to the downside.
As stated in the call I used to trade an opening gap system across all Asian futures markets. My research showed that Asian futures tended to ‘over react’ to a down session in the US and therefore tended to rally off that open.
May 30, 2017 at 11:17 pm #107029JulianCohenParticipantInstead of using LOO orders the API could be set to cancel any unfilled orders at open time + n minutes. That should be an easy code fix.
May 31, 2017 at 8:26 am #107031ScottMcNabParticipantJulian Cohen wrote:Instead of using LOO orders the API could be set to cancel any unfilled orders at open time + n minutes. That should be an easy code fix.Sounds good…what would you give it…1 or 2 min ?
June 13, 2017 at 9:50 am #107032JulianCohenParticipantScott McNab wrote:Julian Cohen wrote:Instead of using LOO orders the API could be set to cancel any unfilled orders at open time + n minutes. That should be an easy code fix.Sounds good…what would you give it…1 or 2 min ?
Sorry Scott I just saw this.
I’d give it 1 min after the opening auction, whatever time that is.
June 13, 2017 at 12:49 pm #107128ScottMcNabParticipantThanks Julian…drifted away from this idea temporarily as I’ve become engrossed testing momentum (roc) with rotational trading systems..they seem incredibly robust (and no friggin selection bias!)…..would still be nice to trade a limit on open system (for want of a better name) as discussed above for the additional diversity …will add it to the list for further research !
June 14, 2017 at 2:16 am #107129JulianCohenParticipantIt’s an ever growing list
August 30, 2017 at 2:01 am #105777ScottMcNabParticipantAugust 30, 2017 at 3:27 am #107491ScottMcNabParticipantNagging feeling I’ve forgotten something crucial about positionscore…does it only use abs value ?…so I would need to differentiate those days when close
open to make sure get worst days ? August 30, 2017 at 4:42 am #107492ScottMcNabParticipantPositionScore = IIf(Close
August 30, 2017 at 4:55 am #107495JulianCohenParticipantScott McNab wrote:PositionScore = IIf(CloseI’m going cross eyed reading that. This is a job for Super Craig….
August 30, 2017 at 5:09 am #107497TrentRothallParticipantSorry guys been MIA a bit the last few weeks.
I agree with Julian i can’t think while looking at that. What’s the logic scott?
AuthorPosts- You must be logged in to reply to this topic.