Generator : Out of sample

Community Forums Forums Express Generator Generator : Out of sample

Viewing 15 posts - 1 through 15 (of 15 total)
  • Author
    Posts
  • #217220 Reply
    WassB
    Participant

    Hello,

    I watched the video tutorial, but I have a question and can’t find the answer in tutorials. I want in the Express generator, take into account an out of sample of 30% in the generator like we can do on EA Studio :

    So I have seen in the gen.setting file those commands,

    ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

    ;; Forward testing          ;;

    ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

    ; Validate strategies on new unseen data.

    use_forward_testing = false

    preload_data_bars   = 0

    ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

    ;; Out of sample            ;;

    ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

    ; Use these parameters to set the data range.

    ; The program cuts data after applying Data Horizon.

    data_start_percent = 0

    data_end_percent   = 100

     

    How can I use it to make an out of sample of 30% ? I tried “use_forward_testing = true”, “data_start_percent = 70” and “data_end_percent   = 100” (to make 30% OOS), but it seems to be not that because when I load the collection on the EA Studio, I don’t see the green part that represent the OOS.

    Do you have an idea how can I do that correctly ?

     

    Thank you,

    Regards,

    Wassim

    #217241 Reply
    Alan Northam
    Participant

    The way I do it for example is as follows: In expressgenerator I will create strategies for 01/01/2020 through 10/01/2023. Then I will import the strategies in EA Studio with the date set from 1001/2023 through today. The result is the OOS test. It will not be green but it is an OOS result since the strategy was created from 01/01/2020 through 10/01/2023 and EA Studio is testing out of that sample.

    Alan,

    #217254 Reply
    WassB
    Participant

    Ok thank you for you answer thats clear.

    I’m a big fan of automation so tell if I’m wrong but :

    If I want to do it via Express Generator, I understand that I can create strategies for 01/01/2020 through 10/01/2023, save the collection then re-use this collection using the command –input …. ^ to load it and test it on the new periode representing the OOS, that’s it ?

    I see just one problem : On EA studio I use the Monte Carlo Validation which normally is including the OOS, so it is done on the whole periode. So now with this method I will use Monte Carlo to validate the created strategies (In Sample), then use it again for the OOS simulation. Using Monte Carlo twice is equivalent to use a Monte Carlo Validation once on the whole periode ? (In Sample + Out of Sample)

    Thank you,

    Regards,

    Wassim

    #217256 Reply
    Alan Northam
    Participant

    I do the Monte Carlo using ExpressGenerator (EG).  When I import into EA Studio I do not do the Monte Carlo as it was already done in EG.  The reason I do the OOS in EA studio is because you still have to import the strategies into EA Studio to create the EAs so why not just do the OOS there.  Plus, it allows me to do various filtering on the collection to find the strategy I want to use.  Anyway, that’s the way I use it.

    Alan,

     

    #217259 Reply
    WassB
    Participant

    Ok I see. You don’t use the Monte Carlo on OOS, so you only use it once, when you create the strategies. Clear for me , thanks!

    Concerning the way I work, I try to use EA Studio as little as possible because I want to try a lots of different ways to find strategies (playing on timeframe, in sample size, indicators , selecting best profit/Rsquared etc … ). I want to find the best research method that increases the probability of finding good strategies, so I need to work fast, everything being automated as much as possible, to save time and explore as many possibilities as I can.
    And OOS was a criteria I wanted to explore 🙂

    Well that’s the way I work. 🙂
    Thank you for your answers.

    Wassim

    #217260 Reply
    Alan Northam
    Participant

    That is a good to try different things to see what works best.  Good exercise.  Happy to hear you are being creative and not just following what someone else does.  Good job.

    Alan,

    #218932 Reply
    WassB
    Participant

    Yes thanks !

    So how to use those settings :

    ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

    ;; Out of sample ;;

    ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;

    data_start_percent = 0

    data_end_percent = 100

    What are they for ?  I’m not sure to use it in a the good way. Anyone know how to use it?

     

    Thanks,

    Rds,

    Wassim

    #218937 Reply
    Alan Northam
    Participant

    Lets say you have the horizon settings set to great strategies from January through October a period of 10 months.

    With Out of sample set to data_start_percent = 0 and data_end_percent = 100 then EG will use all 10 months to create strategies.

    Now with Out of sample set to data_start_percent = 10 and data_end_percent = 90 then EG will use 8 months from February through September to create strategies with January and October not being used in creating strategies.  These two months are not in the sample being used to create strategies, therefore, they are out of sample.

    Test it and while EG is creating strategies you can view the range of dates it is using.

    Alan,

    #218959 Reply
    WassB
    Participant

    Alan, thank you for your quick and clear responses, I appreciate. I just ran the test, and it works as you explained.

    Do you know if there is an automatique check for Acceptance Criteria on the Out of Sample part?

    For example I run the generator for the dates : 01/01/2023 to 01/10/2023 with data_end_percent = 70, so it creates strategies from 01/01/2023 to ~01/07/2023. Then is there a check of acceptance criteria on the period 01/07/2023 to 01/10/2023 ?

    Thanks,

    Rds,

    Wassim

    #218965 Reply
    Alan Northam
    Participant

    Only the in sample date range will have Acceptance Criteria applied!

    Alan,

    #218978 Reply
    WassB
    Participant

    Ah ok so It’s not like in EA Studio where you can add different acceptance criteria between In-Sample and Out-of-Sample date range.

    Thank you,

     

    Wassim

    #218981 Reply
    Alan Northam
    Participant

    To do this in EG you would have to take the collection and run it during the OOS time period (example 80% to 100%) to test against Acceptance Criteria.  You may have to change some Acceptance Criteria settings such as minimum count of trades may not be met over a short OOS time period.

    Alan,

    #219009 Reply
    WassB
    Participant

    Ok so I will do that.

    Thank you!

    Rds,
    Wassim

    #477532 Reply
    kooooooo
    Participant

    KJC định vị mình như một liên minh giải trí số, tập trung vào việc xây dựng môi trường cá cược minh bạch, an toàn và lấy người dùng làm trung tâm. Hệ sinh thái được mở rộng với nhiều sản phẩm từ thể thao, casino trực tuyến đến slot đổi thưởng, mang lại trải nghiệm đa dạng cho người tham gia. Nền tảng được tối ưu vận hành ổn định trên nhiều thiết bị, kết hợp cùng hệ thống bảo mật nhiều lớp nhằm đảm bảo an toàn dữ liệu. Bên cạnh đó, KJC duy trì dịch vụ hỗ trợ chuyên nghiệp và liên tục cải tiến để đáp ứng nhu cầu giải trí ngày càng cao của người dùng.
    Thông Tin Liên Hệ
    Thương hiệu: KJC
    Website: https://kjc.farm/
    Email: [email protected]
    Hotline: 0902 765 214
    Địa chỉ: 198 Võ Thành Trang, Phường 11, Tân Bình, TP. Hồ Chí Minh, Việt Nam
    Zipcode: 700000
    Hashtags
    #kjc #kjccasino #slotgamekjc #nhacaikjc #dangkykjc

    #477627 Reply
    ybweb2026
    Participant

    亚博体育 ( https://yb-web.com/ ) 是一家专注于提供全球体育赛事资讯与体育娱乐的综合平台。平台致力于为广大体育爱好者带来内容丰富、形式多样的服务体验。无论您是足球爱好者、篮球粉丝,还是关注网球、高尔夫等其他体育项目,亚博体育都能满足不同用户的观赛需求。平台不仅整合多样化的赛事资讯,还通过互动功能提升用户参与感,使用户能够与其他球迷共同交流赛事观点、分享观赛体验。亚博持续优化内容结构与使用体验,满足来自不同地区体育爱好者的多元化需求。亚博体育致力于让每一位用户都能享受到高品质的体育娱乐体验。

    #亚博 #亚博体育 #亚博体育 #亚博体育官网 #亚博体育app #亚博体育网址 #亚博体育平台

Viewing 15 posts - 1 through 15 (of 15 total)
Reply To: Reply #218932 in Generator : Out of sample

Scroll to Top