Community Forums › Forums › EA Studio › EA Studio Tools and Settings › EA Studio Tools and Settings: Experience and Results
Tagged: #acceptance criteria, EA Studio, FTMO-Data
- This topic has 286 replies, 38 voices, and was last updated 1 year, 6 months ago by
Alan Northam.
-
AuthorPosts
-
August 4, 2022 at 2:27 pm #120764
Alan Northam
ParticipantHi Samuel,
I will answer your above questions.
First of all I took all 440 robots generated to date and ran them through the Validator with the normal settings and came up with a nice small pool of 42 robots. I will continue to generate more robots to add to this pool each day. I can now further filter this pool of robots to chose those to add to my portfolio of 10 MT4 accounts.In addition to generating my own robots I have a few courses from Petko where I get an assortment of robots he has generated each month.
Now that I have run the Reactor several times since all the issues have been resolved I will be adding more Reactors over the next several days to see how many Reactors I can run at one time without reducing the number of robots generated per minute.
Right now I am generating on average 1200 robots per minute. Also, I am collecting on average 8 robots per hour.
August 4, 2022 at 9:03 pm #120787Samuel Jackson
MemberThat all sounds great Alan, you are well on your way now :-).
Glad we got it resolved eventually. Was a puzzler for a while there!
In my experience each extra reactor will slow down things a little bit but there is a sweet spot, for example adding a second might mean that each reactor generates 1000 a minute which means combined you are getting 2000 a minute, a third might reduce this the each getting 800 a minute which is still 2400 combined so an over all improvement but then suddenly a 4th might slow it down more considerably to only getting 500 a minute and then thats 2000 combined and so the sweet spot is 3 reactors.
August 5, 2022 at 3:00 am #120794Alan Northam
ParticipantI have a question: When I run the Reactor and collect 40 robots and then run those 40 robots through the Validator is then collects something like 34 robots. The Validator is using the same filters as the Reactor. I would have expected all 40 robots to pass through the Validator. What is going on?
August 5, 2022 at 10:17 am #120810Samuel Jackson
MemberHey Alan,
If you are using the Monte Carlo on the validator then that is what is going on. There is randomness in the Monte Carlo sometimes s strategy may just pass the 80% threshold and sometimes it may just fail it for example. But that’s okay the 34 going through are only the ones that have passed the Monte Carlo twice 🙂
August 5, 2022 at 2:18 pm #120813Alan Northam
ParticipantYes the robots are going through the Monte Carlo twice.
August 5, 2022 at 2:47 pm #120815Alan Northam
ParticipantI have another question:
I have Reactor Collections for several days now. Should I further filter them by combining them together in the Validator? How do you handle Many days of Collecting robots?August 5, 2022 at 8:31 pm #120821Samuel Jackson
MemberYes combining them by running through validator is a good idea. Mainly because it will remove correlations and duplicate strategies and also it’s good to run the Monte Carlo a second time. But even if not running a second Monte Carlo and just running through the acceptance criteria the validator will trim out the correlated strategies that wouldn’t have been collected had they all been generated in a single reactor.
August 5, 2022 at 10:07 pm #120830Alan Northam
ParticipantHi Samuel,
Yes that was my thinking to run them all through the Validator at one time to remove correlations. I am also thinking that it puts the best strategies at the top of the list. And, it also allows me to further filter the complete collection so I can find the best 10 robots to use.
Do you normally use the Multmarket and Walkforward after you have selected the best robots to use before live trading or do you just use the Monte Carlo?
August 6, 2022 at 7:14 am #120841Samuel Jackson
MemberYep Alan, that’s the way to use the validator to organize your collections and yes also combining in this way will be the best point to sort and filter the final 10.
For general robustness the Monte Carlo is enough.
Unless you are trying to target something specific with the Multimarket or Walk forward validations but otherwise Id just stick to Monte Carlo. That’s what I do.
It sounds like you are building up your pool of strategies nicely now right?
August 7, 2022 at 2:49 am #120862Alan Northam
ParticipantToday I ran a test of my two laptops. I ran the EA Studio Reactor for 60 minutes using my normal settings. The following is the results:
Main laptop
System: 4 core, CPU 2.80GHz, 16.0GB
60 minutes, Generator = 114358, Collected = 2
60 minutes, Generator = 116435, Collected = 5
60 minutes, Generator = 115576, Collected = 3
60 minutes, Generator = 114678, Collected = 3
60 minutes, Generator = 116109, Collected = 8
Average: 4 robots collected per hourSecond laptop
System: 4 core, CPU 1.6GHz, RAM 20.0GB
60 minutes, Generator = 57265, Collected = 3
60 minutes, Generator = 50597, Collected = 5
60 minutes, Generator = 48698, Collected = 3
60 minutes, Generator = 49929, Collected = 3
60 minutes, Generator = 48915, Collected = 2
Average: 3 robots collected per hourWhat I noticed is that the CPU speed is important in hour many robots are generated per hour. However, what was a surprise to me was that the only difference in how many robots actually pass all the filtering is 1 robot per hour (4 vs 3).
My next test will be to see how many robots (EA’s) are collected per hour when I run 2 Reactors on each laptop.
August 7, 2022 at 11:37 pm #120913Samuel Jackson
MemberHey Alan that is all sounding good and yes now the next step is to see how many reactors is optimal for each machine. I am guessing 3-4.
The number generated is the most important bit here, I’m sure if you left the above test running longer then difference in the number collected gap would widen but then also as you get more strategies the likelihood of correlated strategies not making it through increases. Main point is all is looking well now and you are fine tuning and starting to get to work on your personal pool of robots 🙂
August 13, 2022 at 3:36 pm #121212Alan Northam
ParticipantIn the “EA Studio Professional Course” in the section called “The Pool” Petko talks about when he has collected too many strategies he further filters them in the Validator. Unfortunately, Petko skips over how he further filters strategies when there are too many to handle. It is the middle of the month of August and I have been running the Reactor twice every day on two laptops and I am already getting a very large amount of strategies. By the end of the month I will be over burdened with strategies. How is the best way to further filter all these strategies so I have a nice collection for August?
August 14, 2022 at 1:39 am #121255Samuel Jackson
MemberHi Alan, having too many strategies really isn’t much of a problem. But lets say the you are aiming for roughly 1000 strategies in your pool per symbol timeframe pair.
If at the end of the month you have 2000 and want to trim a bit you could load your existing collections into the validator in chunks to get the best 250-300 and then just keep the final 3-4 collections that come out of the validator. Also as you will be moving the validator end date forward a month some may just naturally fail the acceptance criteria and if you are getting too many passing you can simply increase the acceptance criteria a little and filter the top 300 however you want when you run them through the validator.
How many strategies are you expecting to have??
August 14, 2022 at 3:42 pm #121304Alan Northam
ParticipantRight now I have 1521 strategies (EURUSD M15) for the month of August and the month is only half over so I could end up with 3000 strategies by the end of the month.
August 14, 2022 at 11:08 pm #121327Samuel Jackson
MemberIt’s not really a problem having so many strategies, it will help you find strategies faster as you are able to skip the generator having to find strategies from scratch. Just make sure to keep them tidy I guess.
What about other pairs and timeframes? You should focus on building these up if you are approaching too many for EURUSD M15.
Also once you have a big collection this will allow you to run the reactor less often and just use the validator going forward to ensure your pools keep passing the validator settings or also if you decide to change your strategy requirements by modifying the acceptance criteria you will have a large group of strategy’s to begin with.
I would pick the pairs and symbols that you want a pool for, build each up and then going forward use the validator to maintain and keep current and the Reactor to top up as needed going forward.
-
AuthorPosts
- You must be logged in to reply to this topic.