When Stress testing should we divide our data into in sample/out of sample for all tests and run the tests on both sets, or is insample/out of sample mainly used for optimization?
In sample / out sample is mainly done for optimisation. However, stress testing considers rolling window analysis which is basically looking at different periods of time. It’s not necessarily used to discount a system per se, more so to understand what the system can go through in smaller time windows.