I have multiple variations of an automated strategy for trading certain investment vehicles. For each of these variations I have cross-validated backtests on historic data. I need to pick the best-performing test. There is significant variation between the tests in terms of trades per day, net position size, etc. This makes it difficult to compare one to another.
The nature of the test relies on the predictions of a multidimensional nearest-neighbor search.
Having been recently acquainted with R, I am looking for packages/functions/tests to help me analyze various elements of my strategies' performance. Particularly, I am interested in two things: 1. Packages/functions/metrics that gauge the efficacy of my predictor. 2. Packages/functions/metrics that gauge the relative "profitability" of one variation to another.
If you know something that I should take a look at, please do not hesitate to post it!