I am using Vanity gem and have the basics of experiments & metrics set up fine. I was wondering if anyone has tried to extend it to set up experiments themselves via records in a database.
It seems to me that Vanity is built to initialize its experiments during the app's boot, so this might be working against the design of the tool.
As background, I see myself using this for two distinct kinds of experiments: (1) UX changes that requires a Rails/Javascript developer, and (2) changes of Images and copy which require simply a switch in my custom-built CMS.
Vanity works well for #1, but for #2 I want the admin users of my site to be able to create experiments without involving a Rails/Javascript dev and without deploying code. I could easily implement the switch pull the right content myself, but I'm not sure how Vanity will feel about having experiments defined in a database?
