ExperimentPilot is a free online platform for adaptive experimentation. ExperimentPilot allows users to design, run, and monitor experiments with complex adaptive treatment assignment policies in a simple online interface.
Researchers or businesses conducting experiments frequently want to condition treatment assignment on information that only becomes available while the experiment is running. Two obstacles make such “adaptive” experimentation time-intensive and costly to implement.
ExperimentPilot solves both problems. It provides users with a simple online interface where they can specify their adaptive experiment with a few clicks and without a single line of code. Once specified, ExperimentPilot provisions the adaptive treatment assignment algorithm on its own servers, eliminating the need for users to set up a web server. Users can then connect data collection and treatment assignment by simply embedding a link supplied by ExperimentPilot in their experiment platform of choice.
Sequential Blocking: To improve the precision of treatment effect estimates, researchers may want to block treatment assignment on covariates known to strongly affect the outcome of interest. However, in many experiments, units arrive sequentially, and covariate distributions are, at best, imprecisely known prior to the start of the experiment. This makes it difficult to specify blocking policies before the start of the experiment. Sequential blocking methods can be used to implement valid blocking schemes for units arriving sequentially, but such methods must be executed in real-time while the experiment is running. ExperimentPilot allows users to choose from a variety of common sequential blocking methods, making it easy for researchers to use blocking in any experiment.
Multi-Armed Bandits: Coming soon...