Experimentation for Engineers

Optimise the performance of your systems with practical experiments used by engineers in the world's most competitive industries. Experimentation for Engineers: From A/B testing to Bayesian optimization is a toolbox of techniques for evaluating new features and fine-tuning parameters. You will start with a deep dive into methods like A/B testing and then graduate to advanced techniques used to measure performance in industries such as finance and social media.

You will learn how to:

Design, run, and analyse an A/B testBreak the "feedback loops" caused by periodic retraining of ML modelsIncrease experimentation rate with multi-armed banditsTune multiple parameters experimentally with Bayesian optimisationClearly define business metrics used for decision-makingIdentify and avoid the common pitfalls of experimentation By the time you're done, you will be able to seamlessly deploy experiments in production, whilst avoiding common pitfalls.

About the technology Does my software really work? Did my changes make things better or worse? Should I trade features for performance? Experimentation is the only way to answer questions like these. This unique book reveals sophisticated experimentation practices developed and proven in the world's most competitive industries and will help you enhance machine learning systems, software applications, and quantitative trading solutions.