SLAS2016 Short Courses
Study Design and Statistical Analysis for High Throughput Screening (HTS) Experiments
As data analysis methods for high-throughput screening continue to evolve, methodological research has shown that the reproducibility and validity of HTS screens can be greatly improved by modern design and statistical methods.
Approximately 1/3 of the course will cover basic study design principles (e.g., randomization, internal validity, avoiding confounding variables) and introductory statistical principles (e.g., systematic versus random error, data visualization, inferential versus exploratory data analysis, false positive versus false negative errors). The remaining time will be spent applying these principles to HTS experiments, covering both primary and secondary (validation) screens.
Recent advances from the published methodological literature will be covered from an applied perspective, both in lecture format and by live data analysis sessions conducted by the instructor. The R statistical software will be used to provide examples of data analysis sessions with emphasis on the ideas and the statistical output rather than on the coding mechanics. R scripts will be provided in a format suitable for post-workshop use by participants or by bioinformatics colleagues. Participants will not run R code during the workshop.
Who Should Attend:
The target audience are industry and academia individuals with an interest in HTS data analysis, including graduate students, post-doctoral fellows, scientists, bioinformaticians, screening facility personnel, and laboratory heads. Attendees should have hands-on or strong conceptual experience with HTS.
How You Will Benefit From This Course:
The aim is to give participants a working knowledge of how to use statistical principles to help plan HTS experiments and to analyze the data to improve reproducibility and validity. References to accessible methodological literature will be provided, including books that can be examined at the workshop. Material will be provided to participants to allow them to apply knowledge gained in the workshop to their own data sets. Methods for biochemical and cell-based assays will be addressed, although note that RNAi screens and image-based High-Content Screens will not be covered in this workshop.
Introduction to Study Design and Statistical Principles
- Reproducibility Crisis and the Need for Better Study Design and Analysis
- Statistical Concepts and Terminology
- Logic of Statistical Tests
- What is a p-value?
- Assumptions of Statistical Tests
- Data Transformation
- Data Visualization — Advantages and Caveats
- Study Design
- The Importance of Design and Minimizing Confounds
- Minimizing False Positives and False Negatives
High Throughput Screening Study Design and Analysis
- Primary Screen Systematic Error (Bias) Detection
- Primary Screen Normalization and Study Design Methods
- Primary Screen Statistical Testing
- Partial Replication
- Secondary (Validation) Screen Normalization and Study Design Methods
Robert Nadon, Ph.D.,
Robert Nadon is an Associate Professor in Department of Human Genetics of McGill University, a Principal Investigator at the McGill University and Genome Quebec Innovation Centre in Montreal, Canada, and an Associate Editor for BMC Bioinformatics. Dr. Nadon's research focusses on analysis of high throughput biological data from various sources, notably gene expression microarrays, genome-wide mRNA translation, and high-throughput screening. He has published on these topics in a wide range of technical and life science journals, including Nature Biotechnology, Journal of Biomolecular Screening, PNAS, Bioinformatics, BMC Bioinformatics, and Trends in Genetics. He consults regularly with industry and has given various high-throughput data analysis workshops for life science audiences.
- Box, G. E. P. (2006). Improving almost anything: Ideas and essays (Rev. ed.). Hoboken, NJ: Wiley-Interscience.
- Box, G. E. P., Hunter, J. S., & Hunter, W. G. (2005). Statistics for experimenters: Design, innovation, and discovery (2nd ed.). Hoboken, NJ: Wiley-Interscience.
- Burton, R. F. (1998). Biology by numbers: An encouragement to quantitative thinking. New York: Cambridge University Press.
- Cleveland, W. S. (1993). Visualizing data. Murray Hill, NJ: Hobart Press.
- Crawley, M. J. (2007). The R book. Hoboken, N.J.: Wiley.
- Motulsky, H. (2010). Intuitive biostatistics: A nonmathematical guide to statistical thinking (Completely rev. 2nd ed.). New York: Oxford University Press.
- Tufte, E. R. (2001). The visual display of quantitative information. Cheshire, Conn.: Graphics Press. .
- Vickers, A. (2010). What is a P-value anyway?: 34 stories to help you actually understand statistics. Boston: Addison-Wesley.
- Baryshnikova, A., Costanzo, M., Kim, Y., Ding, H. M., Koh, J., Toufighi, K., et al. (2010). Quantitative analysis of fitness and genetic interactions in yeast on a genome scale. Nature Methods/em>, 7, 1017-U1110.
- Malo, N., Hanley, J. A., Carlile, G., Liu, J., Pelletier, J., Thomas, D., & Nadon, R. (2010). Experimental design and statistical methods for improved hit detection in high-throughput screening. Journal of Biomolecular Screening, 15, 990-1000.
- Malo, N., Hanley, J. A., Cerquozzi, S., Pelletier, J., & Nadon, R. (2006). Statistical practice in high-throughput screening data analysis. Nature Biotechnology, 24, 167-175.
- Miron, M., & Nadon, R. (2006). Inferential literacy for experimental high-throughput biology. Trends in Genetics, 22, 84-89.
- Murie, C., Barette, C., Lafanechere, L., & Nadon, R. (2014). Control-Plate Regression (CPR) normalization for high-throughput screens with many active features. Journal of Biomolecular Screening, 19, 661-671.
- Murie, C., Barette, C., Lafanechere, L., & Nadon, R. (2013). Single assay-wide variance experimental (SAVE) design for high-throughput screening. Bioinformatics, 29, 3067-3072.
- Murie, C., Barette, C., Button, J., Lafanechère, L., & Nadon, R. (2015). Improving detection of rare biological events in high-throughput screens. Journal of Biomolecular Screening, 20(2), 230-241.
- Wu, Z. J., Liu, D. M., & Sui, Y. X. (2008). Quantitative assessment of hit detection and confirmation in single and duplicate high-throughput screenings. Journal of Biomolecular Screening, 13, 159-167.