Survey Weights Training Sessions for RRFSS
Institute for Social Research, York University
Instructor: Hugh McCague
November, 2023
Zoom Meeting
Presentation Slides and Video Recordings
Session One: 1:00pm-3:00pm, Tuesday, November 14, 2023
Survey Weights Training for RRFSS Session 1 Slides (pdf)
Survey Weights Training for RRFSS Session 1 Video Recording (mp4): watch or download (no Dropbox login is required)
Session Two: 10:00am-12:00pm, Tuesday, November 21, 2023
Survey Weights Training for RRFSS Session 2 Slides (pdf)
Survey Weights Training for RRFSS Session 2 Video Recording (mp4): watch or download (no Dropbox login is required)
Session Three: 10:00am-12:00pm, Tuesday, November 28, 2023
Survey Weights Training for RRFSS Session 3 Slides (pdf)
Survey Weights Training for RRFSS Session 3 Video Recording (mp4): watch or download (no Dropbox login is required)
Data and Syntax
Please note: The files are in a folder available through Dropbox. No login is required to download the folder.
Session One: 1:00pm-3:00pm, Tuesday, November 14, 2023
Folder to download: Survey Weights Training Sessions for RRFSS
Session Two: 10:00am-12:00pm, Tuesday, November 21, 2023
Folder to download: Survey Weights Training Session 2
Session Three: 10:00am-12:00pm, Tuesday, November 28, 2023
Folder to download: Survey Weights Training Session 3
Resource Web Links for the Training Sessions
1. Survey Research Methods
1.1 Ornstein, Michael. A Companion to Survey Research. London; Thousand Oaks, CA: SAGE, 2013.
Publisher’s information: https://us.sagepub.com/en-us/nam/a-companion-to-survey-research/book237402
1.2 American Association for Public Opinion Research (AAPOR)
https://aapor.org/
2. Survey Weights and Complex Samples
2.1 Textbooks and General Guidance
2.1.1 Heeringa, Steven G., Brady T. West, and Patricia A. Berglund. Applied Survey Data Analysis. 2nd edition. Boca Raton, FL: CRC Press/Chapman and Hall, 2017. Resources web page for the book including Stata and other code: https://websites.umich.edu/~surveymethod/asda/
2.1.2 Valliant, Richard and Jill A. Dever. Survey Weights: A Step-by-Step Guide to Calculation. 1st edition. College Station, TX: Stata Press, 2018.
https://www.stata-press.com/books/survey-weights/
2.1.3 Williams, Richard. "Analyzing Complex Survey Data: Some key issues to be aware of." University of Notre Dame. https://www3.nd.edu/~rwilliam/stats3/SvyCautionsX.pdf
2.2 Dual Frame Weights
2.2.1 Buskirk, Trent D. and Jonathan Best. “Venn Diagrams, Probability 101 and Sampling Weights Computed for Dual Frame Telephone RDD Designs.” Proceedings of the Survey Research Methods Section, American Statistical Association (ASA), Joint Statistical Meetings (JSM), Alexandria, VA, 2012. pp. 3696-3710. http://www.asasrms.org/Proceedings/y2012/Files/304351_72969.pdf
2.3 Bootstrap Weights
2.3.1 Statistics Canada, "Weighted estimation and bootstrap variance estimation for analyzing survey data: How to implement in selected software"
[Archived content, but still useful]
http://www.statcan.gc.ca/pub/12-002-x/2014001/article/11901-eng.htm
2.3.2 A worked example of a statistical analysis using bootstrap weights in Stata. Institute for Social Research, University of Michigan.
http://www.isr.umich.edu/src/smp/asda/Additional%20Stata%20Examples%20svy%20bootstrap.pdf
2.3.3 Kolenikov, Stanislav. "Resampling variance estimation for complex survey data." The Stata Journal 10.2 (2010): 165–199. https://journals.sagepub.com/doi/10.1177/1536867X1001000201?icid=int.sj-abstract.similar-articles.1
This article describes how bootstrap weights are calculated. It also includes a demonstration of how to create them in Stata using the bsweights command.
2.3.4 An example in Stata of creating (with bsweights) and using bootstrap weights
You can copy this text file into a Stata-do file: CreateBootstrapWeightsExample5.txt
2.4 Issues on When to Use Weights
2.4.1 West, Brady T. "SBE CCC: Using weights when analyzing survey data: Descriptive Statistics vs. Regression Modeling." ICPSR. Presentation video recording. https://www.youtube.com/watch?v=_dYeGQpKmdc
2.4.2 Valliant, Richard and Jill A. Dever. Survey Weights: A Step-by-Step Guide to Calculation as given in 2.1.2 above. Note Section 7.6 "Use of weights in fitting models," pp.138-150.
2.4.3 Bollen, Kenneth A., Paul P. Biemer, Alan F. Karr, Stephen Tueller, and Marcus E. Berzofsky. "Are Survey Weights Needed? A Review of Diagnostic Tests in Regression Analysis." Annual Review of Statistics and Its Application 3 (June, 2016): 375-392. https://www.annualreviews.org/doi/abs/10.1146/annurev-statistics-011516-012958
2.5 Combining Cycles of Surveys and Pooling Weights
2.5.1 Wendt, Michael. "Considerations before Pooling Data from Two Different Cycles of the General Social Survey." Statistics Canada. 2007.
https://www23.statcan.gc.ca/imdb-bmdi/pub/document/8011_D1_T9_V1-eng.pdf
2.5.2 Thomas, Steven and Brenda Wannell. "Combining cycles of the Canadian Community Health Survey." Statistics Canada, Catalogue no. 82-003-XPE. Health Reports 20.1 (March, 2009). https://www150.statcan.gc.ca/n1/pub/82-003-x/2009001/article/10795-eng.pdf
2.6 Post-Stratification
2.6.1 Valliant, Richard and Jill A. Dever. Survey Weights: A Step-by-Step Guide to Calculation as given in 2.1.2 above. Note Section 4.1 "Poststratification estimators," pp.52-58.
3. Statistical Resources
3.1 Statistical Software Resources, UCLA
https://stats.oarc.ucla.edu/