全部版块 我的主页
论坛 计量经济学与统计论坛 五区 计量经济学与统计软件 HLM专版
2545 4
2014-05-02
Any thoughts about Power analysis for a  three-Level Hierarchical Linear Growth Model?.  I want to compute the effect size for the model given the sample size, statistical power, number of predictors at each level, and level of significance
二维码

扫码加我 拉你入群

请注明:姓名-公司-职位

以便审核进群资格,未注明则拒绝

全部回复
2014-5-2 00:55:59
Take a look at the Optimal Design software.  It is free, and is specifically designed for HLM analyses.
http://sitemaker.umich.edu/group-based/optimal_design_software

Todd Zoblotsky
二维码

扫码加我 拉你入群

请注明:姓名-公司-职位

以便审核进群资格,未注明则拒绝

2014-5-2 00:56:38
With regard to statistical power, are you looking at the effects of an intervention, or at naturally occurring associations between variables?  As noted by Todd, Optimal Design is a very valuable tool for power analysis, but like most HLM software it tends to focus on designs involving experimental assignment to treatment conditions.  

If you are interested in computing effect size per se in a randomized experiment, the following paper by Larry Hedges may be helpful:
  • Hedges, L. (2011). Effect Sizes in Three-Level Cluster-Randomized Experiments Journal of Educational and Behavioral Statistics June 2011 36: 346-380,
  • The Raudenbush and Bryk (2002) HLM text also has more general instructions for computing effect sizes at each level of a three level model.

Stephen Brand
二维码

扫码加我 拉你入群

请注明:姓名-公司-职位

以便审核进群资格,未注明则拒绝

2014-5-2 00:59:09
I've done a lot of power analyses.  I've seen a number of really crappy  power analyses.  "Complicated"  is a common characteristic of manyof the crappy efforts.  

  • What do you propose to have as the units of your power analysis?  
  • "Standard deviations of change"?  -  change in WHAT?  
  • Various error terms will exist in a 3-level hierarchical model.  
These depend on not only the TOTAL sample size, but various ways of apportioning the Ns ... which is also apt to be a matter that you can manipulate, and see varying results.  (Does the suggested software help with that?  - real question, not rhetorical or sarcastic.)

It is *often* possible to collapse a complicated design in order to get a good approximation to the effects that concern you by looking at something like a simple t-test, using whatever should be acceptable estimates for the error.  Then you provide the estimates along with the observation that the actual design should offer slightly more power than this.  

The power analysis is written (a) to help you figure out your sample size and design, and (b) to help sell it to your granting agency.  For a complicated design, the choices get more and more finicky, and (often) more and more questionable.  And the result is usually going to be an approximation.

Keep it simple.  Keep it simpler than the actual design, when the design is complicated.

--
Rich Ulrich

二维码

扫码加我 拉你入群

请注明:姓名-公司-职位

以便审核进群资格,未注明则拒绝

2014-5-2 00:59:58
Here's another way to approach it when you have a somewhat complicated model.
  • Simulate a population that has the effect size(s) you want power to detect.
  • Repeatedly sample from that population using a guess at the required sample size (this guess could come from the simplified approach Rich suggests), and run your model.  Power = the proportion of samples for which the null hypothesis is rejected.  (OMS is useful for writing the table containing the p-value to another dataset.)

Bruce Weaver Professor Lakehead University Canada
二维码

扫码加我 拉你入群

请注明:姓名-公司-职位

以便审核进群资格,未注明则拒绝

相关推荐
栏目导航
热门文章
推荐文章

说点什么

分享

扫码加好友,拉您进群
各岗位、行业、专业交流群