Hierarchical modelling

Hello!

Thanks to your advice and help I’ve now got models with good diagnostics up and running which has been great. While these models are good I always intended to use a hierarchical model due to the low trial count in my task and am just wondering the best way to approach this.

Looking around I see that there has been something in development in the latter half of last year but am wondering if this has been released yet. Or is manually implementing a hierarchical structure still the best option as suggested in previous posts.

.Any pointers would help a great deal.

Thanks again!!

Going to skip past the BF specifics here because I am new too, but in general the difficulty of estimating and usefulness of hierarchical models is directly related to the number of trials, conditions and participants so might be worth listing roughly what you expect here?

Hi thanks for the reply,

I plan on comparing two groups parameter estimates across a task which has only one condition. There will be about 25-30 people in a group who will complete 160 trials each.

I am simulating a DDM variant with an intractable likelihood function and I believe 160 trials is on the lower side. From what I have seen across the literature when the trial count reaches this number implementing a hierarchical structure typically improves the reliability of the parameter estimates via partial pooling.

We currently support two-levels with composition, check out [the new tutorial] and let me know if there are any issues (bayesflow/examples/Compositional_Diffusion.ipynb at main · bayesflow-org/bayesflow · GitHub).

We also support arbitrary graphical models experimentally, but @paul.buerkner can say more about the current state.

1 Like