Files
experiments-database/analysis/matlab/variations/naive_a2_d0_10/logpower_result.txt
T
Experiments DB Dev 378ad6da05 analysis(matlab): add log(day) model + Cohen's f + power to every variation
Add variation_logpower.m (self-contained) + make_variation_logpower.m,
dropping logpowersim.m + logpower_result.txt into all 28 variation folders.
Matches the paper's power code: models behavior ~ stim + log(day) +
stim:log(day) + (1|rat) (log(day+1), since our day 0 = paper Day 1), reports
Cohen's f (partial eta^2 of the interaction) and the interaction under
residual/Satterthwaite/honest random-slope DF, then runs the Monte-Carlo power
sim on the log-day ground truth (per-animal cluster-honest + LME power).

Notable: under log(day) the accumulating divergence is captured more sharply,
so several full-window scenarios reach honest significance that were n.s. under
raw day (e.g. right_only_d0_13 honest p=0.003, unmerge_d0_13 0.021,
unmerge_d0_10 0.036); Cohen's f is small-medium (~0.10-0.34).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-23 14:37:50 -04:00

37 lines
1.7 KiB
Plaintext

==============================================================================
LOG-DAY MODEL + COHEN'S f + POWER -- naive_a2_d0_10
==============================================================================
model: behavior ~ stim + log(day) + stim:log(day) + (1|rat) (success COUNT)
log(day) uses 1-indexed training day (our day 0 = paper "Day 1")
observed groups: stim n=3, control n=7 nrep=120, alpha=0.05
--- fitted on real data ---
stim x log(day) interaction: F(1,100)=4.633 p(resid)=0.03378 p(Satt)=0.03391 (df=95)
honest per-animal random slope (log-day): F(1,7.2)=2.24 p=0.177
Cohen's f (interaction, partial eta^2=0.010) = 0.101 (small-medium; f: .10 small, .25 medium, .40 large)
--- power simulation (log-day ground truth: stim:logday=+9.59, ratSD=8.17, resSD=14.84) ---
true stim:log(day) = +9.59 (100% of observed)
N/group | per-animal power | LME power
------------------------------------------
3 | 0.23 | 0.44 <- observed
5 | 0.57 | 0.68
8 | 0.83 | 0.86
12 | 0.97 | 0.98
16 | 0.99 | 1.00
24 | 1.00 | 1.00
true stim:log(day) = +4.79 (50% of observed)
N/group | per-animal power | LME power
------------------------------------------
3 | 0.07 | 0.10 <- observed
5 | 0.11 | 0.17
8 | 0.30 | 0.37
12 | 0.34 | 0.38
16 | 0.62 | 0.64
24 | 0.75 | 0.78
Read the per-animal column as the honest power; the LME column matches the
paper's power code (anova interaction p, observation-level DF) and is optimistic.