Took a look at the setting yaml file and a whole bunch of settings (including selected voice types and animation selection) are not persisted to the file. So they are reset every time the game is reloaded.
Going back to SexLab for now. One day I might get around to switching the SexLab API function calls to CommonLib NG.