The Actor references in the DialogueTree Asset, are correctly set and when the dialogue is started, the assignment remains.
Hmm. can you confirm that when you call SetActorReference, the reference is indeed assigned/set correctly in the DialogueTree asset itself?