Do I need to "Collect All and Save?" What if Splice cannot find my samples?

No. Once you save a project in the Splice folder, the Splice app syncs all dependent samples, so no “Collect All and Save” is necessary.