I was facing exactly the same issue. Time Machine creates the initial backup with no problems. If you start a new backup run, it fails with a umount problem at a certain point.
The solution for me was to adjust the SMB settings (I added the "Global" section):
#unassigned_devices_start
#Unassigned devices share includes
include = /tmp/unassigned.devices/smb-settings.conf
#unassigned_devices_end
#macOS config start
[Global]
vfs objects = catia fruit streams_xattr
fruit:nfs_aces = no
fruit:zero_file_id = yes
fruit:metadata = stream
fruit:encoding = native
spotlight backend = tracker
#macOS config end
This post helped me to solve the problem: