Hey, i had similar issues with switching from afp to smb and i just registered to let you know how i solved it here.
First of all i've seen that the console app and the log inside there told me that authentication did fail.
So i went ahead and googled around and found this:
https://apple.stackexchange.com/a/246244
This states that maybe some "security.plist" is broken, so i went ahead and looked at that file which was completely broken here.
It was just a scramble of hex / asci mix and nowhere near valid xml. So i kept a copy and replaced it with the content from stack overflow
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
<key>SecItemSynchronizable</key>
<true/>
</dict>
</plist>
This did not fix the issue but maybe together with the second step i took did:
I went to the time machine prefpane and removed the disk again.
Opened up a terminal and executed:
sudo tmutil setdestination -ap smb://username@myserver/Backup
This asked me for my local user password and the remote destination password, since then its working here.
No changes were made to the smb conf files or extra confs and the setup is as all the screenshots here have shown.
Hope that may helps some of you.