Nearly a week later I can conclude: It probably came from macvlan.
First memtest did finish 5 runs without an error. So it probably wasn't the RAM.
After setting up a extra vlan for all of my docker containers, that have their own ip, I now had no macvlan stack traces anymore and my server never crashed since then. So I guess the problem is solved.