There do exist automated dispute resolution mechanisms like UMA. Though even they reduce to human voters when results are disputed.

So effectively yes, you need (a) decision maker(s) in the loop.