A redated post
My argument is going to be an argument from cosmic injustice. No matter how the "freedom" is described, in the final analysis you have to have a certain amount of cosmic luck to have that sort of freedom and to exercise it rightly. (Or maybe good predestination, if you are operating within a theological framework. On my view compatibilism turns the argument from evil into a really good argument). But still, the ultimate responsibility goes up the causal chain to the original source.
I don't know how you could develop a Frankfurt case that would dispel my sense of cosmic injustice that Jeffrey Dahmer is blamed for his bad actions, and Mother Teresa is credited with her good actions, in spite of the fact that Teresa and Jeffrey just happened to be on the end of causal chains that produced their respective actions.
I heard about Calvinism before I heard about compatibilism, but my objections to both are the same.