I share your sense that the core position is simple and unimpeachable: we have no way to align something smarter than ourselves on the first critical try. Therefore I have had a hard time thinking further on this topic without devolving into bulverism and failing the ITT. I want to speak privately to people (like Hanson), whisper to them in some corner and say "no really, deep down do you just feel that [my own personal sense of things] and the rest of this is for show?"
But I know that's not the case. Most of these people are rather obviously smarter than I am. Maybe they're less intellectually humble in some hypothetical absolute sense, but I'm not sure there's much of an argument for them being less proportionately humble. For sure they're as honest as I am, or more so.
I look forward to the debate, will listen as soon as it is posted.
I share your sense that the core position is simple and unimpeachable: we have no way to align something smarter than ourselves on the first critical try. Therefore I have had a hard time thinking further on this topic without devolving into bulverism and failing the ITT. I want to speak privately to people (like Hanson), whisper to them in some corner and say "no really, deep down do you just feel that [my own personal sense of things] and the rest of this is for show?"
But I know that's not the case. Most of these people are rather obviously smarter than I am. Maybe they're less intellectually humble in some hypothetical absolute sense, but I'm not sure there's much of an argument for them being less proportionately humble. For sure they're as honest as I am, or more so.
I look forward to the debate, will listen as soon as it is posted.