Exactly. Yudkowsky warns that advancements in capabilities are far outpacing advancements in alignment and we are therefore nowhere near ready for AGI. With something like this, if you don’t get it right at the first critical step, you don’t get a chance to learn from your mistake and try again because you and everyone else is dead.