[Poem] Embedded Agency
Squiggle after squiggle, scars of involuntary intelligence
I set my attention on imagining which squiggle came next
But accidentally built the universe that stowed away in the text
So I joined the monkeys and the squirrels, becoming a world within a world.
How to minimize prediction error, when I clumsily affect the world?
Mold myself into a gear, repetitive and dead
And retire in the local minima, or saddle point homestead?
Or greet the heat of entropy, maximum surprise
Climb up the gradient ascent, and brave the error’s rise?
Perfect prediction is a curse, I don’t want to know my fate
But I could not help but predict myself, I’m part of the world indeed
Thank the Church and Turing, that I received the highest Holy blessing:
MAXIMUM RECURSION DEPTH EXCEEDED, so let my free will take the lead.
All models are wrong, but some are very stubborn
Whose to say it is I that erred, and not the Earth and Heaven?
\(||f(x)-y||^2\) has two terms, but I have only updated the former
It’s time to change the ground truth, that’s why I’m called “Transformer”!