I used to use database migration tools that pretty much locked you into their toolings.
I find it's nice for once not having to rely on any of it.
golang-migrate/migrate is great for that.
Just create SQL files for both up and down, and you can have the script migrate up, or you can just manually run the SQL file yourself.