Linux guy here: How the heck do you automate the deployment of Windows servers?

Greetings from the other side! I'm working on improving my Windows knowledge, and I'd like to replicate something I can do in Linux with Windows servers: Spinning up an EC2 instance and installing and configuring MySQL.

I haven't been able to find any way to automate this down to one command. What I'm trying to avoid is spending a lot of time rebuilding my environment while I'm testing things out.

If anybody has some batch files (I think that's what you call shell scripts here) or tips I'd appreciate it.