Hypixel.net is both their website and mc server adress.
Is it just that https is on port 443 and minecraft is on port 25565?
And if that is the case, can i do something similar by making a reverse proxy have two seperate server blocks for the one domain, with different ports?
You are sort of right
TCP is on layer 4 of the OSI model. Http is layer 7 which runs on top of layer 4 (TCP)
In sort Minecraft and http are both tcp