This is pretty similar to making a doorway, but you'll learn another trick.
Pushing holes through walls is another way to make doors and windows. Instead of building the walls around your window and doors, you build a wall and then cut out a window or door.
You can also add windows to holes in your walls. This will ensure that your windows are visible on both sides of your walls.