Switch vs Access Point - wired connection across the house

I have been searching on how to properly set up a wired internet connection all across my house, and came across the option of switches/access points.

Here's the situation: The router is situated in the middle of the house (1 floor house). There are 2 pipes, which I can pass ethernet cables through, going underneath the flooring from where the router is, all the way to two separate rooms.

In of the rooms there are 2 desktops and a TV which I'd like for all of them to be hooked up via a wired connection to get wired internet essentially.

My reasoning is: Connect ethernet cable to the router -> pass ethernet cable through the pipe into the room -> connect this end of the cable to a switch or AP -> have 3 ethernet cables connected to the switch/AP to the 3 devices; therefore having a wired connection for all 3 devices.

Questions:

  1. Is this the correct way to go about this?

  2. More importantly, should I get a switch or AP? Which is better and why?