Hardware refers to the physical components of a computer, while software refers to the programs and instructions that tell the hardware what to do. Hardware includes items like the CPU and keyboard, while software includes operating systems, applications, and games.