Themes alter your site's layout and visual style, while plugins add all kinds of features and functionality. While there's some overlap in those definitions, it's best to choose a theme based on how you want your site to look, and then add on features via plugins as needed.