In these views, using the Shift key is different from using the Command key.
Hold down the Command key and single-click on multiple items. In the List View, you can select items from several different folders in the same window, as long as their contents are showing in the list; in the Column View, you can only select items from one column at a time. See below, left.