Simply select Mass Import, Add URLs, Add from CSV and select the file from your computer.
Please see this short tutorial video here.
Sample sheet used in the above video can be found at
https://docs.google.com/spreadsheets/d/1ZxlJ4K027c7kwSqv8a8Sg6cfj7Ys6O49cdwalgs_sKk/edit?usp=sharing