Where can I transfer and save 1,000s of photos?

I have 4,000 pictures on my Samsung S4. It's taking a lot of memory and I want to put it in a very safe place. It has some videos and I want to save all of them somewhere so I can delete them off my phone. I'm thinking about an external hard drive but it warns you that it can be all deleted on it's own. Does anyone know where I can save it permanently or what device I need to get. I don't want to put it on my computer either. It's going to take a lot of memory. Should I get a flash drive and a hard drive so I have 2 backups? Link me a url what device, how much memory and how much it costs. That'll be very helpful. Thank You. I'm willing to spend $8-$40.

Read more: Where can I transfer and save 1,000s of photos?