Working with Websites

Some great tools for web or internet stuff I like.

Tools

Downloading

• curl (great for testing HTTP requests)
• aria2c (great for faster downloads via multiple threads)
• httrack (mirrors websites but really slow)
• youtube-dl (it's great!)

Monitoring

• vnstat (checking network usage)
• nmap (local subnet IP searching)

Browsers

• X11 - Firefox
• SSH - elinks (ncurses browser with tabs, and css support)
• SSH - browsh (neat idea to render firefox, but really buggy)

Scripts

Mirror all files from a website

Mirror all the files off of a website, with the full folder structure

wget -m -p -E -k -K -np https://example.com/