Photon is a quick and easy to use tool which can crawl through sites, pulling useful information such as hidden directories and data files.
get clone https://github.com/s0md3v/Photon.git
python3 Photon.py -h
Running a basic scan on a site only takes a matter of seconds and the information collected is impressive.
Once finished, it will separate out it’s findings based on type.
You can then sieve through these to see if you have found anything juicy.