 Nick Sweeting
|
1c1bc76ac1
add chrome headless option and improve default data dir finding
|
6 years ago |
 Nick Sweeting
|
10bb970d66
Update archive_methods.py
|
6 years ago |
|
Nick Sweeting
|
c474bb7992
fix settings not being applied
|
6 years ago |
|
Nick Sweeting
|
b2ccb7dbcb
refactor error hint printing to be DRYer
|
6 years ago |
|
Nick Sweeting
|
552734241b
put git clones in a git folder to avoid retries
|
6 years ago |
|
Nick Sweeting
|
3eaa76267e
fix keyerror domain bug
|
6 years ago |
|
Nick Sweeting
|
b03e9fade8
better link corruption guards, remove title prefetching, save index after run
|
6 years ago |
|
Nick Sweeting
|
c95632883e
fix without_hash to without_fragment
|
6 years ago |
|
Nick Sweeting
|
d689264365
add new config and dependency options
|
6 years ago |
|
Nick Sweeting
|
d52c9c5304
allow passing COOKIES_FILE to wget
|
6 years ago |
|
Nick Sweeting
|
5a7d00a639
fetch page title during archiving process
|
6 years ago |
|
Nick Sweeting
|
e6d5cd4432
ignore robots.txt when using wget
|
6 years ago |
|
Nick Sweeting
|
56d382235f
better progress output
|
6 years ago |
|
Nick Sweeting
|
522b6288c1
hide frequent youtubedl incompatibility
|
6 years ago |
|
Nick Sweeting
|
78ffa57c06
ignore hsts as well
|
6 years ago |
|
Nick Sweeting
|
637f63dc80
chmod media after downloading
|
6 years ago |
|
Nick Sweeting
|
756f31a50b
hide common youtubedl failures
|
6 years ago |
|
Nick Sweeting
|
794c043fa4
fix chrome data dir in wrong folder
|
6 years ago |
|
Nick Sweeting
|
9f5441c4f3
quieter media downloads
|
6 years ago |
|
Nick Sweeting
|
4e5b466bb2
fix broken wget user agents
|
6 years ago |
|
Nick Sweeting
|
d8c7c98c01
fix exception format string
|
6 years ago |
|
Nick Sweeting
|
705abda1a5
send ArchiveBox user agent to archive.org
|
6 years ago |
|
Nick Sweeting
|
8a9b4d6975
dont git clone urls with hashes
|
6 years ago |
|
Nick Sweeting
|
b8e5e1d5bd
skip media when folder exists, even if empty
|
6 years ago |
|
Nick Sweeting
|
901666bae6
dont show wget errors unless all files failed to download
|
6 years ago |
|
Nick Sweeting
|
ad7038e031
catch json parse errors in link archiving
|
6 years ago |
|
Nick Sweeting
|
071b39b944
nicer error formats
|
7 years ago |
|
Nick Sweeting
|
de6eb649e0
disable wget timestamping if using warcs
|
7 years ago |
|
Nick Sweeting
|
ce07a6c738
patch subprocess.run to have better timeout handling
|
7 years ago |
|
Nick Sweeting
|
7ea36c4adb
bump timeouts and improve curl archive method
|
7 years ago |
