 Nick Sweeting
|
b03e9fade8
better link corruption guards, remove title prefetching, save index after run
|
пре 6 година |
|
Nick Sweeting
|
c95632883e
fix without_hash to without_fragment
|
пре 6 година |
|
Nick Sweeting
|
d689264365
add new config and dependency options
|
пре 6 година |
|
Nick Sweeting
|
d52c9c5304
allow passing COOKIES_FILE to wget
|
пре 6 година |
|
Nick Sweeting
|
5a7d00a639
fetch page title during archiving process
|
пре 6 година |
|
Nick Sweeting
|
e6d5cd4432
ignore robots.txt when using wget
|
пре 6 година |
|
Nick Sweeting
|
56d382235f
better progress output
|
пре 6 година |
|
Nick Sweeting
|
522b6288c1
hide frequent youtubedl incompatibility
|
пре 6 година |
|
Nick Sweeting
|
78ffa57c06
ignore hsts as well
|
пре 6 година |
|
Nick Sweeting
|
637f63dc80
chmod media after downloading
|
пре 6 година |
|
Nick Sweeting
|
756f31a50b
hide common youtubedl failures
|
пре 6 година |
|
Nick Sweeting
|
794c043fa4
fix chrome data dir in wrong folder
|
пре 6 година |
|
Nick Sweeting
|
9f5441c4f3
quieter media downloads
|
пре 6 година |
|
Nick Sweeting
|
4e5b466bb2
fix broken wget user agents
|
пре 6 година |
|
Nick Sweeting
|
d8c7c98c01
fix exception format string
|
пре 6 година |
|
Nick Sweeting
|
705abda1a5
send ArchiveBox user agent to archive.org
|
пре 6 година |
|
Nick Sweeting
|
8a9b4d6975
dont git clone urls with hashes
|
пре 6 година |
|
Nick Sweeting
|
b8e5e1d5bd
skip media when folder exists, even if empty
|
пре 6 година |
|
Nick Sweeting
|
901666bae6
dont show wget errors unless all files failed to download
|
пре 6 година |
|
Nick Sweeting
|
ad7038e031
catch json parse errors in link archiving
|
пре 6 година |
|
Nick Sweeting
|
071b39b944
nicer error formats
|
пре 7 година |
|
Nick Sweeting
|
de6eb649e0
disable wget timestamping if using warcs
|
пре 7 година |
|
Nick Sweeting
|
ce07a6c738
patch subprocess.run to have better timeout handling
|
пре 7 година |
|
Nick Sweeting
|
7ea36c4adb
bump timeouts and improve curl archive method
|
пре 7 година |
|
Nick Sweeting
|
c42fcd42d7
fetch warc file inline with wget instead of as separate step
|
пре 7 година |
|
Nick Sweeting
|
321cdeda11
add mirror to git clone
|
пре 7 година |
|
Nick Sweeting
|
6189b1a8af
fix invalid old config vars
|
пре 7 година |
|
Nick Sweeting
|
f83750c545
cleanup options and make cli flags better for chrome headless timeouts
|
пре 7 година |
|
Nick Sweeting
|
911b84a79b
make wget cli options easier to read
|
пре 7 година |
|
Nick Sweeting
|
b77476cb83
fix user agent quoting
|
пре 7 година |
