Nick Sweeting
|
5a7d00a639
fetch page title during archiving process
|
6 年之前 |
Nick Sweeting
|
e6d5cd4432
ignore robots.txt when using wget
|
6 年之前 |
Nick Sweeting
|
56d382235f
better progress output
|
6 年之前 |
Nick Sweeting
|
522b6288c1
hide frequent youtubedl incompatibility
|
6 年之前 |
Nick Sweeting
|
78ffa57c06
ignore hsts as well
|
6 年之前 |
Nick Sweeting
|
637f63dc80
chmod media after downloading
|
6 年之前 |
Nick Sweeting
|
756f31a50b
hide common youtubedl failures
|
6 年之前 |
Nick Sweeting
|
794c043fa4
fix chrome data dir in wrong folder
|
6 年之前 |
Nick Sweeting
|
9f5441c4f3
quieter media downloads
|
6 年之前 |
Nick Sweeting
|
4e5b466bb2
fix broken wget user agents
|
6 年之前 |
Nick Sweeting
|
d8c7c98c01
fix exception format string
|
6 年之前 |
Nick Sweeting
|
705abda1a5
send ArchiveBox user agent to archive.org
|
6 年之前 |
Nick Sweeting
|
8a9b4d6975
dont git clone urls with hashes
|
6 年之前 |
Nick Sweeting
|
b8e5e1d5bd
skip media when folder exists, even if empty
|
6 年之前 |
Nick Sweeting
|
901666bae6
dont show wget errors unless all files failed to download
|
6 年之前 |
Nick Sweeting
|
ad7038e031
catch json parse errors in link archiving
|
6 年之前 |
Nick Sweeting
|
071b39b944
nicer error formats
|
7 年之前 |
Nick Sweeting
|
de6eb649e0
disable wget timestamping if using warcs
|
7 年之前 |
Nick Sweeting
|
ce07a6c738
patch subprocess.run to have better timeout handling
|
7 年之前 |
Nick Sweeting
|
7ea36c4adb
bump timeouts and improve curl archive method
|
7 年之前 |
Nick Sweeting
|
c42fcd42d7
fetch warc file inline with wget instead of as separate step
|
7 年之前 |
Nick Sweeting
|
321cdeda11
add mirror to git clone
|
7 年之前 |
Nick Sweeting
|
6189b1a8af
fix invalid old config vars
|
7 年之前 |
Nick Sweeting
|
f83750c545
cleanup options and make cli flags better for chrome headless timeouts
|
7 年之前 |
Nick Sweeting
|
911b84a79b
make wget cli options easier to read
|
7 年之前 |
Nick Sweeting
|
b77476cb83
fix user agent quoting
|
7 年之前 |
Nick Sweeting
|
e8808b0a1f
add WARC downloading
|
7 年之前 |
Nick Sweeting
|
74189966bf
add link to media
|
7 年之前 |
Nick Sweeting
|
a15a331798
fix media download with longer timeout
|
7 年之前 |
Nick Sweeting
|
c33f7ba91c
add ability to fetch media
|
7 年之前 |