 Nick Sweeting
|
d8c7c98c01
fix exception format string
|
6 years ago |
|
Nick Sweeting
|
705abda1a5
send ArchiveBox user agent to archive.org
|
6 years ago |
|
Nick Sweeting
|
8a9b4d6975
dont git clone urls with hashes
|
6 years ago |
|
Nick Sweeting
|
b8e5e1d5bd
skip media when folder exists, even if empty
|
6 years ago |
|
Nick Sweeting
|
901666bae6
dont show wget errors unless all files failed to download
|
6 years ago |
|
Nick Sweeting
|
ad7038e031
catch json parse errors in link archiving
|
6 years ago |
|
Nick Sweeting
|
071b39b944
nicer error formats
|
7 years ago |
|
Nick Sweeting
|
de6eb649e0
disable wget timestamping if using warcs
|
7 years ago |
|
Nick Sweeting
|
ce07a6c738
patch subprocess.run to have better timeout handling
|
7 years ago |
|
Nick Sweeting
|
7ea36c4adb
bump timeouts and improve curl archive method
|
7 years ago |
|
Nick Sweeting
|
c42fcd42d7
fetch warc file inline with wget instead of as separate step
|
7 years ago |
|
Nick Sweeting
|
321cdeda11
add mirror to git clone
|
7 years ago |
|
Nick Sweeting
|
6189b1a8af
fix invalid old config vars
|
7 years ago |
|
Nick Sweeting
|
f83750c545
cleanup options and make cli flags better for chrome headless timeouts
|
7 years ago |
|
Nick Sweeting
|
911b84a79b
make wget cli options easier to read
|
7 years ago |
|
Nick Sweeting
|
b77476cb83
fix user agent quoting
|
7 years ago |
|
Nick Sweeting
|
e8808b0a1f
add WARC downloading
|
7 years ago |
|
Nick Sweeting
|
74189966bf
add link to media
|
7 years ago |
|
Nick Sweeting
|
a15a331798
fix media download with longer timeout
|
7 years ago |
|
Nick Sweeting
|
c33f7ba91c
add ability to fetch media
|
7 years ago |
|
Nick Sweeting
|
0df098717a
make git domains configurable
|
7 years ago |
|
Nick Sweeting
|
827e15b31a
add git downloading
|
7 years ago |
|
Nick Sweeting
|
57d42339a4
rename pip dir archive to archivebox
|
7 years ago |
