/tech/ - Image restoration

Name
E-mail
Subject
Message	Max message length: 8192
Files	Drag files to upload or click here to select them Max file size: 80.00 MB Max files: 5
More
Password	(used to delete files and postings)
Misc

Image restoration Comrade 01/10/2021 (Sun) 12:19:36 No. 6966

Any 1337 hackers wanna help find and restore the missing images?

Comrade 01/10/2021 (Sun) 12:23:58 No. 6968

Here's a script to find the missing images:


#!/bin/bash

board=$1
thread=$2

curl -s "https://bunkerchan.xyz/${board}/res/${thread}.json" \
    | jq '.posts[].files[].path' \
    | tr -d '"' \
    | sort -u \
    | sed s_^_https://bunkerchan.xyz_ \
    | xargs -n 1 -P 1 \
            curl -s -I -o /dev/null -w "%{http_code} %{url_effective}\\n" \
            >> "${board}_${thread}.log" 2>&1

When run as "./missing-images.sh anime 101" it will produce "anime_101.log" that contains the status code of each file in the thread. You can filter out the okay ones with grep.

Comrade 01/10/2021 (Sun) 12:32:39 No. 6969

>>6968 Getting a list of threads is as easy as:


#!/bin/sh

board=$1

curl -s "https://bunkerchan.xyz/${board}/catalog.json" \
    | jq ".[].threadId" \
    | sort -un

You can combine the two:


./find-threads dead | xargs -n1 -P4 ./missing-files.sh dead

Comrade 01/10/2021 (Sun) 13:11:53 No. 6970

If you have reasonable suspicion that a certain other site that runs a variant of tinyboard has some of the files you are looking for, this will get you all the files in a thread with the md5sum:


#!/bin/bash

site="${1}"
board="${2}"
thread="${3}"

# normal images
normal='.posts[] | select(has("ext")) | (.tim + .ext + " " + .md5)'
extra='.posts[] | select(has("extra_files")) | .extra_files[] | .tim + .ext + " " + .md5'

json=$(curl -s "https://${site}/${board}/res/${thread}.json")

normal_files=$(jq "${normal}" [orange][orange][orange]"${json}" | tr -d '"')
extra_files=$(jq "${extra}" [orange][orange][orange]"${json}" | tr -d '"')

while read name md5; do
    echo "$(base64 -d [orange][orange][orange] "${md5}" | xxd -p) https://${site}/${board}/src/${name}"
done [orange][orange][orange] "${normal_files}
${extra_files}"

Comrade 01/10/2021 (Sun) 14:06:52 No. 6971

>>6968 It seems to miss the extension in some cases?

Comrade 01/10/2021 (Sun) 14:09:23 No. 6972

>>6971 It seems that in this cases it is bunkerchan that is wrong, see >>>/dead/93 for example, both in the html and json the extensions are missing...