This is a thread dedicated to the preservation and archival of pony content from around the web.>Why archiveFor funBecause our history is our futureBecause they don't care about you>Where can I find archived pony stuff?In general:https://www.theponyarchive.com/https://warp.theponyarchive.com/ (TPA file search)https://hobune.stream/tpa-h/channels/ (user-friendly TPA frontend)Specific YouTube videos by ID:https://hobune.stream/tpa-h/videos/VIDEOIDhttps://tpa.mares.workers.dev/?output=html&id=VIDEOIDhttps://web.archive.org/web/*/http://wayback-fakeurl.archive.org/yt/VIDEOIDIf you can't find something, ask in the thread - many anons have private archives. When requesting YouTube content, include the video ID, channel name, and/or video title if possible.>How do I archive stuff?yt-dlp: https://github.com/yt-dlp/yt-dlp#installationSupports downloading from YouTube and a fuckload of other sites.Make sure to use flags that properly save additional metadata (thumbnail, description, .info.json etc).This is the config I use: https://github.com/rebane2001/sensible-yt-dlp-archive-scriptsyt-dlp also has many GUI frontends available in case the terminal is too scary for you.Tube Archivist: https://github.com/tubearchivist/tubearchivistA user-friendly self-hostable website for archiving videos. I have not used it myself so I don't know if it is any good, but I've heard good things about it.You can also link content to be archived in the thread if you'd like other anons to take care of it.>Useful resources- Download an entire website or part of it: https://github.com/ArchiveTeam/grab-site- Decentralization and self-hosting: ipfs.tech, https://web3.storage/ , https://www.pinata.cloud/- web.archive.org has been known to delete stuff, so use https://archive.today/ also- Windows program for searching all of your files instantly: https://www.voidtools.com/old>>40308896
Bump.
>>40422477If you mean a fixed threshold then sure that would be simpler. I only suggested that because everyone has different uploading schedules and inactivity can look relatively different because of that.Say someone has the habit of uploading every few days and suddenly it’s been two months since the last upload. Two months may not usually be considered “inactive”, but this helps in the context of archiving because it means something might’ve gone wrong so all the more reason to pay more attention to it.Anyway, a fixed threshold is probably better. I’m sure any big archives would easily check through all channels every few days.
Bump de bump.
>>40424477More for the road
Maxxarcade on youtube once had a video of a skype call with Ashleigh Ball's band Hey Ocean!, I remember at the end he said something like "I love you guys" and Ashleigh said "Rainbow Dash loves you too" in RD's voice. He also had a recording of one of their concerts. I know it's not closely pony related but I figured I'd post about it here, can't find any mention of these videos anywhere online outside a capture of his channel page. https://web.archive.org/web/20130703121801/http://www.youtube.com:80/user/Maxxarcade/videosNo luck in the usual places.Chatting With Ashleigh Ball And Hey Ocean! 1-25-13http://www.youtube.com/watch?v=DkLXBWdkw1IHey Ocean! concert clip and drum solo 4-4-13http://www.youtube.com/watch?v=cCFG9rO0W7s
Got a hard one for you guys. There is a song by PhonyBrony called "Don't You Dare Let Go", featuring Rina Chan as Celestia: https://youtu.be/NuGCHTY2J24It even has remixes: https://www.youtube.com/watch?v=hdLESQ5TB9oBecause PhonyBrony released the acapella in the description of his video. But, these dropbox links are dead.I've searched The Pony Archive, searched bing and google for any upload of the acapella, and even tried to search the Wayback Machine for the links. Yet, nothing.Do any of you happen to have the acapella?Here are the original links from the YouTube video description:Acapella:https://dl.dropbox.com/u/64168695/DYDLGVOX.wavhttps://dl.dropbox.com/u/64168695/DYDLGVOXHarmony.wavInstrumental:https://dl.dropbox.com/u/64168695/DYDLGInstrumental.mp3
>>40426688Have you checked wootmaster’s archive of pony stems?
an old spreadsheet that tracked mlp references in web comics: https://docs.google.com/document/d/18tFbR1_Sp0-8CeJ4wDoaZR3wCrHjnB0ITf7uaZ8WYUAthere's potentially a lot of stuff in here that's never been archived
>>40426688>>40427687well looks like he has the vocals, or at least one of the files https://mega.nz/folder/EJ1xmJCI#iKxTmMLn8T8m_59qxtZHnA/file/hdUWXYyQ
>>40425325Yes.
>>40428457Thank you muchly! I'm grateful for this archive.
2011 video not in TPA - "PMV: Ode to Celestia":https://invidious.12a.app/watch?v=Oi6mHNR5iFs"Freude, schöner Götterfunken,Tochter aus Elysium,Wir betreten feuertrunken.Himmlische, dein Heiligtum!Deine Zauber binden wiederWas die Mode streng geteilt;Alle Menschen werden BrüderWo dein sanfter Flügel weilt.Deine Zauber binden wiederWas die Mode streng geteilt;Alle Menschen werden BrüderWo dein sanfter Flügel weilt."of "Ode to Joy [Ode an die Freude]" by Ludwig van Beethoven; more on that:- "original" version: https://archive.org/details/youtube--kcOpyM9cBg- full version: https://www.youtube.com/watch?v=fYq1IBDAaWo- synthesizer version, offline at: ipfs://bafybeifh3dxgo5l264qw4qrmupboa42nmcpcjjgfi2vfy7kjvayzrawqdq
>>40431084>2011 video not in TPA - "PMV: Ode to Celestia":>https://www.youtube.com/watch?v=Oi6mHNR5iFsDownloaded via this command -- >>40405101, with a different $ids (similar command except for playlists at >>40412541) -- here:https://w3s.link/ipfs/bafybeiar6y3pcjfnrry4ijvccfveoitjtukcwluwzwfra7wljx33jpctwa>"original" version: https://archive.org/details/youtube--kcOpyM9cBgdownloaded via ia cli program ("$ ia download youtube--kcOpyM9cBg"), offline here: ipfs://QmUEfri6hnEVGpjPqQf6ut8tcQrNLANv4e394Z1DbheJme>full version: www.youtube.com/watch?v=fYq1IBDAaWobinary file seen here today: https://web.archive.org/web/20230424224323/https://www.youtube.com/watch?v=fYq1IBDAaWo&feature=youtu.be>synthesizer version, offline at: ipfs://bafybeif...wqdqonline here: https://ipfs.filebase.io/ipfs/bafybeifh3dxgo5l264qw4qrmupboa42nmcpcjjgfi2vfy7kjvayzrawqdq
another one of those massive youtube playlists with pony videos: https://www.youtube.com/playlist?list=PLc8Qq7z0zsbrAyLCsIxbXPWlgiDS7qOjD
>>40431084The fourth movement of the ninth symphony by Ludwig van Beethoven is also known as "Ode to Joy", and it is sometimes said to be the greatest piece of music ever created. It is one of my favorite pieces of classical music. In that folder for synthesizer versions of "Ode to Joy", I think I like the M4A file more than the WebM: https://gateway.pinata.cloud/ipfs/QmZaKkXVQxYNZucgSPPGTzK6coYiDyhunxwUye2YQow2h5>>40432289Get video ids from playlist:>.../z8/video/7572657$ yt-dlp -j --flat-playlist PLc8Qq7z0zsbrAyLCsIxbXPWlgiDS7qOjD > 1plist1.json; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; wc -l 1plist1.txt>WARNING: [youtube:tab] YouTube said: INFO - Unavailable videos are hidden>802 1plist1.txtSee if videos are in TPA or not:>$ cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txtDownload those that aren't (I could make longer filenames for log files and non-log files):>$ ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --embed-subs --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s_%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s_%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s_%(id)s.apimeta.txt" -- $args); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _Example of a filename format (title="Lavender Is The New Black - ShadesofEverfree"):* https://y.com.sb/watch?v=Iql76IKT59Q* https://new.theponyarchive.com/archive/youtube/ShadesofEverfree_UCg4tuyRcwZeTfK650jPrkHQ/Lavender_Is_The_New_Black_-_ShadesofEverfree-ShadesofEverfree-20151224-youtube-1920x1080-Iql76IKT59Q.description** $website/$channel_name_$channel_id/$title-$channel_name-$upload_date-$website-$dimensions-$id.$ext
^ Download finished a while ago, 683M, image from there. I tried like hundreds of Tor IP addresses, but couldn't get around the geoblock onhttps://invidious.polido.pt/watch?v=FDQRcstkPPwBlocked worldwide? A non-live or non-exact version is my only hope for that.
Found another paper on broniesFriendship Is Manly: The Brony Fandom And The Challenge Of Masculinityhttps://commons.und.edu/cgi/viewcontent.cgi?article=2934&context=theses
>page 10
4chan /mlp/ images, 1 terabyte,curation=Synthbot, type=expect delta releases for newer files in the future, format=CAR:magnet:?xt=urn:btih:9671fb0855c7931fe98f03f7612c18010fb10121&dn=4chan-mlp&tr=udp%3a%2f%2fopen.stealth.si%3a80%2fannounce&tr=udp%3a%2f%2ftracker1.bt.moack.co.kr%3a80%2fannounce&tr=udp%3a%2f%2ftracker.theoks.net%3a6969%2fannounce&tr=udp%3a%2f%2fretracker01-msk-virt.corbina.net%3a80%2fannounce&tr=udp%3a%2f%2ftracker.4.babico.name.tr%3a3131%2fannounce&tr=udp%3a%2f%2fp4p.arenabg.com%3a1337%2fannounce&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a6969%2fannounce&tr=http%3a%2f%2ftracker.openbittorrent.com%3a80%2fannounce&tr=udp%3a%2f%2fopentracker.i2p.rocks%3a6969%2fannounce&tr=https%3a%2f%2ftracker1.520.jp%3a443%2fannounce&tr=udp%3a%2f%2fopen.demonii.com%3a1337%2fannounce&tr=udp%3a%2f%2ftracker.tiny-vps.com%3a6969%2fannounce&tr=udp%3a%2f%2fsanincode.com%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337%2fannounce&tr=udp%3a%2f%2ftracker2.dler.org%3a80%2fannounce&tr=udp%3a%2f%2fuploads.gamecoast.net%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.torrent.eu.org%3a451%2fannounce&tr=udp%3a%2f%2fexodus.desync.com%3a6969%2fannounce&tr=udp%3a%2f%2fexplodie.org%3a6969%2fannounce&tr=udp%3a%2f%2fmovies.zsw.ca%3a6969%2fannounce.torrent file:https://w3s.link/ipfs/bafybeiakcwc7isj4hov3dzcocomtx3l6cxhyxquzapvezn5im2aptlugweThis was posted in the previous thread. Image - https://desuarchive.org/mlp/thread/28613494/#28618620
^ plus, 4chan /mlp/ text data (posts): >>40393205 >>40420293( First saw this guy's pfp in YT https://nitter.d420.de/IssahWywin/status/1674361179160948739 thought for a second that it was Derpy Hooves, looked closer, thought it wasn't; turns out it is this fictional species: https://antifandom.com/finalfantasy/wiki/Burmecian )
>/mlp/ imagesSome artwork has been lost, for example (and I can check and confirm that it is gone):https://desuarchive.org/mlp/thread/5455193/#5455362
>>40425485So those two videos are gone now. When were they killed?
>>40433038683MB ZIP file failed to upload to pomf.lain.la (not my fault) = waste of time. For rescene-zip if I want to improve it later:- File list: https://x0.at/n4Yg.txt- Happy_Rainbow_Dash_On_Stool_L41Y-3vnn2M: https://x0.at/2gJs.zip which should be 912fef869cfe3e63141fcd848f83ace6ac7a125f- youtube.com/watch?v=l41y-3vnn2mSelf-hosting an IPFS Gateway (only works locally if you set it to do that I guess): https://www.youtube.com/watch?v=xhJPz_efAQE- just run "docker run --rm -it ipfs/bifrost-gateway"
How did that end up all lowercase?- youtube.com/watch?v=L41Y-3vnn2M
>>40425485>>40436144Those two watch?v= urls are not in wbm. When did the channel get deleted?>>40436517I ran a gateway. A similar command was helpful. Didn't use --rm. The problem is now "ipfs mount": FUSE keeps mounting it as root and not as a regular user, even though I tried various stuff to fix this, and this was not very helpful:https://github.com/ipfs/kubo/blob/master/docs/fuse.md(It was slightly helpful.)
>>40433038Failed to download as stated inhttp://10.0.0.232/ipfs/QmcyYSALuLbkcVeUb3k86PVoicoTTTczFEkhpi7RhXY4jE/7572657/1error1.txt> ->>ERROR: [youtube] EoqXVCb0XkI: Private video. Sign in if you've been granted access to this video>ERROR: [youtube] FDQRcstkPPw: Video unavailable. This video contains content from SME, who has blocked it in your country on copyright grounds>ERROR: [youtube] r-CqCaU5JiA: Private video. Sign in if you've been granted access to this video>ERROR: [youtube] fgUxGQs0Cxw: Video unavailable. This video is no longer available because the YouTube account associated with this video has been terminated.>ERROR: [youtube] A29wOJnjWPM: Private video. Sign in if you've been granted access to this video>ERROR: [youtube] qFANgdyJvbY: Private video. Sign in if you've been granted access to this video>>40436964Somehow apache2 can now access folders/files owned by root and in the root group. What might have fixed it: I had mount.fuse and fusermount working but didn't have fuse installed (or I had an old version of it - like I had the /etc/fuse.conf file and stuff before "actually" installing it). I installed it by running "apt install fuse". Now I can see a basic Index of directory listing of wherever the symlink in /var/www/html/index.html points to. Now pointing to an ipfs mount at /ipfs/Qm... (can be accessed as a regular filesystem / "arbitrary application" usage). At the link, I see "Apache/2.4.52 (Ubuntu) Server at 10.0.0.232 Port 80" at the bottom on any computer in my local network.
>>40437095I was going to check to see if those YT IDs are in wbm; however, I am blocked right now, so not very easy to do that stuff.> http://10.0.0.232/sym-z8bipfs/1688102113/Pony%20Music%20Archive%2021.03%20(Raw%20Quality)/Artists/SlyphStorm/Sinking%20Ships.flac> http://10.0.0.232/sym-z8bipfs/1688102113/Pony%20Music%20Archive%2021.03%20(Raw%20Quality)/Artists/SlyphStorm/Double%20Rainboom.mp3Lit
> http://10.0.0.232/sym-z8audio/673d686/my-little-pony-talk_2012_01_21_friendship-is-magic-season-2-review--12012.mp3Said: " sailorcancer713.deviantart.com ". Image from there.
>>40437280
2015 video not in TPA - "Freestyle (All I ask of You- WMV,AMV,PMV)" ("odd"):https://invidious.silur.me/watch?v=E12dswZeNVQ
Wow, sexyponyhttps://web.archive.org/web/20231018035010/https://ponerpics.org/images/6803607
>>40437095>$ echo -n "EoqXVCb0XkI FDQRcstkPPw r-CqCaU5JiA fgUxGQs0Cxw A29wOJnjWPM qFANgdyJvbY" | xargs -d " " sh -c 'for args do wget --spider https://web.archive.org/web/1/https://www.youtube.com/watch?v=$args; done' _>[...]EoqXVCb0XkI>[...] https://web.archive.org/web/20140928124843/http://www.youtube.com/watch?v=EoqXVCb0XkI&feature=youtu.be>[...]FDQRcstkPPw>[...] https://web.archive.org/web/20151106104927/https://www.youtube.com/watch?v=FDQRcstkPPw>[...]r-CqCaU5JiA>[...] https://web.archive.org/web/20210627022632/https://www.youtube.com/watch?v=r-CqCaU5JiA>[...]fgUxGQs0Cxw>[...] nope; https://web.archive.org/web/20201119144324/https://www.youtube.com/watch?v=fgUxGQs0Cxw>[...]A29wOJnjWPM>[...] https://web.archive.org/web/20180620182935/https://www.youtube.com/watch?v=A29wOJnjWPM&gl=US&hl=en>[...]qFANgdyJvbY>[...] nope>$
>>40440313>https://web.archive.org/web/20210627022632/https://www.youtube.com/watch?v=r-CqCaU5JiAFirst snapshot, private video. Exact text searches found nothing for https://www.youtube.com/watch?v=r-CqCaU5JiA so I don't know what it was- failed: Google,Bing,Brave,Yahoo,Yandex,DDG- failed: https://archive.is/https://www.youtube.com/watch?v=r-CqCaU5JiA- failed: https://desuarchive.org/_/search/text/%22r-CqCaU5JiA%22- failed: https://filmot.com/api/getvideos?key=md5paNgdbaeudounjp39&id=r-CqCaU5JiA- not tried: thumbnails at https://i.ytimg.com/vi/[id]/- not tried: forgot a login to a Twitter account, and X searches are loginwalled so nitter won't work- not tried: possible snapshots of the playlist- not tried: other stuff, very unlikely to find it that way>https://www.youtube.com/watch?v=qFANgdyJvbYFound metadata!https://filmot.com/api/getvideos?key=md5paNgdbaeudounjp39&id=qFANgdyJvbY>[{"id":"qFANgdyJvbY","uploaddate":"2016-04-17","duration":11,"title":"What if Microsoft Sam voiced Sunburst","channelid":"UCyMIu0AY4rLVxonAleOkn2g","channelname":"Sonicrules831"}]
>>40440368>https://web.archive.org/web/20210627022632/https://www.youtube.com/watch?v=r-CqCaU5JiAhttps://web.archive.org/web/20210823180849/https://invidious.io/ = Invidious was not around back then>- not tried: thumbnails at [wbm/]https://i.ytimg.com/vi/[id]/*nope, also tried i1.ytimg.com, i2.ytimg.com, i3.ytimg.com, i4.ytimg.com>- not tried: possible snapshots of the playlist- failed: https://archive.is/https://www.youtube.com/playlist?list=PLc8Qq7z0zsbrAyLCsIxbXPWlgiDS7qOjD*- not tried: https://www.youtube.com/ [video=...&] playlist?list=PLc8Qq7z0zsbrAyLCsIxbXPWlgiDS7qOjD*>- not tried: other stuff, very unlikely to find it that wayfailed:https://archive.is/https://youtube.com/watch?v=r-CqCaU5JiA*https://archive.is/https://www.youtube.com/watch?v=r-CqCaU5JiA*https://archive.is/https://youtu.be/r-CqCaU5JiA*web.archive.org/web/20210627022632/https://www.youtube.com/watch?v=r-CqCaU5JiA= "Collection: Save Page Now [ https://archive.org/details/save-page-now ]"
>>40440400>double 404, dubschecked>- not tried: https://www.youtube.com/ [video=...&] playlist?list=PLc8Qq7z0zsbrAyLCsIxbXPWlgiDS7qOjD*So, somehow check every one of these in wbm:http://www.youtube.com/watch?v= {videoID} &list=PLc8Qq7z0zsbrAyLCsIxbXPWlgiDS7qOjD&index= {number}If there is a pre-2021-06-27 02:26:32 UTC one then the webpage might scroll to r-CqCaU5JiA.
>>40440434Check for possible years-old captures:>$ cat 1plist1.json | jq '.id, .playlist_index' | sed "s/^\"//g" | perl -pE "s/\"\n/ /g" | xargs -d "\n" sh -c 'for args do id=$(echo $args | sed "s/ .*//g"); num=$(echo $args | sed "s/.* //g"); live="https://www.youtube.com/watch?v=$id&list=PLc8Qq7z0zsbrAyLCsIxbXPWlgiDS7qOjD&index=$num"; wget --spider --max-redirect=5 "https://web.archive.org/web/1/$live"; sleep 40; done' _Playlist json from >>40432571
>>40432571>TPA filename formatReplicated:>$ yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" -- mH4u_uYH1X4>Halo_Reach_Death_Sound_replaced_with_the_MLP_Squee-Silverstreak_Gaming-20220818-youtube-1920x1080-mH4u_uYH1X4.mkvI prefer to have shorter filenames, but them's the standards. (channel_id for channel ID.)
Flutterwonder - partial timeline:1. comments deleted (mfk'd)2. video blurred in protest, can't undo3 or 4. comments back, for now3 or 4. video description changed3 or 4 or 5. reuploaded> https://www.youtube.com/watch?v=viTkj0eu-fk> https://www.youtube.com/watch?v=vrJTSxO517YVideo descriptions can obviously have multiple versions. The video file itself can have multiple versions too; it can be changed years after it is uploaded. This is a problem with non-trustless Internet stuff. A solution for a directory structure for trustless YT data, if multiple versions of description, thumbnail, or video file are discovered and saved:- ./history/v1/video/id- ./history/v2/video/id- ./history/v1/desc/id- ..v2..- ./history/v1/thumb/id- ..v2..
>>40435011
Older posts:>Anonymous Fri 17 Jan 2014 23:06:29 No.>>15740731>>>15740627>>If you want to smile ->>http://youtu.be/_ulwCsrWXwA>Anonymous Sun 09 Jun 2013 18:13:30 No.>>11258458>If you want to smile just turn in 0:13>>http://www.youtube.com/watch?v=8vT516cgifU
>>40442529npr videos fromhttps://desuarchive.org/mlp/thread/15739971/#15740731https://desuarchive.org/mlp/thread/11256516/#11258458
Instagram is not archive-friendly, and there are no longer any alt front-ends which work:https://wiki.archiveteam.org/index.php/Instagram#Accessibilityhttps://www.instagram.com/mylittlepony/BTW, thanks to Apache HTTP Server, I comfortably and locally watched a video where a man makes love to a mare and cums inside of her.
>>40441091Another example https://hobune.stream/tpa-h/videos/wXcsmSF8PYs
JeffthestriderAll videos unlisted/hidden/deleted>https://web.archive.org/web/20220916141416/https://vid.puffyan.us/channel/UCa1FspQEOQSF6ms0xOJhREQ>https://web.archive.org/web/20230325144758/https://vid.puffyan.us/channel/UCa1FspQEOQSF6ms0xOJhREQ>https://web.archive.org/web/20220916141400/https://vid.puffyan.us/watch?v=NbyQ8ORSNAk>https://web.archive.org/web/20231018110702/https://vid.puffyan.us/watch?v=NbyQ8ORSNAk&listen=0Toastychannel deleted>https://tpa.mares.workers.dev/?output=html&id=4LaXXKDySvE>https://vid.puffyan.us/watch?v=4LaXXKDySvE>https://invidious.protokolla.fi/channel/UCAhhHbl-zbrqjggUq-sMnTA
2009-07: Twilight Twinkle2010-10: Twilight SparkleSource=opening credits music as of 2009:https://w3s.link/ipfs/bafybeiecwtrwu4uuckwgiusxfag234nzplrtck43kx6zaka7tjssagenfu
>>40443235Was pretty sad when I found out about jeffthestrider’s uploads a while back. Didn’t think the channel was active at all so just assumed nothing was going to happen to it (or at least from the owner). If it helps, Jeffthestrider is also known as Stars in Autumn.
Retarded channel, maybe better never existing in the first place: https://vid.puffyan.us/channel/UCPu8ZVA77OMvLNwzTabKe8A . Original stuff in that channel: recording a TV playing something as the focus and objects near the TV, so not super interesting. I skimmed though that channel, seems mostly/entirely stupid. To save: non-video content (comments are original content), save videos if you feel like saving a bunch of "crap". Maybe I am being too negative, still, probably better to focus efforts elsewhere. pfp from that channel attached.2014 video not in TPA - "Friendship is Magic intro G1 Style (TV Trax cover)":https://proxied.invidious.fi/watch?v=KZ1KrZsvra8Is in TPA, 2012 - "My Little Pony: Friendship is Magic Opening [Full Song]":https://www.youtube.com/watch?v=ZiTVSjlTcvcI guess I will look into rsyncing to TPA. Maybe uploads are invite-only. IDK. I suppose I should research this other thing before doing that.
>>40443681>Maybe uploads are invite-only.You can ask in their discord server
>>40411889>https://www.derpibooru.org/images/1862424>>Happy Birthday, MLP:FiM! 13 years of FiM, and 40 years of MLP, so let's celebrate with an art event!>It began in 1982, so that's 41 years ago, not 40.This says 1983 also - https://www.youtube.com/watch?v=ag5v0EWppWw - YouTube videos, most reliable source.>>40443689Link?
Twibooru featured post just changed>https://web.archive.org/web/20231019053314/https://twibooru.org/>https://web.archive.org/web/20231019090752/https://twibooru.org/Lulzy image from>https://web.archive.org/web/20231019091000/https://twibooru.org/3066212I was looking at clop in the past, seeing someone getting fucked in the ass. I thought to myself: "You would probably die from that." A human did in fact die as a result of receiving anal sex from a horse. I first watched the Mr. Hands video like 10 years ago, didn't know the details until now:https://dweb.link/ipfs/QmXoypizjW3WknFiJnKLwHCnL72vedxjQkDDP1mXWo6uco/wiki/Enumclaw_horse_sex_case.html>The Enumclaw horse sex case was a 2005 incident in which Kenneth Pinyan[2] (June 22, 1960 – July 2, 2005), an American Boeing engineer residing in Gig Harbor, Washington,[3] died from injuries received during receptive rectal sex with a stallion at a farm in an unincorporated area in King County, Washington, near the city of Enumclaw. Pinyan distributed zoophile porn under the alias Mr. Hands.[4]>During a July 2005 sex act, videotaped by a friend, Pinyan suffered a perforated colon from receptive anal intercourse with a stallion and later died of his injuries. The story was reported in The Seattle Times and was one of that paper's most read stories of 2005.[5] It was informally referred to as the "Enumclaw horse sex case".[6] Video footage of Pinyan and a horse was later disseminated through the Internet.[7]>Pinyan's death rapidly prompted the passing of a bill in Washington prohibiting both sex with animals and the videotaping of the same. Under current Washington law, bestiality is now a Class C felony punishable by up to five years in prison.[8]>[goes on to point out that a filmed based on the events, "Zoo", was successful.]Death from sex with a stallion: what a way to go. That's what happens when you are a turbofaggot. Also, interesting that a law was pasted to protect humans from being harmed/killed in zoophilia situations; typically, you would think those laws are intended to protect animals from getting messed up or killed.
>>40443721It’s on their website https://theponyarchive.com/https://discord.gg/dGtwRph
>>40422488>Windows program for searching all of your files instantly: https://www.voidtools.com/Not very helpful if you have like more than 6 HDDs. It can be challenging to know what data is in which drive. For example, I may have already imaged this HDD which someone else gave to me (it has megabytes of IO errors): "0x6686a4f6.iso"; the hard drive image file might already be on some HDD somewhere.Unless, that program can make an index database of all files from all HDDs, and you can search the DB from just one file. Also should be able to update the DB, though that might use up too many HDD reads, idk.>>40443875Oh, thanks. I felt like I checked that homepage before and didn't see it.
>>40320843" https://mlp.heartshine.xyznow redirects tohttps://mlp.heartshine.gaywhich includes- G5 https://mlp.heartshine.gay/- G4:FiM https://fim.heartshine.gay/- G4:EqG https://eqg.heartshine.gay/- G4:PL https://pl.heartshine.gay/- G3 https://g3.heartshine.gay/- G1 https://g1.heartshine.gay/ "Grabbing these now, starting with FIM.
>>40444320Finished>/z8/web/5d597da/fim.heartshine.gay/fim.heartshine.gay-2023-10-19-93f11fcfThat websites has some videos I think, but grab-site didn't get them due to JavaScript.
>>40374914My friend found out the reason. Seems like it's been taken down for now because it had a couple of bad tags and they want to make sure the metadata is as good as it can be for archival purposes. Also they were planning to make a website just for the le soldat pony archive. They're probably going to get that done first before putting it back up.
>>404433642013: Twinkle Sprinkle
>>40443773(By "just changed" I mean sometime between hour 5 and hour 9.)
So why does stuff in websites get deleted? Some of the reasons:- commenters denigrating it- the platform denigrating itComments seem to be a weak reason, but I am sure users have deleted stuff due to getting trolled or whatever. Comments do not matter a whole lot in regards to persistence of the content. The platform itself being against it in some way is more concerning: either deleting it, or restricting access to it.For example, the website https://archive.org/ engages in overly-moralizing bullshit: reasons that an item gets flagged, collections items gets put it. However, just like comments, this is just some guy's opinions, being expressed explicitly; therefore, such denigration can be ignored. Not like this "official" category or opinion matters worth a damn if it is subjective. It is only really a problem when it gets deleted as a result; restricted access is annoying, but not that bad.This is one reason why file sharing is appealing; with P2P or other methods of file sharing: you don't have to look at moralfaggotry from whatever "archive" website. Something is more truly archived if it available from multiple places, not just one website or one guy. Paying to run VPSs or to have your data hosted with Filecoin/whatever or to improve your own self-hosting stuff: it is almost worth it as you won't be subject to the negativity that centralized platforms sometimes apply to uploads. Ideally you could pay for that positive solution for your entire lifetime. And nearing the end of your life, if archive.org is still around, you could upload it there and also donate to that website. If they restrict access or delete it or whatever, at least you won't have to look at it because you will be dead by then. And after your life, perhaps the data will also or only persist in a decentralized way, more likely if it is popular or "valuable" or part of a data DAO or something. Pic unrelated
2013 video not in TPA - "PMV Gee " (unique images):https://yt.upgods.us/watch?v=eAjZBYTn3Gg
2017 video not in TPA - "Rainbowdash and Soarin Take me home tonight" (slideshow PMV, fanart, Eddie Money, cloudflare link below):https://ytcf.upgods.us/watch?v=6dpFsYE5zd0
>>40443235Original content based on older content:https://w3s.link/ipfs/bafybeif3uofeugb5ju37pic6cuobib2fffqgjqjuic7pjpt5ssldqbct3y/7b451f6/(folder has older files, better audio sync=move audio forward ~0.2sec)
>>40420293File info as stated inhttps://bafybeic32qdav3h7gknbxxxx5fy4liaqnjo24bdnt24u2t6dqxlovo4y7a.ipfs.dweb.link/?filename=lsjson_r.txt> = versions that I have =>HOWTO: Accessing IPFS datasets.txt","Size":27,"ModTime":"2022-06-24T17:06:04.000Z","ID":"1CCuz_des2IGVzV_9AVDpJuH45dYBN_-x">derpibooru.image-taggings.parquet.0","Size":409257281,"ModTime":"2022-06-22T23:02:37.000Z","ID":"1iBLRw2pfJSTelPsMvNuPh2l6J1BXNlyn">derpibooru.tag-properties.parquet.0","Size":14064187,"ModTime":"2022-06-22T23:02:06.000Z","ID":"1Zg_fgnBNyqyd3XiEW3CARG5ixarugAvw">derpibooru.image-properties.parquet.0","Size":1073663456,"ModTime":"2022-06-22T23:02:05.000Z","ID":"1T_5Dnpzk8DjzUGXbG2KWTc5ftZEOZb-0">desuarchive.post-properties.parquet.0","Size":4954937309,"ModTime":"2022-06-22T08:28:01.000Z","ID":"1yitkjUofCbJrBYiv9001lTx8mBr0RwBo">desuarchive.thread-properties.parquet.0","Size":3819446,"ModTime":"2022-06-22T08:26:45.000Z","ID":"13QASmyfeOXmvrZgsgkZlRmnHEe6DpjSm">>40443061It was easy to password protect that Apache web server - https://www.youtube.com/watch?v=00bwCjPp-FU - however, when I authenticate at http://10.0.0.23/ (username+password) it says that the password will be transmitted unencrypted as plain text. Maybe there is a way to get a private IP address to use HTTPS instead of just HTTP, or some other setup.
I found a Google Drive API key. Hopefully it will work long enough to save metadata locally and to wbm. First I could check if wbm has certain IDs under that one key where like millions of JSONs were saved (I know it does not have some). I also found multiple YouTube API keys, which seemingly were easier to find.Google API keys can be used to read data, but can they be used to write data? For YouTube, I don't know all of the cases, but you basically cannot upload a video with just an API key, as seen here https://www.youtube.com/watch?v=aFwZgth790Q , and a similar thing for reading and writing data with rclone happens (interacting with Google API, client secret and ID, logging in, allowing access).
^ *with rclone [interacting with Google Drive]The plan is something like this: use my own key and see how many raws I can get before hitting the quota limit. Then use some other guy's "public key" (which he might have accidentally posted somewhere that I saw) to save warcs: doing maybe half of the quota limit number every 24 hours. URLs:- files >>40413056- folders >>40416639
>>40447877931,957 MLP-related Google Drive IDs:https://dweb.link/ipfs/QmeZLFkzycAL4nL7JdHMWibXhRCPzFjp2x35kaXRtzZ7mrI can test my key on those "low risk" items: 811,307 files and 120,650 folders (/z8/text/3151ebd/). This post refers to metadata only.
>>40447857Not sure if you noticed, but the last time we had a thread for getting google drive resource keys, there were a couple of people with google drive api keys who had saved a lot of metadata, or at least for the links that were scraped from pony sites. It's worth trying to find the list again so you don't do unnecessary work.
>>40447956But did they save the links to web.archive.org?
>>40447369Short link forhttps://w3s.link/ipfs/bafybeib3n5j2ene6js4ukh5oxefsdcmhqqyt5nih5admwdnp4sowqout7y= https://archive.li/GgHAY>gg HAY>>40449553I mean these links >>40447877 :* to match with AT:** files: content.googleapis.com** folders: clients6.google.com
>>40443773Funny how Mr. Hands makes sense as an in-universe name (cf. Derpy Hooves):column1 , column2My Little Pony , My Little HumanPonyville , HumanvilleMs. Hooves , Ms. Hands>>40447566HTTPS uses SSL or TLS for encryption and security and privacy. HTTP uses neither Transport Layer Security (newer/better) nor SSL. To use HTTPS you gotta enable SSL with Apache; also configure apache2 to use SSL and a self-signed certificate for a private IP address or domain name. How:> maybe the best guide - https://www.youtube.com/watch?v=SlcrTSvMioU> apache2 w/SSL+certificate - https://www.youtube.com/watch?v=5JNZdDnH4l4> convoluted method, bunch of steps to use HTTPS by using the public Internet to access your own private local network - https://www.youtube.com/watch?v=qlcVx-k-02E> "A certificate can be bound to an IP address (see this). You can issue a self-signed certificate to a private address" - https://code.whatever.social/questions/38125490/placeholder> "SSL certificates are bound to a 'common name', which is usually a fully qualified domain name but can be a wildcard name (eg. *.example.com) or even an IP address, but it usually isn't" - https://code.whatever.social/questions/1095780/are-ssl-certificates-bound-to-the-servers-ip-address> "SSL certs rely on FQDN's (Fully Qualified Domain Names) not IP addresses."=contradiction - https://superuser.com/questions/791015/https-over-private-network> too long didn't read; maybe use step - https://code.whatever.social/exchange/security/questions/121163/how-do-i-run-proper-https-on-an-internal-network
Wonder why this playlist has these videos:https://web.archive.org/web/20231021100036/https://y.com.sb/playlist?list=PLXGBPIXPEUMLqoYD2rOSnA75p6D-ucCQ3Maybe due to the account being hijacked (money for views), or the account owner randomly putting videos into whatever playlist. Saw that account (banner attached) linked fromhttps://y.com.sb/playlist?list=FL60LK5ujW8qUK27PffNadFg&page=4
>>40437095TPA also uses that same version of Apache in that same OS:>https://web.archive.org/web/20231014100129/https://new.theponyarchive.com/archive/quickchive/Top_10_My_Little_Pony_Characters-MsMojo-20161215-youtube-1920x1080-yQhiUAPs3-Y.info.json>Apache/2.4.52 (Ubuntu) Server at new.theponyarchive.com Port 80But shouldn't it say "Port 443"?>>40450517Or, accidentally adding videos to a playlist (misclicking).
2011 video not in TPA - "My Little Pony Pairings - Darlin' Darlin' Baby" (nearing 1/2 million views):https://www.youtube.com/watch?v=lmXTzeHOfSc
A link from around when nitter became inoperable due to twitter changes: https://web.archive.org/web/20230613030806/https://nitter.privacydev.net/Gabishy04/with_replies?cursor=DAABCgABFySPhA6_-MEKAAIWNVZQtNRwAQgAAwAAAAIAAA>>40433463That is a 232-page PDF file.
>>40433463>>40450750Copied:>$ id=" fa21af1fde218afee3142faee77e "; utc; ~/Downloads/ia list $id 2>/dev/null || curl -sL "https://commons.und.edu/cgi/viewcontent.cgi?article=2934&context=theses" | tee friendship_is_manly_paper.pdf | ~/Downloads/ia upload $id - --remote-name="friendship_is_manly_paper.pdf" --metadata="title:Friendship Is Manly: The Brony Fandom And The Challenge Of Masculinity" --metadata="mediatype:text" --metadata="collection:opensource" --metadata="subject:academic paper; PDF file; PDF; pony; My Little Pony; Friendship is Magic; cartoon; snowpity; 2010s; the 2010s; brony; bronies; MLP; FIM; ponies; mare; mares" --metadata="date:2016-01" --metadata="creator:Samuel Miller" --metadata="description:From https://commons.und.edu/cgi/viewcontent.cgi?article=2934&context=theses" 2>&1 | grep -v "^/usr/lib/" | grep -v " warnings.warn(" | xxd -ps - | sed "s/e29688/23/g" | xxd -ps -r - | sed "s/\x20\x20/ /g" | xxd -ps - | sed "s/e29688/23/g" | xxd -ps -r -; utc>Sat, 21 Oct 2023 14:48:49 +0000>fa21af1fde218afee3142faee77e:> uploading friendship_is_manly_paper.pdf: 100%|##########| 6/6 [00:03<00:00, 1.75MiB/s]>Sat, 21 Oct 2023 14:49:24 +0000>$->https://archive.org/download//fa21af1fde218afee3142faee77e
>>40422488Hi everypony. Rewatching right now, is Netflix S1/2 color corrected or also desaturated? I’m watching it on heartshine but it uses the US files instead of the Australian or color corrected ones. Are there any online versions with the correct color gamut? I don’t want to torrent the whole thing off of YayPonies, I just want to watch it in my browser.t. out of the loop returning oldfag
>>40452257YayPonies=YP.Audio quality - YT vs IA vs PonyTube (not considered=YP, NF):https://desuarchive.org/mlp/thread/40219665/#40227693- YT is bestImage quality - YT vs YP vs NF- IDK, would like to know. I have NF.Web-DL locally, except for season S5 and after where no one shared the no-derive NF files as far as I can tell.You can watch YayPonies video files online in Tor Browser:https://desuarchive.org/mlp/thread/40219665/#40223115Not sure if it will be too slow in Tor. If it is, pick a faster relay. Or just download and seed the torrents; it is not that much storage space.> heartshineWill keep that in mind if I further grab these sites: >>40444320 >>40444348
>>40452257FIM S1 YP, play mkv files in Chrome (incl. Brave, Silk Browser): >>40329790https://archive.org/download/yp-1-r-01x-26
>>40452666Thanks anon. Is there S2 up as well?
YouTube community tab has a thing to vote for options 1, 2, or 3 in a post, example:https://web.archive.org/web/20231020090323/https://y.com.sb/channel/UCKOvOaJv4GK-oDqx-sj7VVg/community^image from this link attached; "turbofaggot" -->>40443773Don't know how to save those polls. More importantly, I think community posts have replies. Also don't know how to save that. When that /mlp/ YouTube channel was deleted, some of the community tab was lost forever.
>>40452793For now it is. Stuff gets deleted off of archive.org more frequently than you would think (so at least save it to archive.ph):https://archive.org/search?query=yayponies
>>40441091Also pic related guy: descriptions deleted>>40443072What's the difference?
>>40443061No other Bibliogram instances linked here:https://cf.farside.link/Linked from https://github.com/benbusby/farside> please be aware that Cloudflare takes steps to block site visitors using Tor (and some VPNs), and that their mission to centralize the entire web behind their service ultimately goes against what Farside is trying to solve. Use at your own discretion.>>40453246Descriptions are different with wXcsmSF8PYs
>>40453275Quora is also not archive-friendly, e.g.: WBM-excluded. However there is an alternative front-end for it! Linked from Farside, example page:https://quetre.iket.me/My-12-year-old-hates-himself-for-watching-My-Little-Pony-What-should-I-do> There are boys who like “My Little Pony”. They are called “Bronies”. My son is almost 19 and his favorite pony is Rainbow Sparkle. He battled with what people would think. He keeps his feelings close to home. He found out that there are Bronies who are in the Army and other branches of the military. My other sons told their little brother that they also liked it when they were younger. They watched it with their sister when they were kids.Still has this kikery:> This is a Quora plus answer and hence full answer is not viewable.> [Rate limit reached]Image: Rainbow Sparkle
>>40452795I think the community posts are not supposed to be cached by google’s crawl. I’ve never seen a google cache of the community tab. I don’t know how to archive the polls, but the comments on the community tabs could probably be archived the same way this script does comments on videos: https://github.com/egbertbouman/youtube-comment-downloader
Anyone else automatically saving sets of URLs to web.archive.org? I have hundreds of thousands of URLs to save, and they are being saved by two IP addresses right now. I could derive some URLs from this text file (music, mp3, Everfree):https://gateway.ipfs.io/ipfs/bafkreiani5bm3xjodxywjc4nmu6rqrh3xm2bhrclwh5rdli75c36ldffhi
>>40454122I’ve been doing some on my side too but not many URLs at all. Just whatever I happen to come across every few days.
2022 video not in TPA - "MY LITTLE PONY | #geometrydash":https://www.youtube.com/watch?v=pyPk8hD4okYhttps://librarian.esmailelbob.xyz/@TheSmashDasher:9/my-little-pony-geometrydash:4
>>40449627rclone can show json metadata on Google Drive files and folders, but this is some of the benefits of the API for info on items:* per ID (a gdrive ID is a fixed-length string which refers to a file or directory)** shows owner id** shows resourceKey
>>40447939About a day ago it seems that I finished downloading the raw jsons for those 120,650 directories. IIRC rclone could get like 700,000 before hitting a rate limit. Was running zero delay for both methods of download.
>>40423020Something like this, years since last upload:1=somewhat inactive, might post more2=inactive, somewhat unlikely to upload more3=more inactive, unlikely to post more4=even more inactive, very unlikely to post more5 to 10 or more=not coming backYou mentioned statistics in the previous thread. Maybe a study has already been done, about time since last post and how that relates to a user making any more posts or uploads. It likely varies by website and is also related to the total posts/uploads that a user made (like in phpBB forums if some guy just makes like 3 posts and is never heard from again).>>40454778By "finished downloading" I also mean I had no rate limit errors, it seems, or I guess.
another youtube playlist that's probably mostly pony https://www.youtube.com/playlist?list=PLVmXPgEYnY4e0A0Lwhv9PGRx5ntCCcW2l
^Playlist with 1304 videos
Anyone have experience with zpools getting a status of "SUSPENDED"? This happened multiple times on this one brand new 5TB external HDD (ran smartctl test on it when I first got it). I can "fix" it by doing stuff with hardware and software. Hope I don't end up completely screwed later on.>>40454122Non-Tor IP address blocked for now
>>40457036>Non-Tor IP address blocked [by web.archive.org] for nowWas looking for a clearweb thing for this:- morty = nope- https://httpstatus.io/api = nope, gotta request an API token- https://www.apivoid.com/api/url-status/ = nope, loginwalled, paywalled- https://helloacm.com/tools/can-visit/ = nope- ...Solution = use some other darkweb network: Lokinet - I can now avoid a website blocking me via two methods. How (I didn't use the lokinet GUI):>https://docs.oxen.io/oxen-docs/products-built-on-oxen/lokinet/guides/installing-on-linux-cli>https://docs.oxen.io/oxen-docs/products-built-on-oxen/lokinet/exit-nodes>https://oxen.directory/exitnodes/>https://loki.network/2020/11/20/lokinet-exit-nodes-explained/Nope, cost money; therefore "sudo systemctl mask lokinet". Update: http://exit.loki and http://exit2.loki seem to be paid, and http://euroexit.loki seems to be free. ( euroexit.loki = http://nig7jc9twyauypb8iabmac9e9jrf4dh9dmtw1r5jt7y7i5qy5fmo.loki )DNS problem which I fixed ( https://www.youtube.com/watch?v=3WiM70R09r0 ) - add "nameserver 127.3.2.1":>$ sudo vim /etc/resolvconf/resolv.conf.d/headupdate:>$ sudo resolvconf -ucheck:>$ cat /etc/resolv.conf>[...]>$ curl checkip.amazonaws.com>[IP address starting with "5." (not mine)]>$use your own IP address again:>$ sudo systemctl stop lokinet>$ curl icanhazip.com checkip.amazonaws.com>[... maybe comment-out "nameserver 127.3.2.1" in file "head" and run "resolvconf -u" again]Image from https://twibooru.org/search?q=loki&random_image=y-> https://twibooru.org/posts/48276?q=loki
>>40421216 >As a summary, data not shared yet:>- compressed version of older animation data>- ipfs refs index before deleting stuff off of server(s)>- derpibooru images via 1.00 TB torrents (preferred size by me)I finished updating my derpibooru scrape. I'll post a torrent of that soon. It'll be in the same format: CARs of folders of images. This one will have two folders of CAR files: one where the filenames are sha512 hashes of the images, and one where the filenames are derpibooru image ids. The two folder together contain everything I have. I'll post parquet files with all of the metadata too. The parquet files map image ids to sha512 hashes, so either one should be enough to identify the image.I have the compressed animation data too. I'll post that torrent at the same time.
>>40457312Lokinet exit node euroexit.loki is fine to circumvent a wbm block, but it looks like it anonimizes all Internet traffic, not only TCP, but also UDP. Therefore, it makes BitTorrent use said node. That exit node is this slow: max upload speed of 34 KiB/s (torrents). Also, I said some of those exit nodes were paid: might be incorrect since that was a snap judgement before I made DNS work with Lokinet.>>40457499I assume you will release delta torrents for Derpibooru: containing future files. (Like you said you would with desuarchive.) Speaking of /mlp/ images, you said that same-MD5 different-file images were post to /mlp/ and that was a problem since your key ID is the mediahash. This may help for non-same-filesize cases: differentiate same-MD5 different-file images by filesize. That could automatically fix for part of the problem. Such images could be released as a side thing, not asking you to reprogram whatever to have said functionality.
>>40432289>>40432571>>40440583>>40440434>>40440400>>40440368>>40440313>>40437095>>40433038>>40436517In that playlist, not in TPA, downloaded by me (except the videos that are gone now):wbw0_TtjsyE zOwm9yAFtsc 8aXI3izeeng TQsDkQnvPH8 EoqXVCb0XkI EoqXVCb0XkI 8Cx-6vln1O8 FDQRcstkPPw nemWG-NnoQw EBwgs2Rekn0 8hJTHC5Dp2c r-CqCaU5JiA 4Ju2E2T5n7M DCB7UCtGHGc W-c4EMqyTyQ ZwyJS2iaEpI 0yJQnNQ_kFw nWNZFQw1uWE DaugerAnOVw leaX_4YmCpk fgUxGQs0Cxw b3AM1B8XI88 -JkTmfdCjM8 A29wOJnjWPM W96q6X30zEs eXR-jnyQ-TY HTGPPHlwGcg L41Y-3vnn2M KzBnpa69IHw Dqy9GT4l7lg U94zEn_EFgs YjfXEVgH55A WtQZl2C02OE OcSvhCfOepo l_EDBM1tOEo 7LPpcKHpKVk 4NdGnEXe6MM G-gndUplGSk 3YPsnC8LEPw 3YPsnC8LEPw 6SgZAjOd0JI Y-O5ddjjbMU QDjSQTOAFk0 qFANgdyJvbY IJNv4GKmct8 Cet7nSuK6gA GU-fDyy82qg>Everything around seemed to giggle glee>She walked up with a flower and I cared>...>There we could be dancing>And you'd smile and say, "I like this song">And when our eyes will meet then>We will recognize nothing's wrong>https://archive.org/details/ACPavilion/01+-+In+the+Flowers.flac>https://sing.whatever.social/Animal-collective-in-the-flowers-lyrics
>>40458034>I assume you will release delta torrents for Derpibooru: containing future files. (Like you said you would with desuarchive.)That's correct.>differentiate same-MD5 different-file images by filesize.Good idea. I can check the file format too. I can keep a separate folder for files with duplicate md5 hashes.
I just tried downloading a playlist with yt-dlp. Out of 12 videos, only 5 downloaded. For the rest it says: ERROR: fragment 1 not found, unable to continue.I have very little experience with yt-dlp. What do you do in this situation?
>>40458444Huh. I was expecting more new videos from that playlist. Thanks anyway.
>>40457499== # compressed older animation data ==magnet:?xt=urn:btih:c56b7b60b0ac5092d01f26ba92600d7468d76c7f&dn=rendertraces.zip&tr=http%3a%2f%2fretracker.omsk.ru%3a2710%2fannounce&tr=udp%3a%2f%2ftracker.leechers-paradise.org%3a6969&tr=udp%3a%2f%2ftracker.cuntflaps.me%3a6969%2fannounce&tr=udp%3a%2f%2fzephir.monocul.us%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.grepler.com%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337%2fannounce&tr=udp%3a%2f%2ftracker1.wasabii.com.tw%3a6969%2fannounce&tr=http%3a%2f%2fgrifon.info%3a80%2fannounce&tr=udp%3a%2f%2ftracker2.wasabii.com.tw%3a6969%2fannounce&tr=udp%3a%2f%2fp4p.arenabg.com%3a1337%2fannounce&tr=udp%3a%2f%2ftracker.bluefrog.pw%3a2710%2fannounce&tr=http%3a%2f%2fpow7.com%2fannounce&tr=https%3a%2f%2fcarbon-bonsai-621.appspot.com%3a443%2fannounce&tr=http%3a%2f%2fshare.camoe.cn%3a8080%2fannounce&tr=http%3a%2f%2ftracker.sktorrent.net%3a6969%2fannounce&tr=http%3a%2f%2fretracker.bashtel.ru%3a80%2fannounce&tr=http%3a%2f%2fkickasstracker.com%3a80%2fannounce&tr=udp%3a%2f%2ftracker.coppersurfer.tk%3a6969&tr=http%3a%2f%2fretracker.telecom.by%3a80%2fannounce&tr=http%3a%2f%2fretracker.spark-rostov.ru%3a80%2fannounce&tr=udp%3a%2f%2ftracker.kamigami.org%3a2710%2fannounce&tr=http%3a%2f%2fbt.artvid.ru%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.vanitycore.co%3a6969%2fannounce
>>40459227Sounds like you are using an older version of yt-dlp.yt-dlp --versionyt-dlp --update>>40459968For me, it is stuck downloading the .torrent file (status="Downloading metadata"). If you restart your BitTorrent client, maybe that will fix it. Or I could restart mine some time later/soon.
I wanted to watch this, but I can't, not in TPA:https://breeze.whateveritworks.org/mlpfanart/wiki/File:For_Whom_The_Bell_Tolls_PMVhttps://web.archive.org/web/20160412090807/https://youtube.com/watch?v=AN5hhktzPvM>For Whom The Bell Tolls [PMV]>The requested video has been archived but is not currently available for playback.
>>40460315All videos on that channel are hidden/deleted:>https://web.archive.org/web/20131106195235/https://www.youtube.com/user/robohobosapien>https://web.archive.org/web/20220921084001/https://vid.puffyan.us/channel/UCUB_GA4nkNyl6S4ByWttJVg
>>40460315Fandom.com sucks cock so I cannot see the history of that page which should be athttps://mlpfanart.fandom.com/wiki/File:For_Whom_The_Bell_Tolls_PMV?action=historyStill alive - this lower audio quality 2018 vid: "My Little Metallica:MLP PMV:For Whom The Bell Tolls" (I mostly didn't watch this)https://farside.link/invidious/watch?v=cjBvWIWy2qY
>>40460032It looks like it's fixed now. qBittorrent was stuck trying to use a bad tracker.Re: the moe images. I'm regenerating some of the car files, so I guess this'll be a test to see if ipfs-car can produce deterministic outputs. I moved the folder location, qBittorrent reset the completion status to 0% and started downloading & overwriting existing files.
>>40460355Reminder that MrPoniator got his page removed from that wiki archive<dot>ph/ANH5z
>>40447857That key:>https://ipfs.eth.aragon.network/ipfs/Qmdiibe7NijDutVS9HLeFG11cweHqHvusxxKSx3R2Xoy8G>https://nftstorage.link/ipfs/bafybeids4leapduhoiwkz7yqnhbx6sn2mdc6y5on3omodxgs32q3iaavoa >https://w3s.link/ipfs/bafybeib5josx3zflifvauaguyalereaqirwdk7ffxlhsk65u6gscgrbhme>>40458034I wonder if there is a way to make a Loki exit node only apply the onion routing / VPN to a specific program, such as wget.
>>40460355>https://www.youtube.com/watch?v=cjBvWIWy2qYVideo not in TPA - and that channel has some MLP-related videos with 2 views each (uploaded in 2018):https://www.youtube.com/watch?v=FKbTQo9lwswhttps://www.youtube.com/watch?v=B-T8LgIM0wshttps://www.youtube.com/watch?v=Cd2UL4rJmOg>>40447857That key:>https://ipfs.eth.aragon.network/ipfs/Qmdiibe7NijDutVS9HLeFG11cweHqHvusxxKSx3R2Xoy8G>https://nftstorage.link/ipfs/bafybeids4leapduhoiwkz7yqnhbx6sn2mdc6y5on3omodxgs32q3iaavoa>https://w3s.link/ipfs/bafybeib5josx3zflifvauaguyalereaqirwdk7ffxlhsk65u6gscgrbhme>>40458034I wonder if there is a way to make a Loki exit node only apply the onion routing / VPN to a specific program, such as wget.
>>40456973Guess I will do something with that after grab-site finishes getting /pag/ 1 through 14>>40460545>www.youtube.com/watch?v=B-T8LgIM0wsFirst read some of that FIM comic months/years ago, just now fully realized (when watching that YT video) that it make a reference to the 1978 film "Invasion of the Body Snatchers".
2016 video not in TPA - "Twilight Sparkle And Rarity VS Pinkie Pie And Applejack In A MUGEN Match / Battle / Fight":https://www.youtube.com/watch?v=MmUQTrcqGtk>>40460538Forgot to delete this post sooner>9.9 minutes elapsed"you must wait longer before deleting the post">55 minutes elapsed"you cannot delete a post this old"
2012 video not in TPA - "Epic Sax Pony":https://nyc1.iv.ggtyler.dev/watch?v=R7eemv4jXEY
>>40460973Nice video. Channel dl:>$ yt-dlp -j --flat-playlist UUMBovEEdb7pwLyfx2kepX_w > 1plist1.json; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; ids=1plist1.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --embed-subs --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _
>>40461039>http://10.0.0.232/z8/video/752d52c/20darkmoon_UCMBovEEdb7pwLyfx2kepX_w/See_Dashie_s_Smile-20darkmoon-20120227-youtube-1280x720-C9QiGCd9s7g.mp4Neat, funny ( youtube.com/watch?v=C9QiGCd9s7g ). Attached=channel banner.>Exit nodeWhere I would put my proxy IP address, if I had a working one:>wget ... -e use_proxy=yes -e http_proxy=127.0.0.1:8080 ...Tried this - https://joshalosh.github.io/loki-docs/Lokinet/Guides/RouteThroughExitNode/ - but changed to bind to a different thing. Didn't work. Related problem: >>>/g/96885980
>>40461461Tryhttps://overflow.smnz.de/exchange/unix/questions/210982/ddg
>>40462920With YouTube, maxres.jpg is not always the same image as mqdefault.jpg for the same video ID; example:>https://web.archive.org/web/20231023103551/https://y.com.sb/channel/UCGWA-ri04z1UHaDfHRzCXiA?sort_by=popular>https://web.archive.org/web/20231023103524/https://y.com.sb/watch?v=CalwzkbkR-A
2022 video not in TPA - "Carrot's Privateers":https://sea1.iv.ggtyler.dev/redirect?referer=%2Fwatch%3Fv%3DEuf2DO6cYQE>>40456357Downloading it:>.../z8/video/7572657/p2$ utc; yt-dlp -j --flat-playlist PLVmXPgEYnY4e0A0Lwhv9PGRx5ntCCcW2l > 1plist1.json; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; wc -l 1plist1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --embed-subs --write-description --write-thumbnail --convert-thumbnails png -o "%(channel_name)s_%(channel_id)s/%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(channel_name)s_%(channel_id)s/%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(channel_name)s_%(channel_id)s/%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc>Wed, 25 Oct 2023 06:15:32 +0000>1306 1plist1.txt
>>40463617> Carrot's PrivateersParody of "Barrett's Privateers sung by Stan Rogers et al.":https://ipfs.filebase.io/ipfs/bafybeiec3cpeuhg2md6ep2czltijclm4ekix5dljncxr74b7l6ny625y7u>https://console.filebase.com/buckets/[...] -> "Free accounts do not allow HTML file uploads."Here: https://x0.at/kWZe.carhttps://web.archive.org/web/20230414090354/https://gateway.pinata.cloud/ipfs/QmaZ3sK93tgAMEhsTnHB8DT5dz765u2BAu1kpKHy6eYiHA/>%(channel_name)sShould be this instead:%(channel)s
Tracking>03 Jul 2023>>40086133>Was taking a bit of inventory:>- z1: 3 terabytes from somewhat recently downloaded website warcs, more to dl>- z4: 1 terabyte from recently downloading two Pony Music Archive (PMA) torrents, more to dl>- z2: 2 terabytes of more recently downloaded website warcs, multiple hundred GB of related data(About 6TB.) Now, 3 months 22 days later:- 1 terabyte, roughly, from Leaks (mostly 2019), counting compressed and uncompressed- 1 terabyte, from /mlp/ images (overlaps some with other datasets)- ###G from various: ##G various, 6G text/mlp/depri, 0.5G DRD game, 6.4G con spreadsheet warc, 232G fanfiction, . . .>>post in previous threadAlso >>40173021>1598.+Blumchen+-+Boomerang+(Langer+Boooomerang+Mix).mp3
Maybe still dead/offline - Ponyfinder:https://desuarchive.org/mlp/thread/40308896/#40357282Tracking>>40463992- ###G from various: ~141G www.mlptp.net warc, 16G EQD Minecraft world compressed+extracted, 14G photobucket raw+warc, 14G MLP The Manga raw+warc, 20G archive.org/details/ raw+warc w/ low relation, 45G shared music and videos "rescened", 170G l sagateMLP, 2.7G whinnycity.com warc, 6.7G theponybusiness.com warc, 1.6G ww.strawberryreef.com warc, 0.666G yum-yum-ponyworld.weebly.com warc, 1G heartshine.gay warc (JS-incomplete), 2.2G s_yiak, ~8G yandex drive w/ medium-ish relation, 0.52G MLP NFTs, ~33G rendertraces.zip, ~100G various+variousYTSo, "various" sums to something like 1T.>Leaks compressed+uncompressed = ~1TMore like 1.5TB:https://desuarchive.org/mlp/thread/40219665/#40264911>>40173986Thinking I never did this in time, RIP (and no one else really tried for it):>8 pages here:>https://desuarchive.org/mlp/search/text/%22photobucket.com%22Pic unrelated
>>40464138141G+245G+16G+14G+14G+20G+45G+170G+2.7G+6.7G+1.6G+0.666G+1G+2.2G+8G+0.52G+33G->https://chat-gpt.org/chat->had to solve a captcha (didn't have any captcha in the past)->[...] = 584.386 G
>>40464138https://www.wolframalpha.com/input?i=+435+GB%2B+132+GB%2B+290+GB%2B12.7+GB%2B211GB%2B111+GBThose MLP Leaks files = 1192 GBpfp from https://web.archive.org/web/20231025042515/https://y.com.sb/watch?v=DuIfez3Vf6c (npr)
My Little Pony Book Collection = dead/offline (.torrent file?):> magnet:?xt=urn:btih:91b8bf3b723472962bcbfb52074d622ef1ed1af2&dn=My+Little+Pony+Books+Collection&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80&tr=udp%3A%2F%2Fopen.demonii.com%3A1337&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969&tr=udp%3A%2F%2Fexodus.desync.com%3A6969MLP Friendship is Magic S1-S9+Movie+Specials = alive and distributed to a medium degree (193 GiB):> magnet:?xt=urn:btih:53db492ecb33901b17f3f99dd41f2d7310fc5a64&dn=MLPFiM&tr=udp%3a%2f%2ftracker.coppersurfer.tk%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337&tr=udp%3a%2f%2ftracker.leechers-paradise.org%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.dler.org%3a6969%2fannounce&tr=udp%3a%2f%2fopentracker.i2p.rocks%3a6969%2fannounce&tr=udp%3a%2f%2f47.ip-51-68-199.eu%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.internetwarriors.net%3a1337%2fannounce&tr=udp%3a%2f%2f9.rarbg.to%3a2920%2fannounce&tr=udp%3a%2f%2ftracker.pirateparty.gr%3a6969%2fannounce&tr=udp%3a%2f%2ftracker.cyberia.is%3a6969%2fannounce
2013 video not in TPA - "PMV Karma Chameleon (Smile Song)":http://ng27owmagn5amdm7l5s3rsqxwscl5ynppnis5dqcasogkyxcfqn7psid.onion/watch?v=aQao7Sm4hyo
2011 video not in TPA - "DJ P0N-3: Robot Rock" (reminds me of a flash loop):http://ng27owmagn5amdm7l5s3rsqxwscl5ynppnis5dqcasogkyxcfqn7psid.onion.dog/watch?v=dBGaGtEp1gk
^Also from that channel, 2011 video not in TPA - "DJ P0N-3: Scary Monsters and Nice Ponies":http://ng27owmagn5amdm7l5s3rsqxwscl5ynppnis5dqcasogkyxcfqn7psid.onion.pet/watch?v=12oEvq1oWNk
I try to download everything pony I like because I have lost too many great videos that have gotten taken down. One of the first brony videos I watched on youtube was back when the fandom was young and it went something like this, it was dark out and there was a couple guys in a house and they was waiting on their friend to arrive, the friend shows up and he has a brony shirt on I think and the friends freak out like he is a zombie and they try to lock all the doors to keep him out but he gets in anyway and picks them off one by one and turns them into bronies and in the end they are all sitting on the couch with their plushies watching the show. I would like to see it again but I have not been able to find it
>>40466096What year and title?
>>40443906Hope I have that copied somewhere else. On what seems to be copy attempt #2 - ddrescue r1 lasted for days (progress slowed down near the end) - the HDD is now loudly clicking rhythmically. Started clicking about 35 minutes ago (last successfully read time). That hard drive, which was given to me, I only used it to image it elsewhere, is now totally toast. It is completely dead because I guess the actuator arm is dead.
Another dead thing, was alive yesterday I think:https://web.archive.org/web/20231026014632/http://iv.melmac.space/>iv.melmac.space>>This Invidious Instance is temporary (or forever?) suspended because of legal action. >>Your admins Gordon and Lucky!>>40466336Ideally, a HDD should be copied elsewhere before it wears down that much (should also be indicated by its slowed-down speed along with read/write errors). So I can still get the starting bytes in the hard drive (not cached I guess), but ddrescue seemingly cannot progress further. This is not a big problem, but it brings up a question again: If you have a HDD which is clicking loudly, should you unplug it or keep trying to get data off of it? If it is scraping, I guess you are totally screwed, so that case doesn't matter. Not sure, but experience tells me it is maybe the best practice to keep it plugged in, clicking, and then keep trying to get data off of it. If it is mounted then you can be more targeted in getting whatever files and folders.
^ was alive yesterday:https://web.archive.org/web/20231025055122/https://iv.melmac.space/watch?v=wz6K9C6G5oA"PMV Dont Stop Believing":https://web.archive.org/web/20230131054807/https://iv.melmac.space/watch?v=1cNuoQ2bn_w
>>40466457>>40466481Not sure how true that is. Could just be boilerplate text for "offline for now, for whatever reason". I think the iv.melmac.space homepage and this webpage was online in the past hour:https://web.archive.org/web/20231026021004/https://iv.melmac.space/watch?v=1cNuoQ2bn_wImage: "I was just form lettered?!"
>>40466096>>40466236I second this. Unless anyone here remembers it, the only way we could possibly find it is with some metadata such as title, channel name, year you saw it, year it was uploaded, etc. I assume it was on YouTube. If it isn't deleted, it could still be hard to find without that metadata.>>40466336Not completely dead. Time since last successful read: 11 minutes. (previously 35 minutes)
>>40466816We really need a better search for the pony videos that can use all this metadata. If searching on The Pony Archive, the file names already has upload date and uploader name (channel ID would have been helpful). Even better if it can use more metadata from available .info.json files.
>>40460574/pag/ 1 through 14 warc = in progress. Current size = 159 GB. A large file in there, something like 70 GB:>2023-10-25 23:01:38,360 - wpull.processor.web - INFO - Fetching ‘https://iw iftp.yerf.org/iwiftp_sha1-md5_hashes_complete.sqlite’.>>40464844>[torrent:] MLP Friendship is Magic S1-S9+Movie+SpecialsI downloaded that. BitTorrent can't automatically tell me how the files in there compare to other files (like in other torrents), so I could do some analysis; maybe the files are all from YP.>>40466816Could probably remove>Unless anyone here remembers it,from that sentence. I guess what I was trying to say is: "Does that description of the video ring a bell with anyone else here? Perhaps ask a larger audience, if you don't know any of the metadata. How many users you reach matters above all, basically, so if you asked on Reddit (not something I would want to do, I guess unless I really wanted to know) or some other place maybe it would be seen by 40 or so people. How many lurkers+posters are in this thread?"
>>40467322>Does that description of the video ring a bell with anyone else here?Future idea: vector search on video descriptions.
>>OP>[previous thread:] https://boards.4chan nel.org/mlp/thread/40308896I think thead #40308896 was read-only yesterday. About 30 minutes ago it was seen as HTTP 404. So threads in /mlp/ stay read-only for about 11 days before getting deleted off of boards.4channel.org.>>40467322todo: manual analysis (dl others, hash)Image from>https://www.online-python.com/#import%20random%0Arandom.seed(int(%22hexadecimal_value_here%22%2C16))%0Aprint(random.randrange(1%2C%20200000))>[ hex value=outputValue of NIST Randomness Beacon pulse #27 (skipped images from pulses 24-26): https://beacon.nist.gov/beacon/2.0/chain/1/pulse/27 ]>[ python output number=51235: ] http://localhost/old[...]/viewfast.php?id=51235
https://desuarchive.org/mlp/thread/39826158/#39859092 (keyworks I was searching for = hardlink , hardlinks , hard link , hard links ,)>ESRGAN 4K upscale of MLP>magnet:?xt=urn:btih:73605190116277ddda6bc24ee91c08a2af27a7e2&dn=%5bLoyaldk%5d%20My%20Little%20Pony%204K%20Upscale&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80%2fannounce&tr=udp%3a%2f%2ftracker.opentrackr.org%3a1337%2fannounce&tr=https%3a%2f%2finferno.demonoid.is%2fannounce>https://files.catbox.moe/c96ahh.torrentProbably distributed to a low degree as of >>39859092 in /pag/ #6>>40456357>>40463617227 videos in that playlist which are not in TPA:Z-FkswE90uI XFAeDffUBeI 1sXvxrFEUDg ZYQZVDDSDwE Bixmu6XdOj8 6EW2U9gN4AU plKH3rUQdvY FoRN3E0zvQ4 M4p5-mk5HgU U8QEMSZz6KQ qyvA9NUD8wk olemGsWjGf4 89sr8SGjYFQ 08kiIFdC2XY tlE3BsN9ehQ HIQRszbuHmY dMa4r_kFHls 6lJtTLpsQjI n5bD67n55HI M46-9XOSifc N77uVgnryuY cr09RNIOp3A THv2qk2DJGM ty5HI4djhak 43NUsP_KYZQ bbxJWiK6GrM iKV1WTFFcyg qHqZ-fPvqLM kfeOAirFuPU RPtTZ4HkUXI vv4B_Q-OKoc dqS3MqDxlnc L05lK--1yJc ifSiRSLhJOY E0IYjk-948w TTW8dV3ZE0A -O1LL6hg_t0 n54ebx656Fg mvuSSZ9vvWM Cy1t-BtFi34 7_0jYy3ANVo Tiam9iZmBJ8 VpXUO8-M_98 G7XvX0NY6rA RcVVo_280tM 7VHVITXZ2mQ BgAH0lrfN9E O4JPf90D3U0 zy3KxP5jZUY sto55Ise5g8 zvvK-UTqSbg Wu3j3Qh7sTE 5Z56MZFMp0k RxJkuwEVQek E0r8eZn-8Cs no9GcWAx3h4 jN_3zTVVBtE 2ZPV6GJjzIo GnoWd4uw0G4 eU6wIUVuPVc ZDW3tOnjbb4 J1zyru2UTE8 rHLYnW2LiJw eRprFZfaYgQ 0joLag1Mr2s PJ9tK8ukFUc 6f7sCDRn_dw TfRz3d_U4rE 0fK97b9ileM 78BRmihCAvU s-O9vSenA7o vg7iyWd8B_Q WoYYZ7QJDi0 w_RsKxfRq_o hpfzxhqjy_w NOItV2Fc5xg 06rEplYQotM 9FUyecs_QeI IslQ21A5R3M 9WI4WvqHE1M UhykVzkcoGg bGjnucMuTkk yg02Hair6l8 stYBPhSMp94 vFvmqNlbqYQ BH0XFXImKYs i8CdEWbt8mo UuUypap1x68 4etp4_bYb-0 UZX5X8tBzoM yTaf2MLR4BI 8CTP26dnDYQ nyFA0iOSh5Y dFMWf8ovbE8 YiGI_9r4TFk JkXL-zpzbd8 JtyaU6om3hE 4dM-lva6bFs mhDA3w-2FJc uWGYwehdCx0 dNEC5SJmAzc qzm1H0z6Jk0 XZAd5hSn4Q0 NqFcW3HINZk 3w4o97LgQgA iFWn6ZWMmiM qY_5HIVJ8Pw S_dKQ0hxuSY Bja5gga7eAk luzmG04zDvw JpdPGZw4vd0 2L2rVIzZGPA a_wBfeOfkxQ CoQ21piew9s jhVrnfFRfsU PBLGhA4MrAo 0lcgkgs-y9c QZ8kCF2dimk ZM3jsEO09P8 CHbIuJWZYog joBmJi6ByNo 65ehEid3aUM thlKNIQ6Pkw 2ZXb0bCpQY4 u48BtpeE0zY AJ59O15-_BU nAjdKeDQ6eM yI89dB6mWgI SIqcVqpkLtw pva5NVFhsdM CkuHBYf79SI hez3NU3sU9M dG_Lh_v8gL8 jD2q0Edjsz8 XEzB1D3DwRM CSbwVgJ9Oq8 Te98GIisGTE ri6vwgJH-OY n6EF66R8Eq4 97HIVkIyXRs JdAB4VDhXMk qDPzjFNLLcQ XK92dD0nOjo 2tXXdq97QI0 IQkToJEr38I VKkP2iTH8ig sZA4knkPn6M OveOP4cMe64 5F1PRZKUMNM kFAVwFpIzZc iEdjaKvw-OM lu5giUWV3eU axtA_iWloU8 EO16VZ6Gx6o ek_wS7q_6eA QYQCPBpnSTM e_46itXlqpU cY8BWTHokX8 dMNB9JHjWag xFCglSyQj64 bSasXlzerpI q806j1_xs_A s5QIJ3rwoqc tvNNfaXGttU StG2C2xosbI 1sBW8g5nFig 4cuH8Ay0jI4 tnN-x9F4Ssk dg10Fhcn0vw 2Ekvz8kM8AU qAoK_UemheE IhUfKhGT-bs 8SI8MddqToE qPHLcjSrNOc q-Je0oozbHM WT4aL1MeAr8 T6lH_sneR2M 9XfiFRUwYZM jkugadfl4_s fU9MH2ZOOPw IrhBRmsoVZQ d_72oclqAUM r4yXqx8VsS8 CUz-1vHcDrU A7jzFwtikSI QwAOtd4f7M8 lHzKQWJZsFw a4jBE98F85k E9VrGtNOlF4 rrsVlKVvxkE YUQHBjCcBCg eXjl-ozZBsk G1OZmjjfYpo ltpvSZFi7y4 8KYqc4gGhZg c4qqoupK-ko _ohbryxMLm0 4__1WNsU1uU
^G_CEgqufzn8 aFfziMUnlO4 mvSrreYy4rY OolGqqaGr_g COtfUwvBgfA mhYKPhCjMFQ ArsEQ0AEQ2E P2Dr57dvnvA eU3htfa1ExM 7Hh1iRUsDNY C3rhyjwIKlg _ZczbM2lazk y-68sgAQtFo c0pfJ_k1xJ8 -72N5Ogyais TS1WjHmcPYI vQ1jPb8Evww 1XYLuLt2C7U 963SMzs3dOw uvTMgveyV9g MuHO5yXPPp8 fv_WQtLn74k q8ZBRz5p9ak FeSka35LhSM bkvbA5fykac m8SdAi9bj6Y lRhEp4TTQQg v39QsTbrqwQ y4NxS_s6-aodl size= 13 GBThing that happened to me, related to downloading that YT data... I kinda learned this the hard way: if you press ctrl+d or definitely ctrl+cd it will close the current tab in GNOME Terminal and probably also other terminal emulator programs. Had this happen when trying to exit python3 by not using "exit()". Image from>/z8/video/7572657/p2/NA_UC-3DyXi9LwdpCqd1knt2EaA/MLP_G6_CONFIRMED-Star_Strike-20230401-youtube-1920x1080-8CTP26dnDYQ.png
>>40467471>ESRGAN 4K upscale of MLP420 GiB>>40467482"NA_" instead of "theAcutalChannelNameHere_" due to using an invalid format thing: >>40463683 . Wet Sweetie Belle:>/z8/video/7572657/p2/NA_UC2IlKx0VtEgH2N_fClmFPhw/FiW_-_Sweetie_Bot_Glitches_In_Water-barbaro267-20130803-youtube-854x480-5F1PRZKUMNM.png
>>40452666One-liner:> LoremIpsum<video width="320" height="240" controls><source src="httpToFileDotMkv" type="video/webm">Your browser does not support the video tag.</video>
>>40467628Using that in https://htmledit.squarefree.com/ in Silk Browser: not all MKV files work.https://archive.org/download/yp-1-r-01x-26/YP-1R-01x17.mkv>plays, no full screen>Rarity: "You should have a picture of Opal as your cutie mark instead of those butterflies."http://10.0.0.232/.../t/MLPFiM/Season%207/MLP_FiM%20-%20S07E01%20-%20Celestial%20Advice.mkv>does not play at all, no image
>>40467471>>40467482>227 videos in that playlist which are not in TPANow that’s more like it!
>>40467729One of the videos from that is>http://10.0.0.232/.../video/7572657/p2/NA_UC0rBAAm-c9fn7T93-U8QNoQ/PONY.MOV-Pinkie_Pie-20130320-youtube-1280x720-FeSka35LhSM.webmIt has all of the .MOV videos. I don't think I watched all of those edge animations years ago. Funny videos; I guess it's not entirely edgy. Dedication in the ending credits:Dedicated to the memory ofLauren Faust1974-2013"My greatest dream is a world without Jews."
*all of those edgy animationsImage from https://www.youtube.com/watch?v=g2CK8YohUGQ
Life is one big stupid fucking eating machine.>>40467741Not all of them. Description incl. this text:>Explanation: SPIKE.MOV was a joke video. If you go to the end of all the other PONY.MOV videos, you would realize that SPIKE.MOV isn't a choice. Based on the creator (hotdiggedydemom) and his actions, I decided to leave SPIKE.MOV out.
Wiktionary:en:archive#Etymology>From French archive, from Latin archīvum [archivum], from Ancient Greek ἀρχεῖον (arkheîon, “town hall”).>>40460574WARC: /pag/ 1 through 14* gotta remember to add the start URLs to "ignores" in the future, since I have completed those pages* 1-13 from desu, 14 from desu and 4channel (wbm-excluded)* finished after more than 48 hours* 119G final size, >>40467322 shows a larger in-progress size likely due to not being entirely compressed yet** /z8/web/676f3a7/mlp_1_14/z8-web-676f3a7-mlp-1in1.txt-2023-10-24-10385e00.cdx*** has: https://iwiftp.y erf.org/iwiftp_sha1-md5_hashes_complete.sqlite 1698296499 - - AT4W27EHZV626W4UQZ36I3USASSTH24V 18805631619 2010702215 z8-web-676f3a7-mlp-1in1.txt-2023-10-24-10385e00-00019.warc.gz <urn:uuid:dd3efb4e-d26a-4bd8-9d44-2ad229ca095c>
>>40468155One of the things that that warc contains:* most/all YouTube video files by way of Invidious links posted in this general** I guess they are all MP4 files, and they are the accessible files, not necessarily the best video+audio quality ones like you would get with yt-dlpLooking at that CDX record for that sql file, I thought one of the fields was filesize in bytes, but I didn't see 70489108480 - fetched size for that file as stated in wpull.log.
4channel.org = excluded from WBM. Something someone could do if you feel like it: save WARCs of all read-only threads in /mlp/ every day. Such threads are listed at something like https://a.4cdn.org/mlp/archived.json . But what if a thread gets deleted without ever becoming read-only? If you want to be lazy or have a simple thing, you could ignore this problem - IDK if it happens in this board. Maybe I will do this saving, but don't count on it. Thinking of doing something similar for some other board.>>40468155>676f3a7/mlp_1_14/Correction:676f3a7/mlp/pag_1_14/
WARC finished >>40468155YT playlist -> rarer data finished, I guess >>40467471 >>40467482 . Terminal tab accidentally closed >>40467482 but logs sorta state that it finished. To clarify, by "ctrl+cd" I meantKeydown ctrlKeydown cKeyup cKeydown dKeyup dKeyup ctrlStill doing requests to WBM from 2 IPs. Wayback Machine blocked my save requests for now (not blocked on Tor). Wanted to get a Lokinet exit node(s) working for just one program, and not my whole damn Internet connection; using this program might be the solution - https://github.com/JsBergbau/BindToInterface - that way I could still save from 2 IP addresses even when my own IP is blocked. (Or figure out how to use multiple Tor IP addresses simultaneously.) Don't have to worry about messing up my connection since the above 2 things completed.>>40468212(Correction because the thing I was writing the post with messed up the text)
2016 video not in TPA - "MLP Crossover Part 224 One Punch Man [PMV]" (slideshow+music):https://www.youtube.com/watch?v=8PVvN9mtyqM>>40468254Could use vagrant - https://www.youtube.com/watch?v=TNfZ9eFm37I - ssh into a lightweight headless vm. (I wonder if Lokinet works with BSD.)
>>40431084Google Translate:>https://archive.is/4OUwy>https://lingva.lunar<dot>icu/auto/en/Freude%2C%20sch%C3%B6ner%20G%C3%B6tterfunken%2C%0ATochter%20aus%20Elysium%2C%0AWir%20betreten%20feuertrunken.%0AHimmlische%2C%20dein%20Heiligtum!%0ADeine%20Zauber%20binden%20wieder%0AWas%20die%20Mode%20streng%20geteilt%3B%0AAlle%20Menschen%20werden%20Br%C3%BCder%0AWo%20dein%20sanfter%20Fl%C3%BCgel%20weilt.%0A%0ADeine%20Zauber%20binden%20wieder%0AWas%20die%20Mode%20streng%20geteilt%3B%0AAlle%20Menschen%20werden%20Br%C3%BCder%0AWo%20dein%20sanfter%20Fl%C3%BCgel%20weilt.WBM said something like "invalid URL syntax". I think that is because that link encodes 0x0a newline.
>>40466236I don't remember, it was on youtube around 2012 or 2013 maybe earlier
DVD ISOs ripped from my personal DVD collection (278.50 GiB)- Equestria Girls - Magical Movie Night DVD (Shout Factory, USA, 2017)- Equestria Girls - The Specials DVD (Miracle Media, UK, 2018)- Equestria Girls 1 DVD (Shout Factory, USA, 2013)- Equestria Girls 2 - Rainbow Rocks DVD (Replacement Disc SF 15703-REV) (Shout Factory, USA, 2014)- Equestria Girls 3 - Friendship Games DVD (Shout Factory, USA, 2015)- Equestria Girls 4 - Legend of Everfree DVD (Shout Factory, USA, 2016)- Friendship Is Magic - Best Gift Ever DVD (Beyond Home Entertainment, Australia, 2018)- - Friendship Is Magic - Cutie Mark Quests DVD (Shout Factory, USA, 2015)- Friendship Is Magic - Pinkie Pie Party DVD (Shout Factory, USA, 2013)- Friendship Is Magic - Rarity DVD (Shout Factory, USA, 2018)- Friendship Is Magic - Season 1 DVD (Shout Factory, USA, 2012)- Friendship Is Magic - Season 2 DVD (Shout Factory, USA, 2013)- Friendship Is Magic - Season 3 DVD (Shout Factory, USA, 2014)- Friendship Is Magic - Season 4 DVD (Shout Factory, USA, 2015)- Friendship Is Magic - Season 5 DVD (Shout Factory, USA, 2016)- Friendship Is Magic - Season 6 DVD (Shout Factory, USA, 2017)- Friendship Is Magic - Season 7 DVD (Shout Factory, USA, 2018)- Friendship Is Magic - Season 8 DVD (The Myth Entertainment, Malaysia, 2019) (POSSIBLE BOOTLEG)- Friendship Is Magic - Season 9 DVD (The Myth Entertainment, Malaysia, 2020) (POSSIBLE BOOTLEG)- Friendship Is Magic - Soarin' Over Equestria DVD (Shout Factory, USA, 2016)- Friendship Is Magic - The Friendship Express DVD (Shout Factory, USA, 2012)- My Little Pony - Rainbow Roadtrip DVD (Miracle Media, UK, 2020)- My Little Pony - The Movie (2017) DVD (Lionsgate, USA, 2018)magnet:?xt=urn:btih:88756d5f383e585c111d794b13e756686b2ce88e&dn=MLP%20DVDs&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=https%3A%2F%2Ftracker1.520.jp%3A443%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.tracker.cl%3A1337%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.openbittorrent.com%3A80%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=https%3A%2F%2Ftracker.renfei.net%3A443%2Fannounce&tr=http%3A%2F%2Ftracker.renfei.net%3A8080%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker-udp.gbitt.info%3A80%2Fannounce&tr=udp%3A%2F%2Fp4p.arenabg.com%3A1337%2Fannounce&tr=udp%3A%2F%2Fopentracker.io%3A6969%2Fannounce&tr=udp%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.tamersunion.org%3A443%2Fannounce
>>40464844>My Little Pony Book Collection = dead/offline (.torrent file?)https://itorrents.org/torrent/91b8bf3b723472962bcbfb52074d622ef1ed1af2.torrent>>40469126I was using this: "vagrant init archlinux/archlinux" -> change Vagrantfile to use a base memory of 256M -> "vagrant up" (virtualbox). This was a bit of a waste of time. I guess virtualbox used more memory than that because qBittorrent got killed. Not only did qBittorrent get oom'd, but I now have to recheck torrents due to virtualbox being prioritized above it. It seems that the Arch Linux vm didn't fully boot with just 256MB of RAM; it seemingly got stuck at something like "starting initramfs". A Puppy Linux ISO worked in virtualbox (not using vagrant) with 256 MB of memory, but I couldn't get the options for it to start without GUI/X to work. I guess Puppy Linux is more lightweight than Arch Linux. Stuff I could try to get to work: (1) Puppy Linux via vagrant, (2) OpenBSD or FreeBSD via vagrant, (3) Gentoo via vagrant, (4) some lightweight headless distro via vagrant. I guess base Gentoo has less than base Arch Linux, so with Gentoo I would have to compile a bunch of stuff before doing anything useful.
>>40470398Months ago I was wondering about disk images for post-S4 MLP FIM. I guess you are the first user to share them online. If you are interested in reproducible ISO files, check out http://redump.org/ (I can write more on this).>>40471119I think CentOS is another server distro. Basically, OpenBSD=server and FreeBSD=desktop. Virtualize and use OpenBSD in one workflow (one terminal tab):https://app.vagrantup.com/boxes/search?provider=virtualboxhttps://app.vagrantup.com/boxes/search?utf8=%E2%9C%93&sort=downloads&provider=virtualbox&q=Openbsd
>>40467471>>40467490>[Loyaldk] My Little Pony 4K Upscale> [ infohash v1 link: magnet:?xt=urn:btih:73605190116277ddda6bc24ee91c08a2af27a7e2 ]> [ infohash v2 link: magnet:?xt=urn:btih:24ecfd5117fe3f9afd0f0d183b33f8ae92c4aefe503ad3983f02e74168952c2e ]Max download speed that I saw with that today: 14.9 MiB/s.>>40471119Looks like qBittorrent keeps dying regardless, so virtualization is not really to blame.Image from http://localhost/old[...]/ran.php?id=108622 - random number from pulse #30 as a seed:>wget -qO- --user=$(cat ~/u) --password=$(cat ~/p) $(echo http://localhost/old[...]/ran.php?id=$(python3 -c "import random;random.seed(int(\"$(curl -sL https://beacon.nist.gov/beacon/2.0/chain/1/pulse/30 | jq .pulse.outputValue | tr -d \"\\n)\",16));print(random.randrange(1, 200000))")) | perl -pE "s/\"/\n/g" | grep http | head -n1
In a previous thread someone said something like "WARC is an obscure format", IIRC. Not true. It is used by WBM. Example = 2 captures - the source code of the Linux kernel and the source code of OpenBSD (both captured "by me" today as "First Archive"):>https://web.archive.org/web/timemap/cdx?url=https://github.com/torvalds/linux/zipball/master>https://web.archive.org/web/timemap/cdx?url=https://github.com/openbsd/src/zipball/master>>40467471Includes this:>http://10.0.0.232/___/video/7572657/p2/NA_UC2tAH-b2pxlfSTW5T1ml_8w/loadsamoney_animatic-Hattsy-20230713-youtube-640x480-E0IYjk-948w.webm>https://www.youtube.com/watch?v=E0IYjk-948wBut not this:>https://www.youtube.com/watch?v=2ViQoMdKx4o
2013 video not in TPA - "MLP: GTA V":https://mub.me/yxUpk#DcmU-vybK3Ahttps://www.youtube.com/watch?v=DcmU-vybK3A
>>40471602Downloading that channel ( arniejolt_UCFVBiGindzqOrALdd6aPtWQ ):>.../z8/video/7572657/c1$ utc; yt-dlp -j --flat-playlist UUFVBiGindzqOrALdd6aPtWQ > 1plist1.json; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; wc -l 1plist1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(channel)s_%(channel_id)s/%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(channel)s_%(channel_id)s/%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(channel)s_%(channel_id)s/%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc>Fri, 27 Oct 2023 12:06:35 +0000>31 1plist1.txt>[in progress]- no more --embed-subs- fixed >>40467490- skipped: https://www.youtube.com/warch?v=qqDsw4KH4Yohttps://www.youtube.com/warch?v=TuiEiUOd5kohttps://www.youtube.com/warch?v=tgA-xwg-vdEhttps://www.youtube.com/warch?v=uT6jaz2xdZEhttps://www.youtube.com/warch?v=h4BL4g6NISs- duplicate? https://www.youtube.com/watch?v=xudwc5OWCkU ("MLP_-_GTA_V-arniejolt-20150308-youtube-1280x720-xudwc5OWCkU.webm")- todo: log to "something-like-$(date +%s)-this.txt"
^* https://www.youtube.com/watch?v=qqDsw4KH4Yohttps://www.youtube.com/watch?v=TuiEiUOd5kohttps://www.youtube.com/watch?v=tgA-xwg-vdEhttps://www.youtube.com/watch?v=uT6jaz2xdZEhttps://www.youtube.com/watch?v=h4BL4g6NISs>duplicate?Nope, it's the "Why did I move here? I guess it was the weather..." trailer
>>40471627>http://10.0.0.232/.../video/7572657/c1/arniejolt_UCFVBiGindzqOrALdd6aPtWQ/Soul_Calibur_V_Custom_Characters_-_MLP_Revisions_2-arniejolt-20121109-youtube-960x720-1DRChNdjSoM.webm>https://www.youtube.com/warch?v=1DRChNdjSoMMusic in the background is "Super Ponybeat - Art of the Dress (Complete)":>index https://web.archive.org/web/20231025072348/https://x0.at/kWZe.car>offline ipfs://bafybeiaoahsh6kcecrpesara56b6d5dtx52sshzwsfa4eqjg6iadwqofzi>from youtube-MunCk4b6ofM
^ * https://www.youtube.com/watch?v=1DRChNdjSoMLol, I copied my typo accidentally. I wonder if he did one for Berry Punch.
Also know as Berryshine. Image fromhttps://www.youtube.com/watch?v=Euf2DO6cYQE
2023 video not in TPA - "SWEETIE BOT SINGS HELLO, WORLD":https://www.youtube.com/watch?v=stYBPhSMp94>>40463683At least Filebase didn't disable HTML previously uploaded by free accounts, like Pinata did; for example, this web page is still fine (image from the following):https://ipfs.filebase.io/ipfs/QmWn1s3j6yGbrzEV3NyKcFFfUaxGCEPSY3aMsN6UaoYZfe/page5.html
TinEye is sorta an archive-friendly reverse image search service/website. Image search links there (like the below one) expire based on a set time limit, not frequency of usage or amount of clicks over a certain period of time. Image fromhttps://web.archive.org/web/20230910030741/https://tineye.com/search/f2420f508e8bd703e07afa20772410ed543b413a?sort=score&order=desc&page=22tineye.com is important because sometimes it has information which no other website has, like if the image info it has is about a dead and not archived webpage or web file. Don't think they have an open index, but if TinEye was hacked, their data could definitely be sold for some money (maybe an archivist would buy it in that case, haha).
>>40464160>584.386 GThis AI thing worked as a calculator, no captcha needed - https://deepai.org/chat - output from that input = "569 GB". Dunno if it will work on more complex asks for calculation such as: https://desuarchive.org/mlp/thread/39826158/#39862576
https://magicalponyreview.blogspot.com/2014/04/trade-ya-review.html> I would also like to point this out: did anyone else notice a pony who looked like an OC?>> Well, I'm to lazy to write all the stuff down so why don't you give EquestriaDaily a visit and read it here?
Ten
Is automatically and completely being saved AFAIK:- Twibooru images and image JSONs- Ponerpics images and image JSONsNot being automatically and completely saved:- Twibooru comments and webpages (warc)- Ponerpics comments and webpages (warc)
>>40471387> qBittorrent keeps dying regardless, so virtualization is not really to blame.Weird, when using this one HDD, looks like if qBittorrent starts uploading then it uses too much memory and gets oom'd. Guess I will just leech only. (Possible fix: update qBittorrent v4.5.5 to a newer version.)Image from >>40472248
Offline again:https://www.isitdownrightnow.com/theponyarchive.com.htmlhttps://www.isitdownrightnow.com/new.theponyarchive.com.html>>40469126>I wonder if Lokinet works with BSD.https://github.com/oxen-io/lokinet/blob/dev/docs/install.md#freebsd-install>FreeBSD >Currently has no VPN Platform code, see issue #1513It can be installed in FreeBSD, and I guess it can also be installed on OpenBSD and other BSDs. However looks like "lokinet-vpn ..." will not work, so this command (if I remember it correctly) will not work to get an exit node: "lokinet-vpn up --exit euroexit.loki".
Thai dub of seemingly all of the episodes of FIM:https://archive.org/details/my-little-pony-friendship-is-magic-season-1-9https://lingva.lunar<dot>icu/auto/en/ซูเปอร์%20สปีดดี้%20ไซเดอร์%20สควิซซี่Guessing the audio is from Netflix, but it is not NF-WebDL because the video has a certain watermark. Captcha: MYPROW
>>40441091The tags of this (.info.json) were changed a year or more after the video was first uploaded in 2009 - "Is It A Good Idea To Microwave My Little Pony?"https://archive.org/details/youtube-9aCDtxPUGPQIt is tagged as "bronies". The word "brony" did not exist in 2009.BTW, I was wondering about this a while, found an answer from having further experience. You can set Brave Browser's IPFS repo to the one used in the CLI by running this:>$ IPFS_PATH=$HOME/.config/BraveSoftware/Brave-Browser/brave_ipfs
*was wondering about this a while agoImage from archive.org/details/youtube-9aCDtxPUGPQ
>>40441091These npr autogenerated music-related YouTube video files were also modified (censored) year(s) after upload - these IA items contain both versions of the video for each YT ID:https://archive.org/search?query=E-rotic+YouTube+addeddate%3A2023https://web.archive.org/web/20230403020307/https://dweb.link/ipfs/QmTUenXHc3qoChozPGCuK8NAgY2A3rAK6JZvtHymLkB4iz>Kiss me>Fly me up high>Wanna feel like a frisbee>High in the sky>Oh, I want you to kiss me>Do it all right>'cause I know that you miss me>Oh-whoa-ah-oh-whoa>[...didn't really like the male vocals in this track]>>40280584I think older versions of ipfs/kubo didn't have a progress indicator for importing CAR files. Newer version(s) do have an indicator: "ipfs dag import --stats file.car".
In a previous thread someone asked something like "How can you trust IPFS?" Regarding the local data storage part of this: I can further confirm that you can trust it because I just confirmed something that I suspected a while ago. You can list all blocks (as raw block CIDs) by running "ipfs repo ls". This lists all of the blocks in a repo: pinned or not. (See only pinned blocks/CIDs: "ipfs repo ls --type=recursive".) This functionality is useful in various cases and supports retention of references to data (so the opposite of shitty NTFS where you sometimes get a corruption/error where you cannot list the files in a folder and can only access them if you know their paths like if you previously saved the filenames in that folder to a text file). Proof:>$ IPFS_PATH=/pathto/repo1/.ipfs>$ ipfs pin ls --type=recursive > p.txt>$ # p.txt contains non-raw-block CIDs>$ cat p.txt | sed "s/ recursive//g" | xargs -d "\n" sh -c 'for args do ipfs pin rm $args; done' _>$ ipfs repo ls > all.txt>$ # all.txt contains raw block CIDs>$ cat all.txt | xargs -d "\n" sh -c 'for args do ipfs dag export $args > ${args}.car; done' _>$ IPFS_PATH=/pathto/repo2/.ipfs>$ find . -type f | grep -v "\.txt" | xargs -d "\n" sh -c 'for args do ipfs dag import --pin-roots=false --stats $args; done' _>$ # run it without "--pin-roots=false" if you want to pin every single block>$ cat p.txt | sed "s/ recursive//g" | xargs -d "\n" sh -c 'for args do echo $args; ipfs pin add --progress $args; done' _Those commands most importantly show that all blocks (incl. unpinned ones) can be copied from one repo to another, and then, the pinset from the first repo can be restored in the second one just from the imported "raw blocks" (CIDv1-Raw CIDs). So the pinset of multiple "Qm..." CIDs can be restored just from the imported "bafk..." CAR files.>>40474494(By "oom'd" I mean killed by systemd-oomd.)
Wow, I wish Pinkie Pie would suck and kiss my penis like this:https://web.archive.org/web/20231028061830/https://ponerpics.org/images/2358141Had a related idea, call it an "AI prompt": "Pinkie Pie sucks my cock and uses my cum as frosting on one of her cupcakes.">>40475049Here's a non-condensed-form log which shows that being done:https://w3s.link/ipfs/bafybeigmo2szwhpamsciwvktru4rhvej2u7ommq7qimv2m67v32jkheoky
>>40470398Thanks for this. Think it would be worthwhile to share the UPC/EAN-13 barcodes?>>40466336>>40466457>>40466816The HDD loudly clicked for like 12 hours after >>40466336 was posted then didn't click anymore and ddrescue continued to get data off of it (error count increased simultaneously).>>40474494The qBittorrent AppImage worked better and is a newer version than qBittorrent in Ubuntu/apt repo and PPA repo (both stable and unstable).
>>40475924Here's the barcodes from the back of the DVDs.- Equestria Girls - Magical Movie Night DVD (Shout Factory, USA, 2017) 826663179019- Equestria Girls - The Specials DVD (Miracle Media, UK, 2018) 5037899077115- Equestria Girls 1 DVD (Shout Factory, USA, 2013) 826663142488- Equestria Girls 2 - Rainbow Rocks DVD (Replacement Disc SF 15703-REV) (Shout Factory, USA, 2014) 826663157031- Equestria Girls 3 - Friendship Games DVD (Shout Factory, USA, 2015) 826663158861- Equestria Girls 4 - Legend of Everfree DVD (Shout Factory, USA, 2016) 826663171280- Friendship Is Magic - Best Gift Ever DVD (Beyond Home Entertainment, Australia, 2018) 9318500080868- Friendship Is Magic - Cutie Mark Quests DVD (Shout Factory, USA, 2015) 0826663158885- Friendship Is Magic - Pinkie Pie Party DVD (Shout Factory, USA, 2013) 826663138733- Friendship Is Magic - Rarity DVD (Shout Factory, USA, 2018) 826663189339- Friendship Is Magic - Season 1 DVD (Shout Factory, USA, 2012) 826663136968- Friendship Is Magic - Season 2 DVD (Shout Factory, USA, 2013) 826663140200- Friendship Is Magic - Season 3 DVD (Shout Factory, USA, 2014) 826663146219- Friendship Is Magic - Season 4 DVD (Shout Factory, USA, 2015) 826663154580- Friendship Is Magic - Season 5 DVD (Shout Factory, USA, 2016) 826663167993- Friendship Is Magic - Season 6 DVD (Shout Factory, USA, 2017) 826663180695- Friendship Is Magic - Season 7 DVD (Shout Factory, USA, 2018) 826663190649 - Friendship Is Magic - Season 8 DVD (The Myth Entertainment, Malaysia, 2019) (POSSIBLE BOOTLEG) 9556300000994- Friendship Is Magic - Season 9 DVD (The Myth Entertainment, Malaysia, 2020) (POSSIBLE BOOTLEG) 9556300001038- Friendship Is Magic - Soarin' Over Equestria DVD (Shout Factory, USA, 2016) 826663167085- Friendship Is Magic - The Friendship Express DVD (Shout Factory, USA, 2012) 826663130508- My Little Pony - Rainbow Roadtrip DVD (Miracle Media, UK, 2020) 5037899077283- My Little Pony - The Movie (2017) DVD (Lionsgate, USA, 2018) 031398276418
>>40476220Appreciated. This helps with verification and identification. (Did you know that many books with ISBN-13 have it so the ISBN13 number is identical to the EAN13 barcode number?)
2023 video not in TPA - recent:"making silly AI ART with the boys"https://www.youtube.com/watch?v=qR5c77vAkz8"My Little Pony Nightmare - AI Art"https://librarian.pussthecat.org/@BoosterKiwi:8/my-little-pony-nightmare-ai-art:f>>40471119>>40471254As a lightweight headless Linux server distro for usage as a virtual machine, CentOS worked better than Arch Linux:>$ vagrant init centos/7>[...modified "Vagrantfile" so that "'centos/7' (v2004.01)" will use 256MB of RAM]>$ vagrant up>[...]$ vagrant ssh>$ [ successfully pinged and curl'd website https://silly.computer after sshing in to the vm. ]Next: seeing if I can install and get lokinet (and its vpn/exit nodes) working in the VM. Captcha: DJ2GAX
If anyone is running an Apache HTTP Server or some other localhost thing and wants to make it Internet-accessible, you can apparently use these maybe spooky methods (as an alternative to changing the configuration of your physical router's routing table):https://www.youtube.com/watch?v=JxChxk25Lj0https://www.youtube.com/watch?v=111ZDMKVTL4>>40475924This one, specifically:>https://versaweb.dl.sourceforge.net/project/qbittorrent/qbittorrent-appimage/qbittorrent-4.6.0/qbittorrent-4.6.0_x86_64.AppImage>>40477721Looks like they were using this (for picrel and other images), which requires that you login with a Microsoft account:https://www.bing.com/create
2017 video not in TPA - "PMV One Piece Believe Intro(English)":https://invidious.chunboan.zone/watch?v=vToi3T4HLZ8
>>40478006Considered downloading that "medium-sized" channel, guess I will download these channels first:>>40465417 >>40465648>Related: DJ P0N-3: DVNO https://www.youtube.com/watch?v=8HRrcGHbFAg>>40472248>Related to stYBPhSMp94: "Hello, World" in 5 CURSED languages, that no one should use https://www.youtube.com/watch?v=ehbSTazdhbU>"Hello World!" in IPFS https://ipfs.moonicorn.network/ipfs/QmfM2r8seH2GiRaC4esTjeraXEachRt8ZsSeGaWTPLyMoG
>>40478140Downloading "Trizero":>$ yt-dlp -j --flat-playlist UU1NC_zSEfEG_eJc5A-0MfYA > 1plist1.json; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); mkdir $fdir; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; utc > 1stats1.txt; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc >> 1stats1.txt; cd ..- all log files and non-log files go into the channel folder now- only one video in that channel is in TPA (thumbnail attached): https://www.youtube.com/watch?v=x5_x52tKIlM- todo: thing to download channel banner, channel pfp, and channel metadata
2015 video not in TPA - 'Lyra ft. Bon Bon "Goodbye Horses" Official PMV':https://www.youtube.com/watch?v=UPpL-skYmG8Image from CF sitehttps://nitter.d420.de/BronyPony/with_replies>Applejack>@BronyPony>Howdy! Ah'm Applejack!>[...]>*Apple falls on head* -.-
2017 video not in TPA - "My Little Pony Characters Names & Pictures" (nice video, couldn't read all of the names, not all of the characters):https://www.youtube.com/watch?v=iIZwrYhjayY>>40477721>Lokinet in CentOS VM(Blocked by WBM again.) I just remembered, I could ssh into this other local computer (not a VM) and use that instead of vagrant/virtualbox.>>40478224http://10.0.0.232/.../video/7572657/c2/Trizero_UC1NC_zSEfEG_eJc5A-0MfYA/1stats1.txt> [75 videos downloaded from> Sun, 29 Oct 2023 11:15:27 +0000> to Sun, 29 Oct 2023 12:30:06 +0000
>>404782242.4G. Failed, maybe I can download these via proxy:>WARNING: [youtube:tab] YouTube said: INFO - 2 unavailable videos are hidden>ERROR: [youtube] ql0wsDXLAEo: Video unavailable. This video contains content from WMG, who has blocked it in your country on copyright grounds>ERROR: [youtube] 40jD6JAR6nA: Video unavailable. This video contains content from WMG, who has blocked it in your country on copyright grounds- todo: save "1error1.txt", if empty at the end, delete it.Above 2 videos are more topical than this recent low-relation Chris-Chan-related video by a popular YouTube fag: https://www.youtube.com/watch?v=in3_S6SOx64
>>40478649Downloaded both videos via torsocks: thanks darkweb bros. One file:>/z8/video/7572657/c2/Trizero_UC1NC_zSEfEG_eJc5A-0MfYA/DJ_P0N-3_-_Night_By_Night-Trizero-20110315-youtube-1280x720-ql0wsDXLAEo.mp4"We can work it night by night":https://x0.at/71Le.mp4Thumbnail: basically the same as >>40465417{"Description": "Original song: Night By Night - Chromeo"}>>40478568Install info below. Alt front-end for GitHub because it doesn't display correctly in lynx browser and other reasons:https://gothub.no-logs.com/oxen-io/lokinet/blob/dev/docs/install.md
Anyone here having problems with archive.today? I’ve been getting a lot of “welcome to nginx” landing pages over the past couple of days.
>>40471119Why is that torrent dead? Perhaps because online "piracy" is/was on a decline. Image from - The Fall of the BitTorrent Client which Shall not be Named: https://www.youtube.com/watch?v=1-VEB4NLGMM>>40478748Lokinet binary is supported by Ubuntu, but not for Linux Mint on i386, so now I spent hours building/compiling from source for that.>>40478845I had that happen multiple times before. It seems to be a per-device (not per-IP address) block. If you restart your web browser, maybe that will fix it. Or wait for some amount of time. One of the causes of this denial of service seems to be submitting certain links to be saved, such as megalodon.jp URLs, IIRC. (BTW, I saved a screenshot of that block before, don't remember if I posted it.)
>>40478518>>40478568>UPpL-skYmG8>iIZwrYhjayYSmall channels. Image fromhttps://mlpraritydailies.blogspot.com/2012/07/blog-post_24.html
>>40477745>>40474494qBittorrent v4.5.5 fucked me. It kept dying minutes or an hour after starting: maybe due to uploading, or some other reason. The newer AppImage is better, but by then the damage to fast resume was already done (forces me to recheck data). So far I rechecked 1 terabyte, but I have multiple more terabytes to recheck. First download of a torrent = first check since the pieces are hashed and verified; any check again = recheck. On download, via UDP (not as frequently valid data as TCP), incorrect received pieces are added to the "Wasted" statistic, I think. I have had this problem multiple times in the past where I had to recheck stuff. It is annoying because it unnecessarily wears down an HDD. With IPFS, at least this is not a problem (optionally check pin integrity by running "ipfs pin verify"). Looks like ZFS automatically scrubs the entire HDD (seen from this IIRC: "zpool list -v"), but I don't know how frequently.>>40478568Comments section of youtube-iIZwrYhjayY mentions Songbird Serenade: not a particularly pretty mare IMO.
>>40477721May be more 1:1 withhttps://www.youtube.com/watch?v=8QmMrD2Y934
Ten.
>>40479272Hmm well I got it after my laptop restarted. Guess I’ll restart it again later and see what happens.
>>40478224>thing to download channel banner, channel pfp, and channel metadataI also have something like this similar to that youtube comments script from a while ago. I’ll need to have a look at it again sometime when I’m free though because I did the bare minimum to get it working.
>>40479779Here's West_Crab_Venom_UCSw0Hkcd6X8tJY8lA70zykQ :https://w3s.link/ipfs/bafybeibbfgatmsi67t6oyrb2evjnieaysqjr3noudw3kwja5y4la7iyeiaDownloaded by improved one-liner:>$ yt-dlp -j --flat-playlist UUSw0Hkcd6X8tJY8lA70zykQ > 1plist1.json 2>1error1.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); mkdir $fdir; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.txt .; utc > 1stats1.txt; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc >> 1stats1.txt; if [ ! -s 1error1.txt ]; then rm 1error1.txt; fi; cd ..- better channel folder name- saves any error from playlist dl and per-video dl, and if text file is empty, delete it- todo: thing to delete other stderr saves if empty (not going to use "find . -type f -empty -delete")- todo: >>40481715>>40479272Build/compilation failed for an unclear reason:>$ nproc>4>$ make -j$(nproc)>[...]fatal error[...]Maybe this will work (some targets are already built so it somewhat picks up where it left off):>$ make -j2>[doing]
>>40452805>Stuff gets deleted off of archive.org more frequently than you would thinkProbably the most at-risk https://archive.org/details/... items are those uploaded by regular users and not "chosen one" IA staff or a similar whoever. Other instance of a deletion (dubbed anime):>https://archive.org/details/kodocha-episode-1-english-dubbed_202009 - seen as deleted months before this 21 Oct 2023 03:04:56 UTC snapshot: https://archive.is/L19Lx > 31-Jan-2022 08:28 file that I have - "kodocha-episode-1-english-dubbed_202009.zip" (3.8G): offline in ipfs://bafybeifzr3dtb7cjqctw23ryngscuzxf2ci622bfisnjrrqkldo35wtp7i
>>40480059Rechecked more, ended up downloading the entirety of this, most probably again (I really thought I had this already downloaded, maybe I moved the file or something):>My Little Pony Friendship Is Magic: Pinkie Pie Party>magnet:?xt=urn:btih:9dc50edfeef703217824229a5010f7b33f101107&dn=YP-DVD-PPP.ISOGotta have that birthday party with Pinkie Pie, to lessen the pain of growing older.>>40481842>$ make -j2Worked.---- Previously, there was a question about ssh from Linux to Windows 7; answer:>https://superuser.com/questions/1002291/how-to-set-up-openssh-server-on-windows-7/>http://www.security-plus.co/OpenSSH.txt>https://superuser.com/questions/873049/putty-to-windows-from-windows
Tik Tok is significantly popular, but it's not the most popular website in the world; it just had a bunch of DNS queries. Pfp from "Is Tik Tok Really the Most Popular Website in the World?":https://web.archive.org/web/20231029201032/https://y.com.sb/watch?v=vtXinzAk7Tw&listen=0
>>40471119Here's a list of files in there - "My_Little_Pony_Books_Collection.torrent.txt" via "trntbyte.py":https://w3s.link/ipfs/bafybeiawpyvg2o4foyhqxz6l6mhygaq6evmpua2po2odobhtu2ddjq677i>>40482881>pfpPaging through a list of whom that channel is subscribed to, links to some MLP-related channels; didn't show all of the channels because it eventually pages to an error page:https://web.archive.org/web/20231030091649/https://y.com.sb/channel/UCNkmtFStWPjwYxPt7B5t3mQ/channels
>>40479272I compiled Lokinet on Linux Mint (x86_64, not i386); that software is seriously lacking and basically unusable, at least that is the case with the compiled version. Well, I tried (binary works much better on Ubuntu - not helpful for Linux Mint). Current setup: saving links to wbm via 3 IP addresses which are mine+Tor in computer1 and Tor in computer2 (using torsocks in both computers). (Note to self: restarting systemd-resolved.service sometimes fixes network issues.) No hooves from >>40471759
>>40483450https://github.com/oxen-io/lokinet/issues/1679#issuecomment-866792086> sudo setcap all=+eip /path/to/lokinet
Flutterwonder by Matt R - video file is still censored, going to download that small channel for any v2 videos:https://www.youtube.com/channel/UCmkLCc8ovB3F1CZBgxqKN5w>>40477721Funny video>>40364046>DistroTubeHe basically said that all conspiracy theories are incorrect - https://www.youtube.com/watch?v=r0WYSINwIdk - that is a stupid and pleb idea.
>>40484925Downloading it. That Flutterwonder version 2 video:https://x0.at/7gWQ.webm>>40484243That improved it functionality. More info:https://github.com/oxen-io/lokinet/discussions/2208https://github.com/oxen-io/lokinet/issues/2209
*improved its functionalityBTW, today I had a dream that Lokinet was working completely fine.web.archive.org claims to be able to "Save error pages (HTTP Status=4xx, 5xx)", but it cannot save HTTP 429 Too Many Requests, such as: https://4get.silly.computer/web?s=test . I can probably write a script to save these webpages: apache2(localnet)+wget(warc)+w3s(nodejs).
>>40485144>4get.silly.computer/web?s=test webpageSaving it:* wget with no user agent: gets a "you are blocked...scraping" page* grab-site: does not get some resources such as the captcha image* archive.ph: saves the page, with a focus on appearance and not the actual source code of the webpage* web.archive.org: does not save HTTP 429 (maybe try spn.sh?)* something else: didn't tryBut how do you easily save archive.ph webpages? You can't. And if you get a browser automation thing like selenium running and working for a while, you may quickly hit a captcha page. Saving archive.is pages:* curl=failure. "curl https://archive.ph /ABCDE" gives up after 60 seconds* wget=failure. "wget -qO- --content-on-error https://archive.ph /ABCDE" runs endlessly and gets no data* grab-site=failure. "grab-site --level=1 --delay=5 https://archive.ph /ABCDE" does not receive any data or payload data* mitmdump=works, but usually inconvenient.* lynx=works, but missing some data, have to do manual stuff (more research needed). "lynx -source https://archive.ph /ABCDE > archive.ph-ABCDE.html" then edit that HTML file or make a folder to link to "lynx -source https://archive.ph /ABCDE/123345677...deadbeef.jpg > archive.ph-imagefile.jpg"** also remove your IP address from the HTML if you want* a non-lynx web browser + save as webpage-complete or whatever: works, but you use a GUI.* something else: didn't tryResults:https://w3s.link/ipfs/bafybeibku5iyputy3rbrdx4hnbksvgpdjdd2cqfvydc2vk4jexiwzu2l6eImage from >>40435105>"./4chan-mlp/desuarchive-images-car/120" which is>bafybeiajrhanwywtjsbx3qgj5dlw4tlpwnywl4fi5dw5qtmkdi272vffuq which includes file>bafybeickabjuylv5avdyuz2ic2sdr3lhwbl4gvklmo6cnm3veer43wckju
>>40483040Some of them (all dead/offline):>first_chunk_number first_chunk_offset file_offset length path>1 0 0 154619515 [b'Equestria Girls - Legend of Everfree', b'EqG_LoE.cbz']>590 154402816 154619515 4213203 [b'Applejack and the Honest-to-Goodness Switcheroo', b'Applejack and the Honest-to-Goodness Switcheroo.mobi']>606 158597120 158832718 2240947 [b'Applejack and the Honest-to-Goodness Switcheroo', b'Applejack and the Honest-to-Goodness Switcheroo.pdf']>615 160956416 161073665 47180717 [b'Daring', b'Daring Do and the Eternal Flower.cbz']>795 208142336 208254382 49765215 [b'Daring', b'Daring Do and the Forbidden City of Clouds.cbz']>985 257949696 258019597 46290700 [b'Daring', b'Daring Do and the Marked Thief of Marapore.cbz']>1161 304087040 304310297 4247733 [b'Discord and the Ponyville Players Dramarama', b'Discord and the Ponyville Players Dramarama.epub']>1178 308543488 308558030 4634624 [b'Discord and the Ponyville Players Dramarama', b'Discord and the Ponyville Players Dramarama.mobi']>1195 312999936 313192654 3228322 [b'Discord and the Ponyville Players Dramarama', b'Discord and the Ponyville Players Dramarama.pdf']
>>40485647WARC finished if it wasn't updated since then:>./Pony/Comics/My Little Pony፡ The Manga/ <- https://web.archive.org/web/20230810214033/https://bafybeicc3vscbnljjwpobto6vq4padrehxrbgz5bgx77kvjfqfleaniaxy.ipfs.dweb.link/?filename=My%20Little%20Pony%E1%8D%A1%20The%20Manga> root (14 GB offline): bafybeihgm76f2ufikry75zecbqdqszjpfb4oguterj53tq6ydkotoh7d5mNow doing:>./Pony/Books/Captcha: 2DTNT
>>40485741Getting a WARC of folder "./Pony/Books" from an onionsite. I should have included this in the wget command: "--restrict-file-names=windows" or "--restrict-file-names=ascii".
>>40485741> My Little Pony፡ The MangaWas reading more of that today. Made me think yet again: G4 ponies have longer and/or more vertical necks than IRL ponies and horses. IIRC G1 ponies didn't have necks which formed a 90 degree angle with the ground, so more of an acute angle (more true to IRL).Was going to post this, but it's >4M>https://web.archive.org/web/20201108101742if_/http://www.ponyrideparty.com/indy/wp-content/uploads/2011/01/My-little-pony-mystic-no-saddle-touched-up.png
>>40485873Also, G4 necks can like bend backwards, so something of an obtuse angle with the flat ground. Image: vol1 p24 top
>>40485647>EqG_LoE.cbzNo historic results here:https://www.google<dot>com/search?q=%22EqG_LoE.cbz%22&nfpr=1>Archive.today>https://archive.ph › ... [8dNn7]>30 Oct 2023 18:02>1 day ago — ... EqG_LoE.cbz'] 590 154402816 154619515 4213203 [b'Applejack and the Honest-to-Goodness Switcheroo', b'Applejack and the Honest-to-Goodness ...
>>40454161Would you be interested in automatically saving tens of thousands of Google Drive metadata links to WBM? I could send you a link list. I have been doing this myself, takes very long to complete. Not sure if anyone else would be interested. (I have the json raws locally, but they are mostly not in wbm.)
>>40480059Maybe there is an option to skip hash check for already-added torrents, so you don't have to waste time rechecking terabytes because the stupid software broke fast resume.
Boo!
Paizuri-ing pregnant pretty pink pony Pinkie Pie's perfectly plump phat pussy pals - popular Ponybooru->Ponerpics penis pulling page (Pusspuss PNG):https://web.archive.org/web/20231031201328/https://ponerpics.org/images/6060096
^Patreon->Ponybooru->porter->Ponerpics penis pulling page (Pusspuss PNG part 2):Save archive file of latest from master branch:GitHub- https://github.com/brion/ogv.js- https://github.com/brion/ogv.js/zipball/master- meditation: add "/zipball/master" or "/tarball/master" to the endGitLab- https://git.shivering-isles.com/github-mirror/omarroth/invidious- https://git.shivering-isles.com/github-mirror/omarroth/invidious/-/archive/master/invidious-master.zip- meditation: add "/-/archive/master/<repo_name>-master.zip" to the end
>>40485647>Daring Do and the Forbidden City of Clouds.cbzbytes: 49765215 - similar file, but not it:bytes: 49793225 - "Daring Do and the Forbidden City of Clouds (scan).cbz">Daring Do and the Marked Thief of Marapore.cbzbytes: 46290700 - similar file, but not it:bytes: 46319484 - "Daring Do and the Marked Thief of Marapore (scan).cbz"
>>40484986lokinet --version:ubuntu: lokinet-0.9.11-5023cdd03mint: lokinet-0.9.11-178ac1757Perhaps compile 5023cdd03 instead? Not something I feel like doing. Or maybe wait for an update to fix everything.
I am downloading this, it has "most" of the .torrent files from YP:https://archive.org/download//yp1.yayponies.no>>40464844Found some of the files. Having some difficulty finding .mobi and .epub for "Starlight Glimmer and the Secret Suite".
I was wondering about this a while ago. Uploading WARCs to archive.org:- ~1990s to ~2016: each URL in there would become accessible via web.archive.org- ~2016 to now (2023): each URL in there would become accessible via web.archive.org, but only if it was uploaded by a trusted member of Archive Team. 2022 example below.In the the 60 minutes I just realized that each time I click edit, change the text, and click submit, it pastes to a new URL:https://put<dot>icu/7ijmbxf6.txthttps://put<dot>icu/q4hxo22e.txthttps://put<dot>icu/ikr7nq7j.txt
>>40489477Is that a book or a comic book? Said to be the 21st book in a series:https://breeze.nohost.network/mlp/wiki/Starlight_Glimmer_and_the_Secret_Suite
>>40489477A significant amount of Yay Ponies data currently only exists as one Vietnamese peer in BitTorrent. For clarity, I mean that I downloaded that IA item, which is only the BitTorrent metainfo files (.torrent files).In the past I downloaded YP torrents, but I guess I could download them again later on, this time as a batch of many .torrent files so I could get a more complete copy.
Two versions of "ia", a CLI program which I used to upload/download to and from archive.org:https://w3s.link/ipfs/bafybeiaifsw5yfqs6mqgdbe6v7nrgds3mvarrj6qb7ttwqvxdxctsqkhhy>>40489477>Having some difficulty finding .mobi and .epub for "Starlight Glimmer and the Secret Suite".Disregard this. wget or source had it downloaded/saved as .html, and I was filtering out /.html$/. Now having difficulty finding a "Princess Celestia and the Summer of Royal Waves.pdf" which matches.
I found screen to be helpful, for checking on crawl logs and probably other stuff:https://linux.die.net/man/1/screenYou can tell if screen is being used because in the terminal emulator program the scroll bar does not scroll up (text in the current screenful is all there is); additional, while using screen, pasting in a command ending in a newline will run that command, which is not the default behavior in newer/current GNOME Terminal.>>40489994Info:https://nerd.whatever.social/mlp/wiki/Princess_Celestia_and_the_Summer_of_Royal_Waves
>>40489557 *the past 60 minutes>>40490499 *additionally>>40489573Categorized as book (not comic book) from one source. Same with >>40490499
>>40464844>My Little Pony Book CollectionOlder version, apparently:http://146.19.24.47:8000/hash/47a39a5a3817bc6f33f069c924a33509e85fb311.html
>>40490570This checks out, another dead torrent:https://web.archive.org/web/20180808173109if_/https://itorrents.org/torrent/47a39a5a3817bc6f33f069c924a33509e85fb311.torrentThere is also:http://146.19.24.47:8000/hash/74f9bdec91d2e329d2446e791944df5c232e6302.htmlhttps://itorrents.org/torrent/74f9bdec91d2e329d2446e791944df5c232e6302.torrentSaw an anthro pony pfp here: https://web.archive.org/web/20231102011909/https://y.com.sb/watch?v=YrJnBGG_SQc (npr) -> https://y.com.sb/ggpht/ytc/APkrFKYngov7_bt8golOiXWSK3jCG19kSsZcksDnRRqu%3Ds0 (and wow that video is stupid, couldn't pay me to watch the entirety of it)
>>40464844Does ANYONE have torrent "My Little Pony Book Collection"?It was alive in 2020:https://desuarchive.org/mlp/search/text/91b8bf3b723472962bcbfb52074d622ef1ed1af2If it was alive today I wouldn't have to look at this scam/clickbait garbage from a Google search:>https://colab.research.google.com/drive/1XskOzNWM2ZO6A1WZ9fwM8gv-pKljjxB_> SEO for https://best.booksrewards.com/?book=0316410861
>>40490770That threadhttps://desuarchive.org/mlp/thread/35043159/links to...dead:https://mega.nz/#!WcQ03ACI!wXpprVvUpHZr7j2ObVuHFf35tcEpmRLZe_hzfZKsqqUstill alive (downloading it with megatools in Linux):https://mega.nz/#F!LMwShY4Q!QZ0S95tTYr3_Yynp_Ag3OQan onionsite: first thing I checked. Captcha: DPTDHT
>>40490799"still alive" - all of this shit is "Empty folder". No wonder megatools and MegaBasterd downloaded nothing."golden oak library"
Did anyone download "golden oak library" mega cons links? There was a few of them IIRC (mega.co.nz , mega.nz)
>>40490799(first thing I checked days ago, that is.)
>>40490908Similar, not it, still alive:https://mega.nz/#F!rrZCGaJJ!hX40ghckXITc03z4Y1gYmgMLP General links to a broken vol.3 link:>>40488542> https://mega.nz/#!7Y43RCoS!WujvDfG-20FsDUXsMAIPpZE8qp3FECTL58wETuMIoz/Yshould be this instead:> https://mega.nz/#!7Y43RCoS!WujvDfG-20FsDUXsMAIPpZE8qp3FECTL58wETuMIozY
>>40491639Audiobooks, matching title, zip files:https://mega.nz/folder/PjB01LLI#IEi9B5CopZK0E5M17yObNQpfp from "AI Regulation Is a Lie" (npr)>https://web.archive.org/web/20231102011944/https://y.com.sb/watch?v=_E6Fkx_CmYE
>>40491648Has mp3 files only, https://x0.at/NAt9.zip>>4049163916G, same link: https://mega.nz/folder/rrZCGaJJ#hX40ghckXITc03z4Y1gYmgpfp from YT comments section >>40491648
>>40491706Been searching. Filter out OPs because MLPG does not have the links I am looking for.Pony Life:https://mega.nz/folder/Ji5VkAwY#BYzHARWDjj-djo8e4WTsnQMLP Bible:https://mega.nz/folder/c0tk2QBR#VqtH9U3wK_3qtd9BPBPocw
>>40491706> https://x0.at/NAt9.zipI thought the part with Pinkie Pie and AJ was sorta funny (file *05*).>>40491706Finished downloading that, 17G not 16G.>>40491731Dead, according to a post this was book-related:https://mega.nz/#F!IGRQ1CDI!BfMoF-4WCKH10ntXH-y1KAWith mega "cloud storage" links, the files are usually compressed. Found this picrel interesting in regards to representing larger data with smaller stuff - "Millitext is a font where glyphs are one-pixel wide.">https://web.archive.org/web/20230926171421/https://nitter.d420.de/pikuma/status/1683130111808118786
The Hub Flash Games:https://mega.nz/#F!gQ0kVaKb!unF9M8Ut1K7hbJ6UA6C54wEqG something:https://mega.nz/#F!baBQTKwB!pddUvRszMyT1KIUFvUqA3Q>>40491767>DeadLinked here, info:https://desuarchive.org/mlp/thread/31848445/#31849943Also:http://www.mediafire.com/file/l43u24xfk736yx3/Books.rar
>>40491818>Books.rarThat is another case of the 3.4 MiB version of it:>./https-www.mediafire.com-file-l43u24xfk736yx3-Books.rar-file/Books/Princess Collection/Princess Collection #1 - Princess Celestia and the Summer of Royal Waves/Princess Celestia and the Summer of Royal Waves.pdf> SHA1 hash: 30f0f5e41746d46f67ec49411ce3c824f92f9d28I'm looking for the 3.2 MiB version of "Princess Celestia and the Summer of Royal Waves.pdf".
>>40491852Linked here, 2016:https://desuarchive.org/mlp/thread/28279383/#28308110>https://torrenthound.unlockme.download/hash/55cc84bedf80382bedefa53e4437073435fb5d71/torrent-info/My-Little-Pony%3A-Princess-Celestia-and-the-Summer-of-Royal-Waveshttps://itorrents.org/torrent/55cc84bedf80382bedefa53e4437073435fb5d71.torrent>http://www.easybytez.com/c602rjbi4ev2Dead
>>404918523.4 MiB version yet again:https://webm.newlunarrepublic.fr/livres/YP-PDF-PCBOOK01.pdfWhere did the 3.2 MiB version even come from? I see that file (missing) in 3 torrents.
>>40491900Maybe this is it:http://www.mediafire.com/download/cge9lb9lloqw83c/Princess+Celestia+and+the+Summer+of+Royal+Waves.rar
>>404919233.4 MiB version again. I was sharing that file with myself, findings:- https://gofile.io/welcome = sucks- https://www.file.io/ = better, burn after reading, gotta type in a 12-character-long ID to download it
>>40491852Dead:https://thepiratebay.org/description.php?id=24881734https://itorrents.org/torrent/E918B8A664430FA353E75163935D62FEA500AB74.torrentDownloading:https://archive.org/details/my-little-pony-ebook-previews
>>40491960>https://itorrents.org/torrent/E918B8A664430FA353E75163935D62FEA500AB74.torrentActually, not dead! This Pony Books Collection v3 torrent is lowly distributed with only one seeder - 11.6 MiB/s max download speed from that guy.
>>40489994>>40490499>>40490698>>40490770>>40491648>>40491706>>40491818>>40491852>>40491866>>40491900>>40491923>>40491941>>40491960>>404919822015 small torrent, restored! "Princess Celestia and the Summer of Royal Waves.pdf" (3.2 MiB version):magnet:?xt=urn:btih:55cc84bedf80382bedefa53e4437073435fb5d71&dn=My_Little_Pony_Princess_Celestia.pdf&tr=http%3A%2F%2Ftracker.nwps.ws%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.winglai.com%2Fannounce&tr=http%3A%2F%2Ffr33dom.h33t.com%3A3310%2Fannounce&tr=http%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&tr=http%3A%2F%2Ftorrent.gresille.org%2Fannounce&tr=http%3A%2F%2Ftracker.trackerfix.com%2Fannounce&tr=udp%3A%2F%2Ftracker.btzoo.eu%3A80%2Fannounce&tr=http%3A%2F%2Ftracker.windsormetalbattery.com%2Fannounce&tr=udp%3A%2F%2F10.rarbg.me%3A80%2Fannounce&tr=udp%3A%2F%2Fipv4.tracker.harry.lu%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.ilibr.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.zond.org%3A80%2Fannounce&tr=http%3A%2F%2Ftorrent-tracker.ru%2Fannounce.php&tr=http%3A%2F%2Fbigfoot1942.sektori.org%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.best-torrents.net%3A6969%2Fannounce&tr=http%3A%2F%2Fannounce.torrentsmd.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.token.ro%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A80&tr=http%3A%2F%2Ftracker.thepiratebay.org%2Fannounce&tr=udp%3A%2F%2F9.rarbg.com%3A2710%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.ccc.de%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.istole.it%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.publicbt.com%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.istole.it%3A80%2Fannounce&tr=http%3A%2F%2Ftracker.istole.it%2Fannounce&tr=udp%3A%2F%2Ftracker.publicbt.com%3A80%2Fannounce&tr=http%3A%2F%2Ftracker.publicbt.com%2Fannounce&tr=udp%3A%2F%2Ftracker4.piratux.com%3A6969%2Fannounce&tr=udp%3A%2F%2Finferno.demonoid.ph%3A3389%2Fannounce&tr=udp%3A%2F%2Fglotorrents.pw%3A6969%2Fannounce&tr=udp%3A%2F%2Fbt.rutor.org%3A2710%2Fannounce&tr=udp%3A%2F%2F9.rarbg.me%3A2710%2Fannounce&tr=udp%3A%2F%2F9.rarbg.com%3A2710%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannouncehttps://x0.at/BitU.pdf
>>40470398>>40471254>>40475924After about a week of seeding, my initial 1:1 seed has completed. I'll still be seeding for about 1 more week but cannot guarantee much else after that.I've been trying to download the Blu-Ray ISO for Legend of Everfree from the 5dpttbqad Onion site and have had little luck besides very slow download speeds in the browser. I've tied Tor with several FTP clients and was able to get into the SFTP server but couldn't browse much or download anything at all.Are there any other sites/projects outside of YP and that Onion site with DVD/Blu-ray disc images? And how might REDUMP (was mentioned earlier) help?I've found a few cool things on Usenet. I've downloaded raw Blu-ray disc images of the 2013 Brony doc and a Blu-ray remux of the 2014 A Brony Tale there. There's also quite a few of dubs of FiM that can be had there. I also can rip lossless audio files from Qobuz and Deezer (there's some sites out there that do that). I could help if any help is needed for Usenet or audio streaming service rips. You can also find my collection of G4 related stuff on Soulseek.
>>40485761Cancelled it at 24 GB of WARC files: I gotta remember that wget with --recursive (infinite level) and --span-hosts is usually a stupid idea. (I explained why it is a bad idea in a previous thread.) I guess I got everything in the target site under that folder, should probably do some sort of link enumeration and compare local paths with remote ones (to check for completeness).>>40493665> I've been trying to download the Blu-Ray ISO for Legend of EverfreeFilenames? Some of them are torrents, and I could share the links. Some other ones were never torrents (I think), and I also have some of those.
*Cancelled it at 24 GB of WARC files created from downloading>>40493665>I've tied Tor with several FTP clients and was able to get into the SFTP server but couldn't browse much or download anything at all.The download via sftp thing has been non-functional for months: I noted this a while ago. Web archive it by using torsocks and wget with warc writing options. Paths where I think I have everything under these folders in that onionsite:- ./Pony/Books/- ./Pony/Comics/My Little Pony፡ The Manga/- [I have other data like ISOs and Leaks, but not as WARCs]>>40485741 >>40494005 >>40485761
>>40493665> You can also find my collection of G4 related stuff on Soulseek.How?>>40494046Download via sftp did work in the past (something that I did), but it looks like an update broke it.
>>40493665I try to get a share ratio of at least 3 on all torrents. If I can share more than that I try for a ratio of 10, then I basically stop seeding. I would say that I have 5TB of torrents that I have backed up locally (which is true), but the backup HDD is low/medium trust storage.>>40494046>wget with warc writing optionsOr, see if grab-site works in Tails OS. Should mention this important "undocumented" wget thing with robots.txt:Save a page with outlinks on (level 1), like wbm spn with an account:>do=0_in_1.txt; TZ=UTC wget -p -r --level=1 --span-hosts --adjust-extension --convert-links --warc-max-size=1000000000 --warc-cdx -e robots=off --warc-file=$do --input-file=$do 1>$do.1.log 2>$do.2.log # --exclude-domains=googlevideo.com does not work well because of redirects or somethingSave everything under a folder (--no-parent, no offsite links):>do=0_in_1.txt; TZ=UTC wget -p -r --no-parent --adjust-extension --convert-links --warc-max-size=1000000000 --warc-cdx -e robots=off --warc-file=$do --input-file=$do 1>$do.1.log 2>$do.2.log # I think this didn't work very well for downloading this one plain "index of" view for an IA item, perhaps due to not having span-hosts=*.archive.org or whatever
>>40493665>And how might REDUMP (was mentioned earlier) help?To get the best dump of discs (especially if further verified by multiple people who also have the discs physically). I encourage you to read this:http://wiki.redump.org/index.php?title=Redump.orgRedump.org is about video game optical discs, but their methods and guides for creating the best dump of a disc can be used by anyone for any optical media. Some of the text in that article plus some of my explanation of their project:> Multiple dumps of games with the same serial number by different people are collected to ensure the same results are gathered, which help correct any incorrect dumps in the database as well as to help recognize alternate versions of the same game.> You can use this information in the database so that you can compare a backup you've made to a backup someone else has made of the same disc, even with different PC configurations and drives. This comparison will verify that you've dumped your disc accurately and it's not faulty.> Optical media is especially susceptible to damage in the form of scratches, cracks, heat, sunlight, etc. Preserving these discs now will ensure that future generations aren't deprived of our video game history.> Why are "verifications" necessary and/or helpful to the project? Isn't one dump good enough? \ Verifications are vital in verifying that the information in the database is accurate, and that a dump is reproduceable by another person using the same tools and methods. An existing dump could be erroneous due to a variety of factors, including user error, hardware and software issues, and more. Furthermore, even when someone is doing everything correctly and has adequate software and hardware, there is a chance that their dump could be incorrect, due to the way data sectors on a disc are read and validated (especially Compact Discs). In most cases, the data will be read and verified successfully, but the process of reading data is not infallible, so there are times when a second dump of the same disc could provide differing information. Verifications help to identify and correct some of these issues.For example, here you can see various information regarding an optical disc or release of a game:http://redump.org/disc/29849/* incl.** SHA1 hash, MD5 hash** text seen on the pressed discIn that example page multiple users got the same hash on the ISO files that they created. This is significant for verification. In the past I causally made two ISOs from the same disc; their hashes didn't match even though, IIRC, I used the exact same software in the exact same OS. Image files created of discs are not deterministic, so it is helpful to have info about which image file is the best and most complete image of a disc.>>40494209Also, probably don't use wget for Windows EXEs or from Cygwin - they make crappy warcs. Use wget in Linux (or FreeBSD?) instead.
>>40494328As for making a "database" of disc info, can't use redump.org for non-vidya, so you could edit wikis. Suggestions:* fuck fandom.com, use something else instead** maybe use Miraheze https://miraheze.org/** maybe use this, don't know much about it https://equestripedia.org/** maybe use this, ran by Rome https://mulpwiki.batpony.party/
>causally*casually
>>40494209What I think I will do in the longer term (1 week-few months or more) is seed at a highly reduced speed during the day and allow it more speed during the night.>>40494046I was hoping I wouldn't have to take that kind of route as that is something I'm not familiar with. I'll have to learn about the fundamentals of running and using Wget and Torsocks first.>>40494328I see, so you would like to see data integrity taken into account that could be replicated by another user. Looking into some of this documentation, I'm skeptical on how copy protection/region locking is being taken into account for verifying and/or copying. Based on my experience when ripping DVDs from another region, it was strongly suggested to have a disc drive with hacked firmware or some sort of region free firmware. I didn't have that and couldn't rip region 2 DVDs I had into ISOs with most software I could find. For those, I used DVDFab to make the ISOs as it could circumvent many things out of the box. The MLP 2017 DVD was also one of those tricky to rip DVDs and it also had Cinavia audio watermarking that DVDFab could detect and I believe removed. So as you can tell, my ISOs are not exactly 1/1 copies of the original discs. I might have mixed some things up but I hope you get the whole gist of it.>>40494065First of all I have to say that my collection is primarily focused on official video and audio material and getting them in the best quality I could find. Soulseek is a P2P file sharing network primarily used by music collectors to browse and download from each others stuff from their computers but it can be used for all types of files. The two most popular client programs are SoulseekQT and Nicotine+. Many people prefer Nicotine+ especially for its Linux compatibility but I personally use SoulseekQT. If you just want to browse files you don't have to share but if you wish to download, sharing a directory of files is almost a necessary gesture. Unlike torrents (at least from what I could tell), there is a message function so you can directly message people. As I don't want to share my username here, search for the file "ANON YOU HAVE FOUND ME" and I will show up.>>40494354If I were to make page about MLP discs, I might just make it out of basic HTML and CSS and host it on something like Neocities. It kind of sucks that the best resource for G4 MLP disc releases are on retromedialibrary.fandom.com and mlp.fandom.com/wiki/Home_media. I used those to help get an idea of what DVDs were released along with browsing shopping sites, not as a primary source. It's a bummer to find that there isn't much out there for MLP discs and especially rips. I know that wouldn't be big due to how much stuff can be had in better quality elsewhere but I would have thought it would have been bigger than how it is so far. From casually sharing ISOs to now possibly being a forerunner for a potentially bigger thing, talk about a rabbit hole I would slowly sink into.
Some vintage videos on MLP official music channel. Hasbro appears to have rebranded one of their old MLP channels. They haven't taken down old videos yet but they might.https://www.youtube.com/@MyLittlePonyOfficial/videoshttps://www.youtube.com/watch?v=PhxIbqUXwmghttps://www.youtube.com/watch?v=K1LCjXoRYqM
>>40474479Did anyone archive derpibooru comments? There were some hot ones to me that were associated with images that were deleted.
Looks like the owner of Alligator Tub Productions is messing around with the channel again, except this time all the videos have been privated: https://www.youtube.com/channel/UCqrCgswKANDHeCF-xUNllyA
"White freckles in the palm of your hand (white freckles)"https://archive.org/details/01-plastic-raincoats-in-the-pig-parade/02+-+White+Freckles.mp3Twibooru featured image was still the Oct. 31st one in 2023-11-02 UTC, IIRC. Changed:>https://web.archive.org/web/20231031201105/https://twibooru.org/>https://web.archive.org/web/20231103092316/https://twibooru.org/
>>40495429Someone apparently saved all of the Derpibooru comments back in the 2023 month in which Imgur announced that they were going to purge and restrict files. Got the comments to get Imgur links out of them. Ask in TPA Discord channel, so maybe you can also get that data >>40443875>>40496068Image
web.archive.org cannot save links containing "/ad/", reasoning: it might be an advertisement (=blocked url); I have seen a false positive with this before.archive.ph cannot save links ending in ".mp3", even if it is to text/html. Example:https://wikiless.org/wiki/2taktare.mp3forever stuck on>https://archive.is/submit/?submitid=SEsVMwEOfX%2B%2BxguykYXWJcigZrAnSy0IBk2FAvRZ0fEaBHBxbFa%2BPNzmVjaLaV2f&url=https%3A%2F%2Fwikiless.org%2Fwiki%2F2taktare.mp32taktare.mp3: Wikipedia redirect to Crazy Frog. Speaking of, 2016 video not in TPA - "(MLP) Crazy Frog - Axel F (PMV)":https://y.com.sb/watch?v=Smbg-e_GF5M
>>40495416Guess I will download that channel or just those two videos after I finish downloading this one mega.nz thing.>>40496118https://wikiless.org/wiki/Crazy_Frog>If you release Crazy Frog NFTs I'm going to fucking murder you.Lol
>>40494209It's fine to say that a torrent is backed up locally, but where's the proof. IPFS can be used for something of a cryptographic proof that someone has two local copies of a torrent; for example, here's "ipfs add -wHr 'Halo 3 OST'" (191 MiB):from> magnet:?xt=urn:btih:e99d156a7eae444463a0326b10f73cabd6c62c6ato> /ipfs/QmPwuwFrZbbhSJqDrfUKYxVWw4pFmLwvhuvGCrTRpvkaSm>>40496148Downloading "Pony Life" >>40491731 which is like 18G. Includes a folder which has some data from Gfycat, maybe, which is a dead website. Or, GIPHY, don't know the domain name for that; MegaBasterd 8.14 (file attached):>INFO: pool-2079-thread-4 Worker [2]: let's do some work! Pony Life/Official GIFs on GIPHY/Apple Jack Summer Sticker-EoNOokQWX44gwaDgGm.gif
>>40233419> >>40233373> >Da1GtM-N8Xk> MLP FIM Claymation (international audience), didn't know that was a thing. I sorta like the one with the cakes. Also, video not in TPAThat video is a combination of>1. http://10.0.0.232/z8/https-mega.nz-folder-Ji5VkAwY-BYzHARWDjj-djo8e4WTsnQ/Pony%20Life/Stop%20Motion%20Shorts/Stop%20Motion%20Short%20Ep.%2005%20-%20Pillow%20Fight.mp4>2. (Probably) http://10.0.0.232/z8/https-mega.nz-folder-Ji5VkAwY-BYzHARWDjj-djo8e4WTsnQ/Pony%20Life/Stop%20Motion%20Shorts/Stop%20Motion%20Short%20Ep.%2001%20-%20Potion%20Party.mp4>3. http://10.0.0.232/https-mega.nz-folder-Ji5VkAwY-BYzHARWDjj-djo8e4WTsnQ/Pony%20Life/Stop%20Motion%20Shorts/Stop%20Motion%20Short%20Ep.%2002%20-%20Cake%20Off.mp4>4. http://10.0.0.232/z8/https-mega.nz-folder-Ji5VkAwY-BYzHARWDjj-djo8e4WTsnQ/Pony%20Life/Stop%20Motion%20Shorts/Stop%20Motion%20Short%20Ep.%2003%20-%20Fashion%20Failure.mp4
>>40496350Readme file in there has more links:> PONY LIFE MEGA FOLDERS> > > SEASON 1: TVrip from Treehouse TV [by Dani]> >> also contains: Stop Motion Shorts + Pony Life Soundtrack + extras> >>> https://mega.nz/folder/Ji5VkAwY#BYzHARWDjj-djo8e4WTsnQ <<<> > > SEASON 1: WEB-DL from Hulu [by vitaly3 on RuTracker]> >> Russian and English audio tracks, includes subtitles> >>> https://mega.nz/folder/4bxBjQ6K#HD91AVCRA1zjOKTHHncGlA <<<> > > SEASON 2: WEB-DL from TinyPop + MiniMini+ leaks> >> contains both raw and speed-corrected versions> >>> https://mega.nz/folder/3PRwWLDB#5gSoWQKPZu17oFnv8fhfDA <<<> > * See also Pony Life on YayPonies for Amazon and DFGo rips> https://yayponies.no/videos/pl/pl.php> > And if you need more ponies, check out Rainbow Roadtrip:> https://mega.nz/file/590QxRaR#S2LDfYWB2Nr0kWJPjJWthwyV5mi-gA_bEogxDfJiBYQ( thanks https://coding.tools/regex-replace )
>>40496148Downloading that channel:>$ yt-dlp -j --flat-playlist UUPDZUP5JAxet_mhLBPoNn5A > 1plist1.json 2>1error1.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); mkdir $fdir; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.txt .; utc > 1stats1.txt; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc >> 1stats1.txt; if [ ! -s 1error1.txt ]; then rm 1error1.txt; fi; if [ ! -s 1logy12.txt ]; then rm 1logy12.txt; fi; if [ ! -s 1logy22.txt ]; then rm 1logy22.txt; fi; cd ..- deletes stderr logs if they are empty >>40481842- todo: >>40481715pfp from https://www.youtube.com/watch?v=QtHbqf2lGaw (npr), this channel> http://www.youtube.com/channel/UCWWg36dwrb8njNsOFqpCAjAI had this same question:>how is a mod to get unlimited gobble gum ok but a mod to get the right luck cheating?
>>40497088It's now downloading this livestreamwww.youtube.com/watch?v=VbebScmiEV4, guess it will be stuck on that until the stream finishes. Maybe I could do something with jq/whatever to sort the json so livestream IDs show up at the end of the download queue (batch file).>https://www.youtube.com/channel/UCWWg36dwrb8njNsOFqpCAjASmall channel, no playlists.
WBM is seemingly blocking Tor IPs even harder now (HTTP 520 Unknown, and some connections refused): all the more reason to get Lokinet working better, request an API key from that one site, find a different method, or get the WARC(s) myself.>>40491639>>40491706Folder with MLP Manga files that I think are small enough to upload to LibGen:>./https-mega.nz-F-rrZCGaJJ-hX40ghckXITc03z4Y1gYmg/Comics/*Other rips/My Little Pony The Manga - A Day in the Life of Equestria/
>>40496492>youtube-Da1GtM-N8Xk>MLP FIMI think it is more "Pony Life" than FIM.BTW, JewTube is ridiculous, npr:>https://web.archive.org/web/20231031172503/https://www.youtube.com/watch?v=7Pq6ZIOhTg0>https://web.archive.org/web/20231103215606/https://y.com.sb/watch?v=7Pq6ZIOhTg0>This video has been removed for violating YouTube's policy on harassment and bullying
>>40495429Seems that most Derpibooru image post URLs are in WBM as of ~2022. Find one that isn't. However, whoever did that may not have saved all of the pages of comments (url: "?page=5" or whatever it is).>>40497490>Hamas bullied Israelis so hard that da jooz had that video deletedLulz
>>40498969Invidious version 2023.11.02-db3c57d @ master: can see some/all replies to posts on the YT community tab; for example, one from this MLP-focused YouTuber:>https://web.archive.org/web/20231104054851/https://vid.puffyan.us/post/UgkxMrIXN8aVUgCaN5tq2wbCmn_k3eTCvRBg?ucid=UCHKDtSVVEc686EW7jRSCpZA>Soooo ... as are a lot of people, I'm partially migrating my meagre asocial media presence over to BlueSky because, even though I love Twitter (cesspool that it is, I've made a ton of friends and discovered a lot of creators there) Musk is making it virtually unusable. You can find me here if you want to follow me: bsky.app/profile/obabscribbler.bsky.socialImage from what seems to be a sharty conspiracy - https://y.com.sb/watch?v=7fDE_0-Yz6g - pony near the bottom left?
>>40499326Didn't mean to reply to that post.>Musk is making [Twitter] virtually unusable.I agree. Besides paying $100 for some Twitter API, how am I supposed to get all of the Twitter post links from some MLP-related Twitter user? In the website formerly known as Twitter, the search function is loginwalled. Idea: remember or reset my Twitter password, login to X, search something like "user:abc start:2010 end:2011", then keep making similar searches to cover more date ranges. Eventually I should have all the post links. This seems to be the only way to get all of the posts from users who have a bajillion posts, like a quarter of a million from this one guy. Nitter can only page through like some less than ten thousand posts from whatever account.
>>40497088Finished downloading after about 6 hours. I could at a "du -sh ." thing to 1stats1.txt. Image from>http://10.0.0.232/z8/video/7572657/c2/My_Little_Pony_Official_Music_Channel_UCPDZUP5JAxet_mhLBPoNn5A/MLP_-_Friendship_is_Magic_Toys_Sugarcube_Corner_Friendship_is_Magic_Collection-My_Little_Pony_Official_Music_Channel-20160126-youtube-1920x1080-ihstbfd7-jo.png
>>40499347Problem with that is you can only see like 1000 posts per day. But how exactly is that counted? What if I use automation or something to get the links out of view-source:http..twitter..search.. ?>>40499423*I could add aLooks like that image uses this type of dithering:https://wiki.froth.zone/wiki/Floyd-Steinberg_dithering
2012 video not in TPA - "Kodocha Pony 3" ("crap" from a small channel):https://y.com.sb/watch?v=P5D6b4Qrk1c>>40432571Other nice classical music, it's like "Ride of the Valkyries":https://gateway.pinata.cloud/ipfs/QmZR3fpVPNULk1FMD3md3YSyhmy4Vh9MLe63BWLsoBHuy7
Small channels, newer, similar:ponerzoner UC8omWd20WCdh1YhgZew47NwBatsy UCVvQ5E-M0kjufkdQfPsDVsASmall channel, older, some effort put into videos:KittyCatYugi UCPVC4l1-uQd4vz1MmX4yH0g >>40499773BTW, probably a bug that YouTube's official channel on YouTube has some videos here which show up as having zero views:https://web.archive.org/web/20231028055128/https://y.com.sb/channel/UCBR8-60-B28hp2BmDPdntcQ?sort_by=popular
>>40499817Downloaded ponerzoner by using this improved one-liner:>.../z8/video/7572657/c2$ yt-dlp -j --flat-playlist UU8omWd20WCdh1YhgZew47Nw > 1plist1.json 2>1error1.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); mkdir $fdir; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.txt .; utc > 1stats1.txt; chan=$(pwd | grep -o "........................$"); curl -sL $(curl -sL "https://web.archive.org/web/2/https://y.com.sb/channel/$chan" | grep '<meta property="og:image" content="' | sed "s/\">$//g" | sed "s/.*\".......................//g" | sed "s/=.*/=s0/g") > 1pfp1.png; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc >> 1stats1.txt; if [ ! -s 1error1.txt ]; then rm 1error1.txt; fi; if [ ! -s 1logy12.txt ]; then rm 1logy12.txt; fi; if [ ! -s 1logy22.txt ]; then rm 1logy22.txt; fi; cd ..- hacky method to get the profile picture of a channel (picrel), also assumes that that channel URL is in WBM- todo: other stuffFindings: derived pfp url sometimes links to a better/larger image, other times not. Therefore, get both the default pfp url and the derived one; default should be "1pfp1.png", and derived should be "1pfp2.png". Also, thing to detect if the file is JPG or PNG (like reading the head bytes).
>>40499873>get "derived" and "canonical" pfpDone:>[...]chan=$(pwd | grep -o "........................$"); chanp=$(curl -sL "https://web.archive.org/web/2/https://y.com.sb/channel/$chan" | grep '<meta property="og:image" content="' | sed "s/\">$//g" | sed "s/.*\".......................//g"); chand=$(echo $chanp | sed "s/=.*/=s0/g"); curl -sL $chanp > 1pfp1.jpg; curl -sL $chand > 1pfp2.png; wc -l 1plist1.txt >> 1stats1.txt[...]Downloading channel "Batsy". Canonical pfp: jpg artifacts, larger. Derived url to pfp: png w/out jpg compression crap, smaller
Should also get derived URL and non-derived URL for channel banner. Attached=banner of >>40499873 . Potential issue: torsocks yt-dlp sometimes can't download the YouTube webpage due to HTTP 429 Too Many Requests.>>40499773>>40496350"Never Forget" is likely the most popular track in that soundtrack album:https://gateway.pinata.cloud/ipfs/QmNXFBcFoyAESPMWjkxWkT1qSYJd76mF3FrhA5c7f8obe2So I updated kubo ipfs, now it outputs a warning message telling me something I already knew: that my software/hardware/network power is week. node/provider.go:88:>[...]YOU ARE FALLING BEHIND DHT REPROVIDES![...]>[...]Your system is struggling to keep up with DHT reprovides!>This means your content could partially or completely inaccessible on the network.>We observed that you recently provided 137 keys at an average rate of 38.739077723s per key.>[...]Your total CID count is ~9690 which would total at 104h16m21.66313587s reprovide process.>[...]The total provide time needs to stay under your reprovide interval (22h0m0s) to prevent falling behind!>[...]Consider enabling the Accelerated DHT to enhance your reprovide throughput. See:>https://github.com/ipfs/kubo/blob/master/docs/config.md#routingaccelerateddhtclient
^*is weakImage=banner of >>40499922
>>40495416>http://10.0.0.232/z8/video/7572657/c2/My_Little_Pony_Official_Music_Channel_UCPDZUP5JAxet_mhLBPoNn5A/My_Little_Pony_Songs_The_Pet_Song_Music_Video_MLP_Songs-My_Little_Pony_Official_Music_Channel-20220719-youtube-640x360--bed5HTrGn4.webm- Odd that the video quality is so low- Fluttershy (voice actress, not AI) suggests that the viewer clicks here to watch another video, and also click here to subscribe to the YouTube channel>>40499969>https://gh.owo.si/ipfs/kubo/blob/master/docs/config.md#line_1441I guess I could enable the Accelerated DHT in one computer but not this other one.
>>40485144https://web.archive.org/web/20150618231111if_/https://www.wired.com/2015/02/fantastically-wrong-unicorn/>. . .>In the 7th century, the scholar Isidore of Seville chimed in, noting that the unicorn “is very strong and pierces anything it attacks. It fights with elephants and kills them by wounding them in the belly.” He also helped popularize the myth that would serve as a hallmark in European folklore for centuries to come: Catching a unicorn is impossible…unless you have access to a virgin woman. “The unicorn is too strong to be caught by hunters,” he writes, “except by a trick: If a virgin girl is placed in front of a unicorn and she bares her breast to it, all of its fierceness will cease and it will lay its head on her bosom, and thus quieted is easily caught.” It’ll suckle until it’s lulled to sleep.>. . .>Today, the unicorn is a decidedly more magical, gentle creature, running around on rainbows and inspiring millions with regular appearances in My Little Pony and the occasional acid trip and in North Korea, apparently. I’d recommend against heading over to Pyongyang to find one, though. Maybe just stick to the acid.
>>40500891Posted that image >>40485144 days ago, didn't know until today, in which I first read that article, that that unicorn wanted to suck on those virgin tits.Arousing artwork which shows a unicorn sucking on a human breast:https://twibooru.org/16561
>>40494876>What I think I will do in the longer term (1 week-few months or more) is seed at a highly reduced speed during the day and allow it more speed during the night.Why the day and night thing? Something to do with a metered connection? (If I didn't have to pay an additional $30/month for a non-metered connection, maybe I would pay for a fully qualified domain name clearweb site.)>>40499817Other small channel:>https://y.com.sb/channel/UChTJ94PEjj-OdAwhHKpSo_wlinked from npr>https://web.archive.org/web/20231104225626/https://y.com.sb/watch?v=kbc7IzgTvuUThat channel has picrel pfp but not a banner, may need to have logic to reflect that possibility >>40499969
>>40496350*where's the proof?>>40494876torsocks is pretty simple. Just run "torsocks [program_name_here] [...]" and it will use a Tor relay to anonymize your traffic, and you can also access onionsites from the command line (view a webpage in CLI-based lynx browser by running "torsocks curl -sL website.onion | lynx -stdin"). Some programs that I have seen torsocks work with: sftp, curl, wget, yt-dlp. I think it doesn't directly work with lynx ("torsocks lynx site.onion), and doesn't work with grab-site. Info:https://man.archlinux.org/man/torsocks.1.entorsocks is a nice way to torify a program. I wish Lokinet had a similar tool, so I could use a Lokinet exit node with just one program instead my entire Internet connection from one computer.>>40502275>Dave Rhodes channelHas one public topical video, which is in TPA, so I could skip thathttps://www.youtube.com/watch?v=MeJiuXM2Z_I
>>40494876Wikipedia says that Soulseek is "Proprietary freeware". So if the maintainer(s) of the code/software disappear, then everyone ends up screwed? Is it like Napster where it was P2P but only through that website's index or the website itself (so easily shut down)? Somewhat:https://wikiless.tiekoetter.com/wiki/Soulseek> Soulseek depends on a pair of central servers. One server supports the original client and network Version 156, with the other supporting the newer network (functioning with clients 157 and Qt).[8] While these central servers are key to coordinating searches and hosting chat rooms, they do not actually play a part in the transfer of files between users, which takes place directly between the users concerned. (See Single Source Downloads below).So if those servers disappear then the search index and the chat rooms also basically disappear.>>40501428https://web.archive.org/web/20231104215752/https://twibooru.org/16561>>40502404*and it doesn't work with grab-site*just one program instead of
>>40499922>>40499969> BatsyInteresting pony videos from that channel. Deleted video in here:https://y.com.sb/playlist?list=PLks3hIxmDJaH3v5SmaC5mofWd3T7eHpHC>Potential issueWas not an issue in this case. I checked a log and the reason that two videos were not downloaded is because they are in TPA.>>40502482From my research, besides a chat room, Napster and Soulseek are essentially the same (btw, both don't support swarming and only do/did one-to-one transfers). Other differences... Napster: US-based, more of a general music focus, funding=idk; Soulseek: France-based (I think), more of a niche music focus, funding=donations. Both Napster and Soulseek don't work without a proprietary centralized server:>In 2003 the artist Sapphirecut contacted Soulseek in an effort to stop the group's music from being shared amongst users; when Soulseek's server host Verio became aware of the situation, they dropped the network and it was unavailable for weeks.So this P2P is only possible so long as the centralized closed-source Soulseek headquarters is around. It is, so to speak, like one half website and one half peer-to-peer, and the latter cannot exist without the former.I asked "How is Soulseek different from Napster?" here https://chat-gpt.org/chat and the information it gave me was mostly crap. Sorta accidentally uploaded a record of that response here:https://files.catbox.moe/gpreo1.pngpic unrelated
>>40502963>delete videoThis one, not in TPA:https://y.com.sb/watch?v=NZ_y7_vyB54&list=PLks3hIxmDJaH3v5SmaC5mofWd3T7eHpHC&index=0>This video is no longer available due to a copyright claim by Crystal PayneNo video file:https://web.archive.org/web/20220706160323/https://www.youtube.com/watch?v=NZ_y7_vyB54>swarmingIf you are wondering what I meant, if you download from multiple peers at the same time for the same file, then your P2P thing supports swarming.>NapsterCan read about it here - https://wikiless.northboot.xyz/wiki/Napster - they lost multiple lawsuits for some reason like "[indirectly] facilitating copyright infringement". Makes me wonder, torrenting websites can operate freely in the US (as long as they don't actually host the non-free-license data like movies and TV shows), so how is that possible given the previous rulings with Napster? Maybe because they couldn't control all the torrenting sites around the world, different from just one thing in one country where they have jurisdiction.>https://files.catbox.moe/gpreo1.pngAttached
>>40499873>>40499922>>40499969>>40499979For other channel related metadata, these may interest you:https://developers.google.com/youtube/v3/docs/channelshttps://developers.google.com/youtube/v3/docs/channelSections
Selenium installation and usage info that's not jeetware/Java, video starts at 3:30:https://www.youtube.com/watch?v=Xjv1sY630Uc&list=PLzMcBGfZo4-n40rB1XaJ0ak1bemvlqumQ&index=0>>40502963>>40503040>delete video https://www.youtube.com/watch?v=NZ_y7_vyB54This was "Now This Is Beautiful [/mlp/ The Antithology 2.0 submission]". Attached = thumbnail of that video fromhttps://web.archive.org/web/20220706160333if_/https://i.ytimg.com/vi/NZ_y7_vyB54/maxresdefault.jpg>>40503790Okay, I will understand that once I get to that stage.
I wonder if this image (attached) is inspired by that one animu meme:https://web.archive.org/web/20231103094736/https://twibooru.org/3077100>>40504187*deleted videoFound 11-second video!> https://pony.tube/w/424cb6cd-52df-4203-b222-43eae5efb86d>> https://docs.google.com/document/d/1nG1ITnYOMEfbVBeuI_igj6ggq0G-VLQXDQilcEf8NbM>>> https://u.smutty.horse/mheyjfutvrr.mp4
>>40482043"Shitpost" roundup:https://archive.org/details/mlp-futa-2https://archive.org/details/mlp-futtahttps://archive.org/details/mlp_20231105https://archive.org/details/large_202311https://archive.org/details/large-5https://archive.org/details/2822360= very recent fromhttps://archive.org/details/@shiki_neko>>40497569WBM copy:https://archive.org/download//youtube-7Pq6ZIOhTg0
>>40499817Downloading it via improved one-liner:>$ yt-dlp -j --flat-playlist UUPVC4l1-uQd4vz1MmX4yH0g > 1plist1.json 2>1error1.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); mkdir $fdir; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.txt .; utc > 1stats1.txt; chan=$(pwd | grep -o "........................$"); chanp=$(curl -sL "https://web.archive.org/web/2/https://y.com.sb/channel/$chan" | grep '<meta property="og:image" content="' | sed "s/\">$//g" | sed "s/.*\".......................//g"); chand=$(echo $chanp | sed "s/=.*/=s0/g"); curl -sL $chanp > 1pfp1.jpg; curl -sL $chand > 1pfp2.png; banc=$(curl -sL https://web.archive.org/web/2/https://y.com.sb/channel/$chan | grep "w=w2560-fcrop64=" | sed "s/\" alt=.*//g" | sed "s/.*\".......................//g"); band=$(echo $banc | sed "s/=.*/=w0/g"); curl -sL $banc > 1banner1.jpg; curl -sL $band > 1banner2.png; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc >> 1stats1.txt; if [ ! -s 1error1.txt ]; then rm 1error1.txt; fi; if [ ! -s 1logy12.txt ]; then rm 1logy12.txt; fi; if [ ! -s 1logy22.txt ]; then rm 1logy22.txt; fi; cd ..+ hacky method to get channel banner images- todo: >>40503790, update modeImage from>http://10.0.0.232/z8/video/7572657/c2/KittyCatYugi_UCPVC4l1-uQd4vz1MmX4yH0g/Kodocha_Pony_4-KittyCatYugi-20121213-youtube-640x480-NxEuIhYfz6g.png
2 deleted mega.nz links; I think I have those files:https://desuarchive.org/mlp/thread/39270745/#39326720>>40494209> --warc-max-size=1000000000This is more of a soft limit, looks like wget doesn't split files across .warc.gz files. So Gzip-compressed WARC files can range from about 954M to 1.3G.
Didn't see https://pony.myponyasia.com/inhttps://robotizing.net/ipfs/bafkreic6ingxxyqelvin52ubb5cscbzhloez6chody2vbe5dtdkbvdzye4?filename=websites_in_iwiftp_gdrive.txt
SEC torrents:https://desuarchive.org/mlp/thread/38972725/#38994549
Deleted, not in TPA, loginwalled in IAhttps://web.archive.org/web/20111218033303/http://www.youtube.com/watch?v=9GtPSJVo5E8
>>40506870In this iwiftp folder for now:https://dweb.link/ipfs/QmatVNwHVyGhF9WroZMDxGJowEK51RoUzXg2bwTR4sdWiE
2017 video not in TPA - "Lucky Star Opening (MLP Version)":https://www.youtube.com/watch?v=WjX_X7AhkVU
>>40504196This meme (picrel):https://gelbooru.com/index.php?page=post&s=list&tags=jokanhiyouMaybe it isn't based on that, just looks similar.
Some "significant" pony videos with music from the 2010s are linked in this thread:https://boards.4chan nel.org/wsg/thread/5286058/2010s-nostalgia>>>/wsg/5286058^ Love that sexy sassy Rarity:https://tpa.mares.workers.dev/?output=html&id=7LE6DJj0ngU
>>40504408> https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$argsWas looking over this - https://developers.google.com/youtube/v3/docs/videos - and saw the following. Doesn't get or doesn't matter:> kind>> string>>> Identifies the API resource's type. The value will be youtube#video.> etag>> etag>>> The Etag of this resource.> fileDetails>> object>>> The fileDetails object encapsulates information about the video file that was uploaded to YouTube, including the file's resolution, duration, audio and video codecs, stream bitrates, and more. This data can only be retrieved by the video owner.> processingDetails>> [another video owner only thing]> suggestions>> [same]Some subparts:snippet.* contentDetails.* statistics.*player.* topicDetails.* recordingDetails.*liveStreamingDetails.* localizations.*Image fromhttp://mlpfactfile.blogspot.com/search/label/Unicorns
>>40443773>EnumclawThat was whorse central.https://wikiless.esmailelbob.xyz/wiki/Zoophilia>Until 2005, there was a farm near Enumclaw, Washington that was described as an "animal brothel", where people paid to have sex with animals. After an incident on 2 July 2005, when a man was pronounced dead in the emergency room of the Enumclaw community hospital after his colon ruptured due to having had anal sex with a horse, the farm garnered police attention. The state legislature of the State of Washington, which had been one of the few states in the United States without a law against bestiality, within six months passed a bill making bestiality illegal.>>40503790I looked over https://developers.google.com/youtube/v3/docs/channels in lynx browser. Findings:>kind,etagSkip for now>auditDetailsCannot get, need another token>id,snippet,contentDetails,statistics,topicDetails,status,brandingSettings,localizationsCan and will get>contentOwnerDetails = [object which] encapsulates channel data that is visible only to the YouTube Partner that has linked the channel to their Content Manager.Don't think I can get this.
>>40504874I can check on this, but first >>40475049 ("ipfs repo ls") going to do some things like listing out all the blocks in a repo. I'm listing out all of the blocks in a roughly 700G repo, and the output is streamed; in the case, more lines get added to the output text file every ~3 seconds. Will see how long this task takes (doing it for reasons).
>>40504874That's that "*Ponycide*" album. CAR files: exported all three, yet to share.>>40509833Listed about 2.5 million blocks after ~30 minutes then got the following error. A folder in this NTFS HDD has a previously-described error because NTFS sucks.>blockstore \t blockstore/blockstore.go:291 \t blockstore.AllKeysChan got err: walk failed: readdirent /mnt/My_Passport/b/ipfs/.ipfs/blocks/LI: input/output errorOther method: list blocks from recorded CIDs which were pinned. Captcha: RAWJ0R
>>40510341Looks like 0x0.st does not allow .car files to be uploaded.
https://web.archive.org/save/https://rule34.xxx/index.php?page=post&s=view&id=6825429>Sorry>This host has been already captured 5,002.0 times today. Please try again tomorrow. Please email us at "info@archive.org" if you would like to discuss this more.Test for downloading agewalled and loginwalled videos:https://www.youtube.com/watch?v=WvshTi5eTYshttps://www.youtube.com/watch?v=vHKUx_9sreQReading older threads - https://desuarchive.org/mlp/thread/2911951/OP:>sex with horses is legal in most states>i started fucking my new shetland pony and it felt great>then she started crying>i felt so bad>I almost didn't cum on her face
>>40499969Actual text:https://x0.at/G3aW.txt
>>40481614
>>previous postPretty sure I found that image (not tagged as "futa"):https://twibooru.org/125005?q=derpibooru_id:149814Also, I think this is part of another significant memory:https://twibooru.org/195969?q=derpibooru_id:241777
/pag/ - Pony Archival General #1 was posted almost exactly one year ago today:Anonymous Sun 06 Nov 2022 >>39270745https://desuarchive.org/mlp/thread/39270745/Image fromhttps://web.archive.org/web/20190820163015/https://www.al.com/news/2019/08/yes-a-miniature-horse-can-be-a-service-animal-in-alabama.html
>>40510341>>40510673>>40504874>Anonymous Mon 21 Nov 2022 00:16:35 No.>>39326720>HD FLAC: >https://mega.nz/folder/OpwgSIZQ#yQAR8ja67ElYKskBAmFQTQDead>15 files dl'd to folder "OpwgSIZQ_yQAR8ja67ElYKskBAmFQTQ" - hashes to:>ipfs://Qmf6376cQQMZNaHqCsDQNfzrjrdbNb7WttHu1Ux4J5FbEE>FLAC: >https://mega.nz/file/n8BX3AZT#3pc38csVUsmfrfDF-iXAXRBJHOmhaAUquobMBaFon1AStill alive>1 file, "TarbyRocks & Narokath - Forever Broken- The Continuing Tale Of Pinkie Pie & Ponycide (16-bit).zip", =>ipfs://QmSRkSqysGEYA38vkDLVZfeHPjW1PVgDrsycZv5tuT7Mw3>MP3: >https://mega.nz/folder/XwoQDIJR#FER9lQE_8-umvAR4lm8mMADead>15 files dl'd to a folder which hashes to:>ipfs://QmfXweAyCTtsga2osHmsDcN5EZKo2CvnQGz7ZCCXTGMJ41That mega.nz data has been outlived by IPFS. I have all of those CIDs offline, hope to upload it somewhere else later.
Websites becoming worse:- Google, going to delete content from inactive accounts, effective 2023-12- Discord, going to break image file links, effective sometime, maybe by the end of 2023- DeviantArt, already did or going to delete artwork depicting certain sexual situations- mega.nz, updated TOS, didn't see details in this link, hopefully it isn't a problemhttps://blog.mega.io/updates-to-megas-terms-of-service-and-privacy-and-data-policy/
shitty image formats, degenerate formats, image degradationhttps://desuarchive.org/mlp/thread/39372926/#39432867https://wikiless.funami.tech/wiki/I_Am_Sitting_in_a_RoomInhttps://desuarchive.org/mlp/thread/40429708/#40429961> If an anon saves a posted image and didn't append the [?randomtext] qualifier at the end of the URL, and then posts what they saved later, then yes, that image will be a compressed version of the original. Then if another anon does the same thing to that image, it'll again be compressed, ad infinitum.> It's lame as hell and honestly, I dont even know for how long its been going on. But a significant amount of time for sure.So, continual recompression of images is lame. Same thing happens if a video is reuploaded to YouTube, downloaded, reupload the reupload, download that, reupload the reupload of the reupload, etc. Eventual data becomes a faint echo of the original with the current incarnation, becoming worse the more it is a copy of a copy of a copy. The sane solution is to have no-derive files, that way no matter how many times it is copied it will always be bit-identical to the original (no compression added). IA does this with video files and images. "Lossless compression" is an oxymoron.
Idea - if a URL was seen as saved in WBM then later when you check on that snapshot and it is seen as not saved: check its CDX info.>>40513983That video is maybe misrepresenting the situation. I think this is the original video - "Generation Loss: JPEG, WebP, JPEG XL, AVIF":https://www.youtube.com/watch?v=FtSWpw7zNkI
>>40513983>>40514112Original video - "Generation Loss – JPEG, WebP, JPEG XL, AVIF" (JXL=JPEG XL):https://www.youtube.com/watch?v=w7UDJUCMTngFormats used in social media, YouTube, various websites. These formats definitely degrade as a result of repeated recompression (from resharing/reprocessing):- JPEG, WebP- WebM, MP4, AAC, MP3Maybe degrades from that:- OGG- PNG, GIFIn any case, the file getting a unique hash each time is a form of degradation. Image from>https://web.archive.org/web/*/https://desu-usergeneratedcontent.xyz/mlp/thumb/1419/73/1419738025007s.jpg>It said "Saved 69 times between September 18, 2018 and ..." a little while ago.
Every single instance here says "Could not get channel info."https://redirect.invidious.io/channel/UCS-oI85IpE6_nj-yeOxEoJAMaybe this is an effect of YouTube blocking ad blockers. The following makes a suggestion which didn't work.>https://yt.drgnz.club/channel/UCS-oI85IpE6_nj-yeOxEoJA>If you see "cannot load channel info" error message, try refreshing the page a few times.Why is YouTube fighting against ad blockers? Probably because the "free but with ads" part of the Internet is dying.
>>40504196>https://pony.tube/w/424cb6cd-52df-4203-b222-43eae5efb86d <- picrel from hereThat's "/mlp/: The Antithology 2022". I feel like the 2021 one was better. A criticism of the 2022 one: in the "Pegasus race"/"Little Dark Age" part, instead of dedicating itself to parody, it becomes satire. It does an ironic "subvert your expectations" thing. I think it maybe would have been cool if it just stuck the parody and took its time. Perhaps it's a silly idea, but that's what a significant amount of the whole thing is. Maybe other things in the overall video could be cut to make room. Fast pace and subversion from that was disappointing to me, but I suppose it fits the theme or overarching idea.>>405139834chan might be using "Cloudflare Polish" to "optimize" images: https://developers.cloudflare com/images/polish/. When an already CF-"optimized" image gets posted and "polished" again: a polished turd is still a turd.
>>40515955Like a lyric of that song itself: "The humor's not the same, coming from denial."Banner image from> https://boards.4channel org/mlp/thread/40422488>> image linking to https://hakurei cdnbo org<slash>gate<question_mark>r=BbmKKc3h6s&d=27<ampersand>dest<equals_sign>www.fimfiction.net>>> redirect to https://www.fimfiction.net/story/537057/twilights-felquines-of-xenon
>>40480059> qbittorrent-4.6.0_x86_64.AppImageSeems like qBittorrent before v4.5.5 was better. Sometimes or in some cases, this v4.6.0 AppImage dies after 4 to 6 hours of running.>>40515955> /mlp/: The Antithology 20221080p version is about 3G, so over wbm's 2G limit.>>40516015> fic19 dislikes, 3 likes
>>40513346Uploading folder "add":>./add/Music/Fan-made/Various artists/TarbyRocks & Narokath - Forever Broken- The Continuing Tale Of Pinkie Pie & Ponycide/->>remote:upload/mlp/- todo: on larger files, got HTTP 413- readme: https://fleek.cool/ipfs/bafybeihpwqamiapu64pvjf4gbaqjbfwhxjbn4vjdwvvxyjmzl5qiu3qdpa
>>40515955Or, ignore that criticism. Maybe that video has the right amount of serious/non-serious and focus/non-focus.>>40516239>https://wiki.slipfox.xyz/wiki/HTTP_413rclone/webdav limit is like 100 MiB per file max. I suspect that on the server side (not my side) those limits can be changed.
>>40443773>>40509128>>40450381If Mr. Hands instead had sex with a stallion pony (smaller than a horse), perhaps his ass would not have been destroyed.>>40516239>todo: on larger files, got HTTP 413Done. Also, gotta remember that "&" in filenames sometimes creates other difficulties. I was trying to keep is as true to the source as possible.
>>40516239"*Ponycide/" contains:- ./mp3/- ./flac/- ./hd_flac/- ./*.txtThe text file is this - https://ipfs.fleek.co/ipfs/bafkreigfgalmnwchnto3ck2m5skmpaqpsje6ndrznj5xae2d5nzgs75rsm - which presents the information nicely. Minor problem: multiple consecutive spaces. Even more minor problem: could have had more information.>>40516549Image
>>40517568
>>40503790>>40509128Was looking over https://developers.google.com/youtube/v3/docs/channelSections - info:>kind,etagSkipping for now>id,snippet,contentDetailsCan and will get. Hope to save playlist JSONs from channels.>>40516040Instead of running on external storage, maybe that appimage will run better from somewhere under "$HOME/". I know some versions of Tor Browser work better when the program is stored somewhere in $HOME.
Channel name seen as changed: "Travis Bico", "Spitfire">https://web.archive.org/web/20220917134136/https://y.com.sb/watch?v=Yi5xC-p6Ls4>https://web.archive.org/web/20231105222221/https://y.com.sb/channel/UC_4ugbjEbV9_3LSJc2H_gUQ
>>40519007Downloaded that small channel; improved one-liner:>$ yt-dlp -j --flat-playlist UU_4ugbjEbV9_3LSJc2H_gUQ > 1plist1.json 2>1error1.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); mkdir $fdir; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.txt .; utc > 1stats1.txt; chan=$(pwd | grep -o "........................$"); curl -sL "https://www.googleapis.com/youtube/v3/channels?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails,statistics,topicDetails,status,brandingSettings,localizations&id=$chan" > 1chan1.json; chanp=$(jq ".items[].snippet.thumbnails.high.url" 1chan1.json | tr -d \"); chand=$(echo $chanp | sed "s/=.*/=s0/g"); curl -sL $chanp > 1pfp1.jpg; curl -sL $chand > 1pfp2.png; banc=$(curl -sL https://web.archive.org/web/2/https://y.com.sb/channel/$chan | grep "w=w2560-fcrop64=" | sed "s/\" alt=.*//g" | sed "s/.*\".......................//g"); band=$(echo $banc | sed "s/=.*/=w0/g"); curl -sL $banc > 1banner1.jpg; curl -sL $band > 1banner2.png; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc >> 1stats1.txt; if [ ! -s 1error1.txt ]; then rm 1error1.txt; fi; if [ ! -s 1logy12.txt ]; then rm 1logy12.txt; fi; if [ ! -s 1logy22.txt ]; then rm 1logy22.txt; fi; cd ..- gets some channel metadata- gets channel pfp from api and not wbm- todo: stuff+delete channel banner images if empty
>>40519154So that channel has a PMV of "Fortunate Son". I thought one of the comments on that video was something like "This shows many of the cool action sequences of FIM." Guess I was thinking of a different PMV.That image is from>http://10.0.0.232/z8/video/7572657/c2/Spitfire_UC_4ugbjEbV9_3LSJc2H_gUQ/PMV_Changeling_War-Spitfire-20201026-youtube-1920x1080-MV2piW9b7M0.pngThis image is based on that one 7chan image, I think.
>>40447096>>40519154Downloading this channel: xPinkyRoses. This:>$ jq ".items[].brandingSettings.image.bannerExternalUrl 1chan1.json"Seems to show the source image used for the channel banner, but the JSON does not detail the cropped/moved one seen on the channel page. https://archive.is/Kqv76Image>http://10.0.0.232/z8/video/7572657/c2/xPinkyRoses_UCSVppJzvS3Y0abdRhG1XQlg/PMV_M_I_N_SH-xPinkyRoses-20131225-youtube-1280x720-bWKN5H6H01U.png
>>40519279>".items[].brandingSettings.image.bannerExternalUrl"channels API gives me a crappy lowres channel banner. Sticking to:>w=w2560-fcrop64=which should be this instead:>=w2560-fcrop64=Image>./xPinkyRoses_UCSVppJzvS3Y0abdRhG1XQlg/PMV_Gee-xPinkyRoses-20131021-youtube-1280x720-eAjZBYTn3Gg.png
>>40472248>>40519726Dl'ing by better one-liner:>$ yt-dlp -j --flat-playlist UUdd7j6whCEP25q8yPvpNsqw > 1plist1.json 2>1error1.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); if [ -f $fdir ]; then sleep 9d; else mkdir $fdir; fi; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.txt .; utc > 1stats1.txt; chan=$(pwd | grep -o "........................$"); curl -sL "https://www.googleapis.com/youtube/v3/channels?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails,statistics,topicDetails,status,brandingSettings,localizations&id=$chan" > 1chan1.json; chanp=$(jq ".items[].snippet.thumbnails.high.url" 1chan1.json | tr -d \"); chand=$(echo $chanp | sed "s/=.*/=s0/g"); curl -sL $chanp > 1pfp1.jpg; curl -sL $chand > 1pfp2.png; banc=$(curl -sL https://web.archive.org/web/2/https://y.com.sb/channel/$chan | grep "=w2560-fcrop64=" | sed "s/\" alt=.*//g" | sed "s/.*\".......................//g"); band=$(echo $banc | sed "s/=.*/=w0/g"); curl -sL $banc > 1banner1.jpg; curl -sL $band > 1banner2.png; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.txt 2>1logy12.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.txt 2>1logy22.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.txt; done' _; utc >> 1stats1.txt; if [ ! -s 1error1.txt ]; then rm 1error1.txt; fi; if [ ! -s 1logy12.txt ]; then rm 1logy12.txt; fi; if [ ! -s 1logy22.txt ]; then rm 1logy22.txt; fi; if [ ! -s 1banner1.jpg ]; then rm 1banner1.jpg; fi; if [ ! -s 1banner2.png ]; then rm 1banner2.png; fi; cd ..* better channel banner get+ delete banner files if empty+ sleep 9 days if folder exists
>>40520018>imageFrom http://10.0.0.232/z8/video/7572657/c2/Makaryo_UCdd7j6whCEP25q8yPvpNsqw/SWEETIE_BOT_SINGS_HELLO_WORLD-Makaryo-20230311-youtube-1920x1080-stYBPhSMp94.png>better channel banner get$banc should have a thing to do this at the end: s/".*//g>sleep 9 days if folder existsTo prevent mistakes, like one that I just sorta did, since this is not an updater.Image from>./Makaryo_UCdd7j6whCEP25q8yPvpNsqw/BACKROOMS_but_it_s_MLP-Makaryo-20221105-youtube-1920x1080-zUL00OpNr3c.png
Been looking for a copy of this for a while, but during the Anni Stream there was a Luna TTS version of the Moon Man Pulse Rap. I've been trying to archive every Moon Man song I can and unfortunately this one got removed from yt before I could download it.
>>40520305Link to video or channel?
>>40520379https://www.youtube.com/watch?v=rWJumufS7MAhere was the link
>>40519279>http://10.0.0.232/z8/video/7572657/c2/xPinkyRoses_UCSVppJzvS3Y0abdRhG1XQlg/PMV_What_s_Twilights_age_again-xPinkyRoses-20130419-youtube-1280x720-nWgK_0WRo90.mp4>https://www.youtube.com/watch?v=nWgK_0WRo90Nice.>>40520018>http://10.0.0.232/z8/video/7572657/c2/Makaryo_UCdd7j6whCEP25q8yPvpNsqw/CMC_SINGS_CHUG_JUG_WITH_YOU_l_MLP_Parody_Animation-Makaryo-20230205-youtube-1920x1080-uIsehleSRvs.webm>https://www.youtube.com/watch?v=uIsehleSRvsLit.>>40520305>I've been trying to archive every Moon Man songBased.
Omegle, which started in 2009, has just recently shut down. Why? Due to the pernicious weed of Internet laws (too many, too extreme). https://www.omegle.com/>>40520018Deleting empty log files could be simplified, something like:$ find . -type -name '*.log.txt' -empty -deletehttps://www.man7.org/linux/man-pages/man1/find.1p.html>>40520529Linked from? Any other metadata like title or uploader (more likely that you have the title than uploader name/id)? Based on what you posted, thinking it was uploaded/shared in 2023. I could look for an archive of the thumbnail. Video title could also be helpful. I now have ~2 YT URLs to search in Twitter if I ever remember/reset my password. (I or someone else might have this video, but probably not.)
>>40520719>-typeMeant to post:>-type fNothing here:>https://filmot.com/api/getvideos?key=md5paNgdbaeudounjp39&id=rWJumufS7MA>https://desuarchive.org/_/search/text/rWJumufS7MA>https://tpa.mares.workers.dev/?output=html&id=rWJumufS7MA>https://archive.li/https://www.youtube.com/watch?v=rWJumufS7MA*>https://hobune.stream/videos/rWJumufS7MA>wbm>"rWJumufS7MA" in !b !ddg !brave !g>[didn't check this other thing]
>>40520766Idk what thie video is but I have it archived, I'll have to check tomorrow
>>40520719The title of the video was "Moonmare", I only know that because I bookmarked the original link, so my bookmark had a populated title field. I don't recall who made it, but I do recall the video being unlisted from search results. Honestly the worst of it was that it couldn't of been up for that long as less than a day after I saw it on the Anni Stream, it was removed.
>>40520917Also, not sure if it helps, but it was definitely played right after the first eps of season 1 at the beginning of the stream.
Been using GNU/Linux for about 10 years now. I have come to an understanding that it seems like Linux is the problem when it comes to this one thing. Thinking of using FreeBSD instead (flash drive dual boot with Mint or something), so maybe that will be the solution. FreeBSD - use geom instead of lsblk; has curl, wget, lynx, rsync, torsocks, ssh, sshfs; uses ZFS by default; supports kubo ipfs:>https://man.freebsd.org/cgi/man.cgi?query=lynx>https://man.freebsd.org/cgi/man.cgi?query=rsync&manpath=FreeBSD+13.2-RELEASE+and+Ports>https://man.freebsd.org/cgi/man.cgi?query=geom>etc.>>40520597Based on this comic:https://nitter.x86-64-unknown-linux-gnu.zip/punkittdev/status/1616605239028899841
2012 video not in TPA - "Spike PMV: What's my age again?":https://www.youtube.com/watch?v=KxygQiaKJi82019 video not in TPA - "What's My Age Again?":https://www.youtube.com/watch?v=PRujv7ccEsE>Song by Blink-182>I turn 23 today. >Yikes.
>>40508496Download warc of these niggers, level 1 recursion:- read only https://boards.4chan nel.org/wsg/thread/5286058/2010s-nostalgia- full images=404s https://desuarchive.org/wsg/thread/5286058/>>40521658From possibly hijacked channel, to download:https://www.youtube.com/channel/UCpITEtVHBK0Pm0p93x7KJQw>>40521170Thumbnail image>./Makaryo_UCdd7j6whCEP25q8yPvpNsqw/CMC_SINGS_CHUG_JUG_WITH_YOU_l_MLP_Parody_Animation-Makaryo-20230205-youtube-1920x1080-uIsehleSRvs.png
todo: get YT channel banner from youtube.com, Invidious, or some other api; soon get missed imageboard files (not /wsg/)>>40520719Simplification=done:>$ find . -type -name '*.log.txt' -empty -delete>$ find . -type -name '*.img.png' -empty -delete>$ find . -type -name '*.img.jpg' -empty -delete'*.log.txt' only matches /[any bytes].log.txt$/.>>40521727>grab thread #5286058Finished quickly (grab-site --level=1 ...)>dl YT channel MANESHARKDone>>40477721"$HOME/.vagrant.d/" can be pretty big. Hope I can change the default location for that folder.Image from>http://10.0.0.232/z8/video/7572657/c2/MANESHARK_UCpITEtVHBK0Pm0p93x7KJQw/MLP_FIM_Monster_pmv_Twilightsparkle_Fluttershy_Spike_Nightmaremoon-MANESHARK-20120429-youtube-854x480-yFInLj1FaO0.png
>>40521658>www.youtube.com/watch?v=PRujv7ccEsEChannel that uploaded that has like 667 videos total. Not sure that I want to download the entire channel.>>40521790Typo again: "-type" -> "-type f"Image>./MANESHARK_UCpITEtVHBK0Pm0p93x7KJQw/MY_little_Pony_FIM_Halloween_PMV-MANESHARK-20120506-youtube-1920x1080-m8Mt_UdCInU.png
There's been some rumors tumblr may be shutting down. Not sure if this was already known here but figured I'd make a post anyways.
>>40453362https://quetre.catsarch.com/Has-anyone-ever-gotten-away-with-murdering-a-cophttps://quetre.catsarch.com/Is-it-true-that-all-the-My-Little-Pony-characters-are-LGBT-colours>Well some of them do, and many of them don’t like for instance Twilight is the colors of the bisexual flag, and Rainbow dash is the color of the gay flag, and Pinkie pie is the colors of the pan sexual flag, and Fluttershy being the colors of the pan gender flag, and spike is the colors of the Genderqueer flag. Applejack isn’t really any pride flagApplejack: "It ain’t natural.">>40521836Check the vital signs. (How does ArchiveTeam do that?)
>>40514112I know that this was captured in the past:>https://web.archive.org/web/20231109204826/https://y.com.sb/playlist?list=UUrh6he76X9ac2xnI0ptRKQg&page=2But now that shows up as having never been saved; same story here (currently empty page below):>https://web.archive.org/web/timemap/cdx?url=https://y.com.sb/playlist?list=UUrh6he76X9ac2xnI0ptRKQg%26page=2- WBM does not make any open-access cryptographic proofs of snapshots (like a hash tree of the content)- archive.ph captures seem to "stick" more frequently
https://bronyru.info/ appears to be down again. Last time was some "hackers". I don't know about this time.>>40521836Links to rumors?
>>40477721"Full" image from>https://web.archive.org/web/20231110132530/https://y.com.sb/post/UgkxZrgd-NZX2dK_ZLHMFTzhoOL6xqR0TD3l?ucid=UCHGQPBG_Q0cDqwlIJ9HdKLgattached>>40522071Funny, I checked that site a few hours ago today. It also looked down: CF-walled + HTTP 500.
>>40521864Quetre is inconsistent because I think it can only show a certain amount of "viewable answers" out of the total answers due to rate limiting:>https://web.archive.org/web/20231110123016/https://quetre.catsarch.com/Is-it-true-that-all-the-My-Little-Pony-characters-are-LGBT-colours>Daring Do is the straight flag (her hair/tail is black, grey, and white).>Zecora is also the straight flag (she is a zebra, zebras are usually black and white).(I never heard about this "straight flag" before.) Live version that I saw (not in that wbm snapshot): some answer which said something like "appropriating all of the visual spectrum.">https://web.archive.org/web/20231110123731/https://quetre.catsarch.com/Has-anyone-ever-gotten-away-with-murdering-a-cop>Happy endings do twinkle in the dark sky once in a blue moon. This isn’t counting all those who waited until the pig is no longer a cop before doing him in.Live version that I saw (not in that WBM snapshot): something about shooting a guy 7 times in the chest.For the below link: pfp=pony? Thinking no, but I'm not sure.https://web.archive.org/web/20231110131912/https://y.com.sb/channel/UCPd-mq3gqNBVnaCy5BCPviw
2014 video not in TPA - "Ciphershy [PMV]" (pony instrumentation mix):https://y.com.sb/watch?v=w3z6b-vpuqEFirst time watching S7E4 of FIM was today>https://pony.tube/w/nMmQPvhAVRg3Mk6YuPp5xrLikable, funny episode.>>40518947>put qBittorrent appimage in $HOMEDon't think this helped, based on what I observed.>>40515955>/mlp/: The Antithology 2022Incl. a track from "Learning to Crawl" by The Pretenders; that album:>magnet:?xt=urn:btih:12406618d8c96ff359de10a3b2dbcd180f956758-> local backup via "ipfs add -rHw 'The Pretenders - Learning To Crawl [ChattChitto RG]'" ->>ipfs://QmTeeKCjjRKpAPXEPnBf7sC7dFJEAnFYTaQVYWgmmvYxkr
>>40522568Downloading that channel. WBM blocks me so often that vid/yt personally has better uptime. Fuck waiting to get it on your own, Google gonna give it to ya:>$ curl -sL https://x0.at/Ygpt.txt>chan=$(pwd | grep -o "........................$"); banc=$(curl -sL https://y.com.sb/channel/$chan | grep "=w2560-fcrop64=" | sed "s/\" alt=.*//g" | sed "s/.*\".ggpht/https:\/\/yt3.googleusercontent.com/g"); band=$(echo $banc | sed "s/=.*/=w0/g"); curl -sL $banc > 1banner1.img.jpg; curl -sL $band > 1banner2.img.png(patch for channel banner get: no longer relying on wbm)Image from>http://10.0.0.232/z8/video/7572657/c2/Roosevelt_Gunadi_UCz4WoVtgc1Ejs-aTfVggYEA/1banner2.img.png
>>40522643>./Roosevelt_Gunadi_UCz4WoVtgc1Ejs-aTfVggYEA/Waving_Flag_PMV-Roosevelt_Gunadi-20130612-youtube-540x360-pgXQ3NdFiBk.webm>https://www.youtube.com/watch?v=pgXQ3NdFiBk"When I get older, I will be stronger. They'll call be freedom, just like a waving flag!"
in regards to https://desuarchive.org/mlp/thread/40152126/#40210184https://files.catbox.moe/v6t2m3.swfhttps://files.catbox.moe/7mang5.flahttps://files.catbox.moe/3ebmse.swfhttps://files.catbox.moe/xe7iaw.flahttps://files.catbox.moe/ylzj0y.swfhttps://files.catbox.moe/hkiiey.flahttps://files.catbox.moe/iquhoo.swfhttps://files.catbox.moe/gqpx0v.fla
Todo:- slash tabs of a wbm-excluded booru, get local warc copies- something something cookies.txt >>40511453- download older websites: hint=Cherry Berry (IIRC)- download small channels ofhttps://y.com.sb/redirect?referer=/watch?v=nhnGCMDj9-shttps://y.com.sb/redirect?referer=/watch?v=dK6w4VBQvNw>>40521790>get missed (probably npr) imageboard filesFailed: too slow, didn't try hard enough
>>40522071Seem to be moving all production staff to other projects. This is the original I saw. Rather than closing down it appears to be in maintenance only mode but still not a good sign in the longer term.https://www.threads.net/@waxpancake/post/CzbS-cVuGgn
Another one bites the dust.https://www.youtube.com/post/UgkxEQPzzuOIjSiV4KInANn3uiNUcxR2ND9zEverything is still up for now.
>>40522903Nice, I guess this has some files that I missed.
>>40523567Someone get whatever this doesn't get:>$ yt-dlp -j --flat-playlist UUemUN21RAWJJv1heOfZ5dog > 1plist1.json 2>1error1.log.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); if [ -f $fdir ]; then sleep 9d; else mkdir $fdir; fi; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.log.txt .; utc > 1stats1.txt; chan=$(pwd | grep -o "........................$"); curl -sL "https://www.googleapis.com/youtube/v3/channels?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails,statistics,topicDetails,status,brandingSettings,localizations&id=$chan" > 1chan1.json; chanp=$(jq ".items[].snippet.thumbnails.high.url" 1chan1.json | tr -d \"); chand=$(echo $chanp | sed "s/=.*/=s0/g"); curl -sL $chanp > 1pfp1.img.jpg; curl -sL $chand > 1pfp2.img.png; banc=$(curl -sL https://y.com.sb/channel/$chan | grep "=w2560-fcrop64=" | sed "s/\" alt=.*//g" | sed "s/.*\".ggpht/https:\/\/yt3.googleusercontent.com/g"); band=$(echo $banc | sed "s/=.*/=w0/g"); curl -sL $banc > 1banner1.img.jpg; curl -sL $band > 1banner2.img.png; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.log.txt 2>1logy12.log.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.log.txt 2>1logy22.log.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.log.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.log.txt; done' _; utc >> 1stats1.txt; find . -type f -name '*.log.txt' -empty -delete; find . -type f -name '*.img.jpg' -empty -delete; find . -type f -name '*.img.png' -empty -delete; cd ..Image>/z8/video/7572657/c2/NikoSourceDemon_UCemUN21RAWJJv1heOfZ5dog/MLP_SFM_-_DANCE_TILL_YOURE_DEAD-NikoSourceDemon-20220117-youtube-1920x1080-I8zrrMKzQkI.png
>>40523087> slash tabsDone> get local warc copiesDoing. Also todo: update yt-dlp>>40523650Some of the things it doesn't get- community posts- channel playlists- channel channels/subscribed-to
>>40523673>community postsCan’t get this. I was suggesting this before >>40453845>channel playlists>channel channels/subscribed-toYouTube API can get this. I’ll get them when I get back home.
>>40520766>>40520790https://hobune.stream/videos/rWJumufS7MA
>>40520719
>>40523673>>40523796Here you go: https://files.catbox.moe/hmwijl.zipAlso got the channel metadata and sections for you.
>>40523087> get local warc copiesDone. 10G, mostly npr> something something cookies.txt >>40511453https://gothub.projectsegfau.lt/rebane2001/sensible-yt-dlp-archive-scripts/blob/mane/scripts/linux-osx/yt-dlp.conf
>>40523567>>40524580FYI, there's multiple private videos in a playlist from that channel (last edit=3w ago):https://y.com.sb/playlist?list=PLaNInrIWB3aVbxSQmckCrUfVJD2Fv3kNk>>40523650That's somewhat beyond 8dot3; renames (could be applied after):> 1plist1.json > 1_playlist_all_videos_1.json> 1plist1.txt > 1_playlist_all_video_ids_1.txt> 1plist2.txt > 1_playlist_tpa_1.txt> 1plist3.txt > 1_playlist_not_in_tpa_1.txt> 1error1.txt > 1_ytdlp_error_1.log.txt> 1stats1.txt > 1_stats_1.txt> 1chan1.json > 1_channel_metadata_1.json> 1pfp1.img.jpg > 1_profile_picture_1.img.jpg> 1pfp2.img.png > 1_profile_picture_1.img.png> 1banner1.img.jpg > 1_banner_1.img.jpg> 1banner2.img.png > 1_banner_1.img.png> 1logy11.log.txt > 1_ytdlp_stdout1_1.log.txt> 1logy12.log.txt > 1_ytdlp_stderr1_1.log.txt> 1logy21.log.txt > 1_ytdlp_stdout2_1.log.txt> 1logy22.log.txt > 1_ytdlp_stderr2_1.log.txt
>>40525055>FYI, there's multiple private videos in a playlist from that channelYup I noticed that too. I don't know about those particular videos, but the couple of others I did find in TPA were older videos that have since been reuploaded as "remastered" versions. That's what could be happening.
>>40523567This guy also quit, seems unlikely that he would delete older videos:https://y.com.sb/channel/UCvCNHxwLZD8XvSFGADDwpGw/community>PieDislikerSwag>If I made a return on this channel, it wouldn't be a pony channel anymore. But I thought about making recording a couple "vlog" review style videos for stuff (cartoons, anime, tv shows, movies, video games). Be honest, would any of that interest you? It wouldn't be super high effort content (probably) but I think it'd be fun to reconnect with some people that watched this channel from back in the day. Thoughts?>1 year ago | [3 likes]>View 1 reply>>40464160>>40472398The site with reCaptcha shut this prompt down immediately ("sorry I cannot help with this request blah blah blah"). The site without any captcha was more permissive, but does have the same no-overly-explicit-requests limiter; paste title=actual filename from a site, not ML/AI-generated (was seemingly not easy to copy the text from that no-captcha website):https://pastelink.net/rt5qg9hl
>>40522052>https://web.archive.org/web/20231109204826/https://y.com.sb/playlist?list=UUrh6he76X9ac2xnI0ptRKQg&page=2Now shows up as having been saved at that timestamp, and ...cdx?url... has the info. Looks like wbm sometimes needs hours/days to register or index snapshots that were first made hours or days ago.>>40521170Might be a fuse/fuse3 problem.pfp from https://web.archive.org/web/20231111164149/https://y.com.sb/watch?v=xewQL6CkMWI (npr). captcha: HDDAHW
>>40494876>If I were to make page about MLP discs, I might just make it out of basic HTML and CSS and host it on something like Neocities.Something like that could be OK, but only the owner can interact with that webpage. My idea with >>40494354 >>40494328 was to use something that anyone can edit, so if some other user uses redump methods and gets the same hash for the disc, he can note that on that wiki article or page. (Could also post a screenshot/whatever in a thread or something, if he feels like sharing further proof.)
>>40521864The argument that Rainbow Dash references homosexuality (due to her colors, personality) is idiotic. That argument probably usually lacks the understanding that rainbow ponies have always been a thing. Was anyone saying that G1 or pre-2010 Rainbow Ponies = homosexuality? Nope.>>40514112>>40515022A comment on that video links to this YouTube channel which basically uses furry porn as a pfp, banner: >https://iv.melmac.space/channel/UCSi1EtSZwypbz2eMtsAeUzQ>https://iv.melmac.space/ggpht/ytc/APkrFKaVyhs9F-Cm3phGhzR61QHkx9SLRDQWc3O35DMS_Cs%3Ds0>https://iv.melmac.space/ggpht/WszAmCFG_da2jrSEUVZ6DnS4mBxvHEYLCvUY9e0VLRTfKwoKpWUM7fhz3XKkRPtU3lwfS70WBg%3Dw0
>>40523884Good work. I assume you got that ID from an anniversary stream when it was still live.
Current automatic AT project=Reddit:https://wiki.archiveteam.org/index.php/Current_Projects(Previous: Telegram)IA uses S3 as their core storage service:https://blog.archive.org/2023/11/02/in-memoriam-of-python-2/
>>40523884>>40527963Speaking of the anniversary stream, do you also archive pony videos from the weekly rewatch streams? They usually have some new pony videos in them.
>>40496350giphy.com. Ex:https://media3.giphy.com/media/Is2UtQqfUCObdSSg7P/giphy.gif>>40525472There's also Cleverbot, which is stills braindead. I guess it isn't an AI/ML/"ChatGPT" thing. For example, see the following (websites deepai and chat-gpt said the prompt was an "offensive" idea so they were limited in that way and returned basically nothing):https://www.cleverbot.com/conv/202311121350/AYAESYYVRU_If-Anders-Behring-Breivik-was-a-character-in-the-series-My-Little-Pony-Friendship-is-Magic-what-would-he-do-or-say
2015 video not in TPA - "[PMV] Wonderbolt (Sung with Rainbow Dash's voice)":https://y.com.sb/watch?v=kDPW8XlDveA>>40528855*still braindeadWonder if that ML implementation would have any problems if it was this prompt instead:>If Che Guevara was a character in the series "My Little Pony: Friendship is Magic", what would he do or say?Read/download:>https://radishmag.wordpress.com/2013/07/05/breiviks-norway/>https://archive.org/details/warc_radishmag_wordpress_com_20180130
>>40529011> kDPW8XlDveAIn a way, this was mentioned before, so here's one that wasn't...2012 video not in TPA - "Super Ponybeat - Luna (DREAM MODE) ru (pyccкиe cyбтитpы)":https://y.com.sb/watch?v=S3FizQiSTuc
Reading older threads - https://desuarchive.org/mlp/thread/24386344/> https://d.maxfile.ro/leewufoche.mp4> How did I do, /mlp/?https://web.archive.org/web/20160428011815if_/https://d.maxfile.ro/leewufoche.mp4>>40525055Could implement:https://overflow.adminforge.de/questions/5735666/placeholder>>40528855>>40529011Image: moronic back and forth that I had at chat-gpt.org - tried to get it to write part of a fanfic. Then I checked if Cleverbot improved at all since I first used it in ~2014; it did not.>>40529011>https://www.youtube.com/watch?v=kDPW8XlDveAFrom a small channel. Others: >>40523087
2012 video not in TPA - "DotA Intro [PMV]":https://piped.adminforge.de/watch?v=t453aj2MfxU2015 video not in TPA - "DotA - BassHunter [PMV]" (I mostly didn't watch this):https://www.youtube.com/watch?v=7kHlHkpO9VM>>40529027> S3FizQiSTucAlso a small channel. Others: kDPW8XlDveA nhnGCMDj9-s dK6w4VBQvNw . pfp from> https://y.com.sb/watch?v=25fsQofab9c> This song always keep me in good mood,even when my life is going to start slowly ruin> 7 months ago (edited) | [4 likes]
>>40530311Dl'd a channel:>$ yt-dlp -j --flat-playlist UUyebl9lAAXnjzV3pUjBAatw > 1plist1.json 2>1error1.log.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); if [ -f $fdir ]; then sleep 9d; else mkdir $fdir; fi; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.log.txt .; utc > 1stats1.txt; chan=$(pwd | grep -o "........................$"); curl -sL "https://www.googleapis.com/youtube/v3/channels?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails,statistics,topicDetails,status,brandingSettings,localizations&id=$chan" > 1chan1.json; chanp=$(jq ".items[].snippet.thumbnails.high.url" 1chan1.json | tr -d \"); chand=$(echo $chanp | sed "s/=.*/=s0/g"); curl -sL $chanp > 1pfp1.img.jpg; curl -sL $chand > 1pfp2.img.png; banc=$(curl -sL https://y.com.sb/channel/$chan | grep "=w2560-fcrop64=" | sed "s/\" alt=.*//g" | sed "s/.*\".ggpht/https:\/\/yt3.googleusercontent.com/g"); band=$(echo $banc | sed "s/=.*/=w0/g"); curl -sL $banc > 1banner1.img.jpg; curl -sL $band > 1banner2.img.png; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.log.txt 2>1logy12.log.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.log.txt 2>1logy22.log.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.log.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.log.txt; done' _; utc >> 1stats1.txt; bash <(ipfs cat bafkreibmctj6wjeajcf2ce36efsatxicjfazuo63fow46wpmk3wstwfcxa); cd .. # w3s+ more descriptive filenames* ignore mv and curl errors* todo: stuff>/z8/video/7572657/c2/Sterling_Noblewolf_UCyebl9lAAXnjzV3pUjBAatw/PMV_Wonderbolt_Sung_with_Rainbow_Dash_s_voice-Sterling_Noblewolf-20150721-youtube-1920x1080-kDPW8XlDveA.png
>>40530311Here's WaffleToastCake_UC_yZJwGAXhjCAvaONU1psNg (a YouTube channel):https://w3s.link/ipfs/bafybeia6cpucoqwp7ng4qnysv6sarxqydh5jb4hzbwx5v3rd7usffywsfqUpdate to one-liner:>curl -sL "https://www.googleapis.com/youtube/v3/channelSections?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails&channelId=$chan" > 1_channel_sections_1.jsonImage from:>http://fzdqwfb5ml56oadins5jpuhe6ki6bk33umri35p5kt2tue4fpws5efid.onion/ipfs/bafybeia6cpucoqwp7ng4qnysv6sarxqydh5jb4hzbwx5v3rd7usffywsfq/WaffleToastCake_UC_yZJwGAXhjCAvaONU1psNg/1_profile_picture_1.img.pngCaptcha: HP8SGP
>>40530915He uploaded a 48-second PMV demo, but unfortunately never finished it due to being afraid of copyright infringement:>Unused_PMV_Shy_Gon_Give_it_to_Ya-WaffleToastCake-20130803-youtube-1280x720-nhnGCMDj9-s>https://dweb.link/ipfs/bafkreicrfcuzrqd7o4ol7urgrlwe3ev7szthhhkebjq3srpwgqloimqgvy>https://dweb.link/ipfs/bafkreiglr5f6zby3fkcglaedklzp6ufew7uh6h63rzoxfwkvetn6ommkq4I would have been interested in seeing the full-length version. Channel desc.:>The second channel of TrixieReturns. \n\nHere I post the new, upcoming Pony Grumps videos and other pony related project that I'm afraid to post on my other channel because of copyright :P\n\nI hope you enjoy your stay ^_^Image>https://bafybeia6cpucoqwp7ng4qnysv6sarxqydh5jb4hzbwx5v3rd7usffywsfq.ipfs.dweb.link/WaffleToastCake_UC_yZJwGAXhjCAvaONU1psNg/Unused_PMV_Shy_Gon_Give_it_to_Ya-WaffleToastCake-20130803-youtube-1280x720-nhnGCMDj9-s.png
>>40530311> 7kHlHkpO9VM + other idSmall channelsUCL2pvYFTcVRUl7SpyALtCpgUCUZq_fqEob-T_Us5JmII1_A>>40531957Neither shows all of the channel channels:>https://bafkreib53pabqxi7paeg4iv6xu3spulqenbll3t2qnpvmbcslfd5v4gee4.ipfs.w3s.link/?filename=1_channel_sections_1.json>https://bafkreicrfcuzrqd7o4ol7urgrlwe3ev7szthhhkebjq3srpwgqloimqgvy.ipfs.w3s.link/?filename=1_channel_metadata_1.json
>>40532076> >>40531957Meant to reply to>>40530915Channel channels (subscribed to Imma[Pony] channels):https://y.com.sb/channel/UC_yZJwGAXhjCAvaONU1psNg/channels
>>40523884fantastic work, didn't think I'd actually be able to find it. Thanks anon
>>40523673> todo: update yt-dlpDone. Older and newer version:https://w3s.link/ipfs/bafybeiejm2jngllckvq4irxe54xmrd66jfn5dti3ltvhzvglwr2rl2qyga
>>40530311Dl'd another>$ curl -sL https://x0.at/YAWl.txt>$ yt-dlp -j --flat-playlist UUokyMug7f_3VWsk_KweoVvg > 1plist1.json 2>1error1.log.txt; cat 1plist1.json | jq ".id" | tr -d \" > 1plist1.txt; fdir=$(yt-dlp --get-filename --skip-download --restrict-filenames --windows-filenames -o "%(channel)s_%(channel_id)s" -- $(head -n1 1plist1.txt)); if [ -f $fdir ]; then sleep 9d; else mkdir $fdir; fi; cd $fdir; mv -n ../1plist1.txt .; mv -n ../1plist1.json .; mv -n ../1error1.log.txt .; utc > 1stats1.txt; chan=$(pwd | grep -o "........................$"); curl -sL "https://www.googleapis.com/youtube/v3/channels?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails,statistics,topicDetails,status,brandingSettings,localizations&id=$chan" > 1chan1.json; chanp=$(jq ".items[].snippet.thumbnails.high.url" 1chan1.json | tr -d \"); chand=$(echo $chanp | sed "s/=.*/=s0/g"); curl -sL $chanp > 1pfp1.img.jpg; curl -sL $chand > 1pfp2.img.png; banc=$(curl -sL https://y.com.sb/channel/$chan | grep "=w2560-fcrop64=" | sed "s/\" alt=.*//g" | sed "s/.*\".ggpht/https:\/\/yt3.googleusercontent.com/g"); band=$(echo $banc | sed "s/=.*/=w0/g"); curl -sL $banc > 1banner1.img.jpg; curl -sL $band > 1banner2.img.png; wc -l 1plist1.txt >> 1stats1.txt; cat 1plist1.txt | xargs -d "\n" sh -c 'for args do wget --spider --no-verbose "https://tpa.mares.workers.dev/?output=html&id=$args" -o temp.txt; cat temp.txt >> 1plist2.txt; done' _; rm temp.txt; grep -v '!!!\| 200 OK$' 1plist2.txt | sed "s/.*=//g" | sed "s/://g" > 1plist3.txt; ids=1plist3.txt; yt-dlp -S "lang,quality,res,fps,hdr:12,vcodec:vp9.2,channels,acodec,size,br,asr,proto,ext,hasaud,source,id" --restrict-filenames --windows-filenames --sub-langs all --sub-format srt --write-description --write-thumbnail --convert-thumbnails png -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy11.log.txt 2>1logy12.log.txt; torsocks yt-dlp --restrict-filenames --windows-filenames --write-info-json --write-comments --skip-download -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.%(ext)s" --batch-file $ids 1>1logy21.log.txt 2>1logy22.log.txt; cat $ids | xargs -d "\n" sh -c 'for args do fname=$(yt-dlp --restrict-filenames --windows-filenames --skip-download --get-filename -o "%(title)s-%(channel)s-%(upload_date)s-%(extractor)s-%(resolution)s-%(id)s.apimeta.txt" -- $args 2>>1error1.log.txt); curl "https://www.googleapis.com/youtube/v3/videos?key=$(cat ~/ytapikey1.txt)&part=snippet,id,contentDetails,liveStreamingDetails,localizations,player,recordingDetails,statistics,status,topicDetails&id=$args" > $fname 2>>1logm2.log.txt; done' _; curl -sL "https://www.googleapis.com/youtube/v3/channelSections?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails&channelId=$chan" > 1_channel_sections_1.json; utc >> 1stats1.txt; bash <(ipfs cat bafkreibmctj6wjeajcf2ce36efsatxicjfazuo63fow46wpmk3wstwfcxa); cd ..>./7572657/c2/fengshui1301_UCokyMug7f_3VWsk_KweoVvg/
>>40471717>>40463683That's an index of about 485 GB of data from IA. Those hundreds of gigabytes are in this folder (MFS for now):* https://gateway.pinata.cloud/ipfs/QmYQdv2cPkeHRkyF9UU3Zcrerpjcf5ut9grjEPj5wMM86j** ipfs://QmcmwTgJGE3jN7PMGvA14MuJf52pRtHX48GifsgBrgvcNo>>40529514Video from a 2015 thread, copied here:https://gateway.pinata.cloud/ipfs/QmQEVkmJNJjLmin4bPos2FC19k2RyXHqyBP9YF6ggk6Bf4/Guy_pranks_a_girl_with_a_Twilight_Sparkle-themed_mare_vagina_sex_toy/
If anyone else here uses remote pinning sites/services, the following may be helpful. You should have local copies of all remote pins, but sometimes you don't want to run the ipfs daemon all the time. Solution: pin it via a CAR file. First, download it (replace host and CID with whatever):>wget https://ipfs.jpu.jp/ipfs/QmX6FVE5Q61tpYhBxGzbcc9kdHirH89pJkzktkYote6Eb7?format=carNext, import it which should also pin it:>ipfs dag import QmX6FVE5Q61tpYhBxGzbcc9kdHirH89pJkzktkYote6Eb7.carLastly, optionally delete the .car file.Further motivation: you can somewhat make sure that your own local storage is good enough and around. You can't guarantee that some websites or services will be around long enough, and can't trust that they won't mess up in some way. Example:https://reddit.lol/r/ipfs/comments/slj7kk/web_based_ipfs_uploader_and_browser/>I don't know the full details (have been talking to the PM for it on and off in the ipfs discord for a bit), but web3.storage and it's sibling site nft.storage are not for profit businesses. They are just for promoting the ipfs/FIL ecosystem and will not be around forever. The intention is to pin as much as they could in the beginning to kickstart the ecosystem, I assume the FIL used to do the current pinnings probably come out of a community fund of FIL for starting the ecosystem or something of the sorts.>>40529514Reading older threads - https://desuarchive.org/mlp/thread/35341327/OP:>Know your meme has 220 000 pony images dating back 10 years.I read about a WARC copy of some of that KYM website. I may have downloaded it. Said WARC might be incomplete; for example, it might not have all "200,000+" MLP images.>>40471717>Super Ponybeat - Art of the Dress (Complete) [MunCk4b6ofM]Back online:https://gateway.pinata.cloud/ipfs/bafybeiaoahsh6kcecrpesara56b6d5dtx52sshzwsfa4eqjg6iadwqofziSome of the YouTube comments:> I put this song on at work a few days ago, and nobody knew what it was from. My friend who was using the mixer in the back said that it made her so excited that she almost spilled a bottle of vanilla on the floor.> 2013-04-12T11:46:09ZHype track, makes you spill the vanilla.>> Oh jesus christ the nostalgia, Winter of 2011 when I was a stupid loudmouth on the internet about this show.\n\n;_;>> 2014-02-19T01:45:54Z> Same here, I actually turned some of my friends into bronies cause I loved this show so much I was BEYOND crazy obsessed with it, I needed to tell the whole world about it lol> 2021-06-25T04:52:15Z>>40477745>How to make your local apache web server accessible over the internet in 30 seconds using ngrokI randomly came across this post which shows that that website was used in the past in /mlp/:https://desuarchive.org/mlp/thread/35364097/#35625451> Anonymous Sat 18 Jul 2020 12:48:38 No.>>35625451> Quoted By: >>35625626> >>35618730> Now that I'm less of a noob, I feel like posting the last ngrok link here :> https://c7acfbca8b7f.ngrok.io/ttsDead link, not in wbm
>>40534747Includes the classic that started it all, for some fans:> My Little Pony - Rainbow Dash - You're Gonna Go Far Kid [Explicit] and source audio>> https://gateway.ipfs.cybernode.ai/ipfs/bafybeiai6fn2ryofsgdpcuxdrbumxe4nqr5yudrzdd5vtvh7547xugijhm>>> https://gateway.pinata.cloud/ipfs/QmT1pYyLoyKeTt7bZNodub43CqSrHJo3MCYHD9BqfBGYUU>>>> Hit em' right be between the eyes. Hit em' right be between the eyes.>>40535081>Super Ponybeat - Art of the Dress (Complete) [MunCk4b6ofM]>https://gateway.pinata.cloud/ipfs/QmcswWPQQRXLDJtnpE82scchAB1T4QyTMMwUiPzSvbc7sc>Winter of 2011That's about one year after "Winter Wrap Up" first aired.https://breezewiki.hyperreal.coffee/mlp/wiki/Winter_Wrap_UpAnother comment on MunCk4b6ofM:>"textOriginal": "i remember clicking a link to masterlinkx's youtube channel over a year ago. \"check out MLP on this dude's youtube\" they said. i was skeptical at first.\n\nthis was the featured video on MLX's channel; it had just been released. first pony vid i ever saw. i was impressed that people made remixes for this show. i guess MLP couldn't be that bad if it had such talented fans.\n\nthis song gives me tears now. what if i had never clicked on that link? how different the past year would have been...",>"authorDisplayName": "J C",>"updatedAt": "2012-05-11T08:24:04Z"
If you're saving online HTTP(S) data to web archive files, you can check if the grab is still running with Apache HTTP Server; go to a URL similar to the following. In that local network link to the "temp" folder you will see dynamic data in there (different on "each" page refresh) if it is still running, and empty if it finished.http://10.0.0.232/.../grab-site/something-2023-11-04-932d3950/temp/>>40535123>>40534747Also includes "Bats - song with Polish subtitles":> https://gateway.pinata.cloud/ipfs/bafybeihror47ry2i74pgmxwtni3inu5tjz6drtxm2oklxmofrfzsv4vbmq>> https://gateway.ipfs.cybernode.ai/ipfs/QmQ1KvdLXXpQbMoRencQAkZUSujiwKFA7JwN4f6JVs1wHt>>> Polish word for "monsters" = "potwory">>40535123*Hit em' right between the eyes.Image from> https://external-content.duckduckgo.com/iu/?u=https://media1.tenor.com/images/e115361e8562922e7d2ade29c1e7f1dd/tenor.gif%3Fitemid=15003654>> currently not here: https://twibooru.org/search?q=popcorn%2Cgif%2Crainbow+dash
>>40534747Includes "Avast Fluttershy's Ass - 20% Cooler Yay Equaliser Edition" - folder contains an FLV file from old YouTube:* https://gateway.ipfs.cybernode.ai/ipfs/bafybeic65b6l72fqsv62nwfigwk7kea5gpmjaqe2jjmxlbs3rxcstbmbzy** MP4: https://gateway.ipfs.cybernode.ai/ipfs/QmSQer7wMvQFfMd3teW9M3akKPs3vGdtDzUwuDTQcXxXye>>40535231*Hit 'em right between the eyes.
>>40516015>>40515955Was listening to that MGMT track again ( https://y.com.sb/watch?v=BoatSoGva_I ) and noticed that this not-in-tpa video has been made private - "PMV | Little Dark Age | My Little Pony: Friendship is Magic":https://web.archive.org/web/20230702104658/https://vid.puffyan.us/watch?v=4MTj4FUmQfkGeoblocked - "Little Dark Age PMV (blood warning!!)":https://y.com.sb/watch?v=cv8kIg1o1MA"Little Dark Age - PMV"https://y.com.sb/watch?v=CGuZNHjXQocDDG, deleted video:>https://www.youtube.com/watch?v=rvSTA-iEIBQ>my little dark age.Clearsight PMV - YouTube>Subscribesong by MGMT YouTube link-https://youtu.be/rtL5oMyBHPs?si=7oEBx7IzWygewjPwSome of the above might be npr. Kikes are having lots of videos with that music deleted, and I saw something on Pony.Tube about that too. Image from>https://web.archive.org:443/web/20230506080022im_/https://vid.puffyan.us/vi/4MTj4FUmQfk/maxres.jpg
>>40535431>PMV | Little Dark Age | My Little Pony: Friendship is Magic>https://www.youtube.com/watch?v=4MTj4FUmQfk720p copy of that video ID:https://files.catbox.moe/y9xr88.mp4Anyone have a 1080p copy of it?
Reading older threads - https://desuarchive.org/mlp/thread/34616514/>shitposts/funposts>pornI laughed; I came; I saw; I conquered.
>>40524580Contains:* UCemUN21RAWJJv1heOfZ5dog_info.json** I know how to get this.** kind=youtube#channelListResponse -> kind=youtube#channel** contentOwnerDetails*** I intentionally didn't get this, but guess I should >>40509128* UCemUN21RAWJJv1heOfZ5dog_sections.json** I know how to get this** kind=youtube#channelSection* UCemUN21RAWJJv1heOfZ5dog_playlists.json** Don't entirely know how to get this** kind=youtube#playlist** PLaNInrIWB3aVbxSQmckCrUfVJD2Fv3kNk* UCemUN21RAWJJv1heOfZ5dog_subscriptions.json** Don't entirely know how to get this** kind=youtube#subscriptionImage from a file in>https://gateway.ipfs.cybernode.ai/ipfs/QmcmwTgJGE3jN7PMGvA14MuJf52pRtHX48GifsgBrgvcNo/
I'm at a point where I can restore some things from this computer which basically died (HDD is fine). Image from 0x52abd5b8.iso*:>$ sudo losetup -o $(expr 206848 \* 512) /dev/loop1 0x52abd5b8.iso2 # sudo fdisk -lu 0x52abd5b8.iso2 -> expr: start * sector size>$ sudo mount -o ro /dev/loop1 /mnt/loop>$ ffmpeg -i "[archive:///mnt/loop/.../Ponyvideos.zip|/Pony/ponyvids/.MOV/Wildfire's Road Rage [0P1gESvjY6Y].mkv]" -map 0:2 -c copy "Wildfire's Road Rage [0P1gESvjY6Y].mkv.jpg"
>>40535231>currently not here: https://twibooru.org/search?q=popcorn%2Cgif%2Crainbow+dashShould be fixed soon, uploaded that image to crapsite:>https://derpibooru.org/images/3240848>2023-11-15T15:53:43Z>safe, rainbow dash, fire, solo, gif, popcorn>>40538343>Pony/ponyvids/.MOV/Wildfire's Road Rage [0P1gESvjY6Y].mkvCorrection:>Pony/ponyvids/Wildfire's Road Rage [0P1gESvjY6Y].mkv
>>40537458>Don't entirely know how to get thisChannelBanners, Playlists, Subscriptions, etc. are described here and in subpages:https://developers.google.com/youtube/v3/docs/>>40538343Would be neat if this would work as a read-only FS (currently doesn't or maybe it will work if I change the location of "repo.lock"):>$ IPFS_PATH=/mnt/loop/.../.ipfs>$ ipfs pin ls --type=recursive > wp.txt>Error: cannot acquire lock: Lock Create of /mnt/loop/.../.ipfs/repo.lock failed: open /mnt/loop/.../.ipfs/repo.lock: read-only file system
>>40531957>>40532081>>40532705Similar - "Slow Down PMV" (video is in TPA, EQD YT):https://www.youtube.com/watch?v=Wi_L5QnwMUEIt's a pony music video of a rap music track. I kinda like that PMV; it uses maybe most of the track and not all of it ( full: https://www.youtube.com/watch?v=8I75tc1SLT0 ).>>40538412Would have preferred to mount it as read-only (-o ro), but IPFS works better with the default mount options: something like "mount /dev/loop1 /mnt/loop # implies -o rw" for read+write.
>>40537458>>40538412>UCemUN21RAWJJv1heOfZ5dog_playlists.jsonhttps://developers.google.com/youtube/v3/docs/playlists/listUse the channelId filter to get all playlists for a channel.>UCemUN21RAWJJv1heOfZ5dog_subscriptions.jsonhttps://developers.google.com/youtube/v3/docs/subscriptions/listAgain, use the channelId filter.
>>40428457>>40430522>https://mega.nz/folder/EJ1xmJCI#iKxTmMLn8T8m_59qxtZHnAI'll download this later.>>40538883-o defaults:>Use the default options: rw, suid, dev, exec, auto, nouser, and async.>Note that the real set of all default mount options depends on kernel and filesystem type. See the beginning of this section for more details.https://manpages.org/mount/8
Magnets can in fact ruin a hard disk drivehttps://y.com.sb/watch?v=VWjX52oAAMk
2016 video not in TPA - "Pinkie Brew - [PMV]":https://y.com.sb/watch?v=JOw6jc9tInc2023 video not in TPA - "Pinkies Brew [ Animation ] ~ Pinkies Brew Remix by TheLivingTombstone":https://y.com.sb/watch?v=n0nc8VC94DsBoth medium/high effort
>>40540296Guess I'll download those two channels in the near future. One=inactive. Another=active, larger than the inactive one. Image from>https://gateway.ipfs.cybernode.ai/ipfs/QmYZyd3RJ5u3LHLViCXFa2eiC1qC9bqkE66CmHHbs1vbkp?format=tar
Alligator in the Tub^channel here this day:> https://web.archive.org/web/20231019123705/https://y.com.sb/channel/UCqrCgswKANDHeCF-xUNllyAGone today:> https://web.archive.org/web/20231116165418/https://y.com.sb/channel/UCqrCgswKANDHeCF-xUNllyA?sort_by=popular>>40432571>>40431228I could listen to "Ode to Joy" just about every day.>>40534747> Qmcm...vcNoThis was online a little while ago. Compared to past observations, gateway(s) and my node had significantly better accessibility when it came to random reads (on folders which probably weren't "cached" or hosted by anyone else, I think).
I was arbitrarily reading thishttps://i.opnxng.com/r/ipfs/comments/o45jh9/can_i_upload_files_to_ipfs_without_hosting_a_node/Someone suggested that a tiny Google Cloud VM be used. That's a stopgap/temporary solution for some things, such as- Lokinet exit nodes not working for anyone, not fully supported on BSDs >>40474740- Some CIDs not having great uptime >>40541544I haven't used Google Cloud [Compute], might be interesting to mess with that likely spooky/anti-privacy thing to do Internet-based tasks. Don't use it as a main thing, and I read a complaint about it before.>>40539443>mega.nz/folder/EJ1xmJCI#iKxTmMLn8T8m_59qxtZHnAI'm downloading this MLP-related music folder, about 35G total. Saving to:>/z8/audio/db6b776/https-mega.nz-folder-EJ1xmJCI#iKxTmMLn8T8m_59qxtZHnA/Pony Fan Music Remix Stems/- forgot to replace "#" with "-"- forgot to try redirecting stdout/err from MegaBasterd to text files
>>40542302>downloading [...]/Pony Fan Music Remix Stems/MegaBasterd seems to be stuck on these two 82-byte files:>./Pony Fan Music Remix Stems/JayB - ILoveEverything_RemixPack 131BPM/._Chords Breakdown.mid>https://mega.nz/#N!UdsFmDLB!4BVcb-LnPMN7Ctqnj9qeNyC9lsex5G3noorELBefn4U###n=EJ1xmJCIand>./Pony Fan Music Remix Stems/JayB - ILoveEverything_RemixPack 131BPM/._Pad Breakdown.mid>https://mega.nz/#N!VNlBnRCL!4BVcb-LnPMN7Ctqnj9qeNyC9lsex5G3noorELBefn4U###n=EJ1xmJCIBrave Browser showed this with those two links: "The link you are trying to access is not valid." Everything else finished downloading.Image from>/z8/audio/db6b776/https-mega.nz-folder-EJ1xmJCI#iKxTmMLn8T8m_59qxtZHnA/Pony Fan Music Remix Stems/Pony Swag 120BPM/PONY SWAG Digital Single/FRONT.jpg
How could I download mega.nz webpages so they can show the timestamps of all of the files and folders?>>40542595After clicking "pause all downloads", it said that those 2 files downloaded successfully. BTW, follow-up to post in previous thread: >>>/wsr/1418953 (in 4chan/wsr/thread/1405633). Image from>/z8/audio/db6b776/https-mega.nz-folder-EJ1xmJCI-iKxTmMLn8T8m_59qxtZHnA/Pony Fan Music Remix Stems/Pony Swag 120BPM/PONY SWAG Digital Single/BACK.jpg
>>40541544>Alligator in the TubI'm sure it's been archived a lot of times by now, but here are a couple of other accounts:https://47times.newgrounds.com/movieshttps://www.deviantart.com/nomorethan9
sleepy https://twibooru.org/3098629
>>40474868>>40474875>https://archive.org/details/youtube-9aCDtxPUGPQCopied one file:>https://bafybeiflhdthlpgtmbwdyv7ozackij6l4gyiqksatxiu3qjmtz56hlfh5u.ipfs.w3s.link/ipfs/bafybeidm5kl546kbhunh5aximn7dxf3lgyflsz2azenc3zzg24z2dp4faq?filename=9aCDtxPUGPQ.webm
YT video ID=? - "[MLP×SNL] Jar Glove":https://archive.org/details/mlpx-snl-jar-glove>>40540296Downloading channel with 2016 video; looks like that channel doesn't have a subscription or playlists tab. Rename: "1logm2.log.txt" -> "1_apimeta_per_video_1.log.txt"; or, quit writing this file by using "-sL".
>>40543928Looks like yt-dlp (latest >>40533527) only downloaded 37 out of 38 total fragments on https://www.youtube.com/watch?v=C-_wmalzIag ; this is a problem, or it isn't:>[hlsnative] Downloading m3u8 manifest>[hlsnative] Total fragments: 38>[download] Destination: My_Demons_-_PMV-ebrar-20160727-youtube-1920x1080-C-_wmalzIag.f270.mp4>[download] 66.8% of ~ 96.75MiB at 1.67MiB/s ETA 00:21 (frag 24/38)[download] Got error: 47260 bytes read. Retrying (1/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (1/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (2/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (3/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (4/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (5/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (6/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (7/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (8/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (9/10)...>[download] Got error: HTTP Error 404: Not Found. Retrying fragment 25 (10/10)...>[download] fragment not found; Skipping fragment 25 ...>[download] 100% of 93.61MiB in 00:01:10 at 1.32MiB/s>[download] Destination: My_Demons_-_PMV-ebrar-20160727-youtube-1920x1080-C-_wmalzIag.f251.webm>[download] 100% of 3.06MiB in 00:00:00 at 3.56MiB/s>[Merger] Merging formats into "My_Demons_-_PMV-ebrar-20160727-youtube-1920x1080-C-_wmalzIag.mkv"Image from>/z8/video/7572657/c2/ebrar_UCFZ3wlN6iJkjNSIgZDWjAVg/My_Demons_-_PMV-ebrar-20160727-youtube-1920x1080-C-_wmalzIag.png
>>40542726>How could I download mega.nz webpages so they can show the timestamps of all of the files and folders?Maybe available from Mega.nz's API. Also, not much info here:https://wiki.archiveteam.org/index.php/Mega>>40543949>ebrar UCFZ3wlN6iJkjNSIgZDWjAVgBunch of EQG in that channel
>>40538913>Use the channelIdThis was the only slightly confusing part when I added "1_channel_sections_1.json" >>40534030 .>developers.google.com/youtube/v3/docs/playlists/listSo:>curl -sL "https://www.googleapis.com/youtube/v3/playlists?key=$(cat ~/ytapikey1.txt)&part=id,snippet,contentDetails,localizations,player,status&channelId=$chan&maxResults=50"->should show a nextPageToken if there's >50 playlists, at which point more logic has to be implemented to get them all.
*>Use the channelId filter [which is www.googleapis.com/...&channelId=]Downloading SinclairDuGore_UCysdoUf58HnIw38CRznWThQ - this time with "1_channel_playlists_1.json".
>>40544962>should show a nextPageToken if there's >50 playlists, at which point more logic has to be implemented to get them all.I’ve got python scripts for these too but as mentioned before they’re a little dodgy at the moment. I can fix them up for you if you’re still interested.
>>40542302>>40535081Similar to those two threads:>https://megalodon.jp/2023-1118-0826-28/https://teddit.bus-hit.me:443/r/ipfs/comments/rnirgm/how_long_i_can_access_ipfs_files_without_pinning/Was also arbitrarily reading this. It mentions that data can be hosted/stored/shared with Filecoin for free, all that has to be paid is the gas fee.>>40545034I'm interested in seeing or using that.
>>40545000Downloaded. I also downloaded this small channel (see "1how1.txt" for the improved one-liner):https://w3s.link/ipfs/bafybeichfyuko3oizxokoud6puciktctdwazf6j5etx5n5y5giey44gttyHas only one public video - '"Revenge (Minecraft Creeper Song) [feat. CaptainSparklez]" PMV':https://www.youtube.com/watch?v=7ZFKRX7sQQYPic related from>https://w3s.link/ipfs/bafybeichfyuko3oizxokoud6puciktctdwazf6j5etx5n5y5giey44gtty/Emma_Schmudlach_UC-eSaEd96LUS71nWX_R4bDw/Revenge_Minecraft_Creeper_Song_feat._CaptainSparklez_PMV-Emma_Schmudlach-20140619-youtube-640x360-7ZFKRX7sQQY.png
In the thumbnail of the following video (attached), the image of Applejack holding a knife was modified for there to be blood on the blade."My Little Pony: Friendship is Magic | SPOOKY Halloween Episodes | Full Episodes Compilation | MLP" (2023 video not in TPA):https://www.youtube.com/watch?v=eoosziwWTnc----Copy of FIM that I was looking at:https://fmovies.to/filter?keyword=My+little+pony
>>40542302>Google Cloudhttps://www.youtube.com/watch?v=kzKFuHk8ovk>furry friends>free trial>>40545600>https://fmoviesz.to/tv/my-little-pony-friendship-is-magic-720j6/7-5Maybe better than the 123movies copy. Besides a few ads, it also might beat YT, IA, and pony.tube. fmoviesz.to for that S7 episode (and maybe also multiple seasons): good video quality, good audio quality and volume, has English and Russian subtitles/CC which you can turn on and off.
>>40100267>randomly became unpinned?Thinking that happened because in crappy NTFS some leveldb files became corrupted or errored.? image from booru post:>http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion.pet/post/4916199/bafybeidi6jc5amsnhkenfyq7q6ktnjnkgo4qyyiioeser7ul2kn5ewvthmCaptcha: WHAAH
Wget clarity (simple + not considering span-hosts):* (1) download something:** wget url* (2) download something+page requisites (pr)** wget -p url* (3) download something + outlinks** wget -r --level=1 url* (4) download something+pr + outlinks+pr** wget -rp --level=1 urlThinking of going with #3 (+warc options) for this one thing. Wget2 can filter by mime type:https://anonoverflow.frontendfriendly.xyz/exchange/unix/questions/53397/placeholder
>>40447939In regards to Google Drive data QmeZLFkzycAL4nL7JdHMWibXhRCPzFjp2x35kaXRtzZ7mr ("low risk"):* Downloaded: metadata - dirs, raws, per ID* Partly downloaded: data* Partly done: metadata - dirs, raws, per ID -> wbm* Todo: get warc of dirs, per ID* Commands:** ran:*** .../z8/text/3151ebd$ grep -P " https...web.archive.org.web.\d\d\d\d\d\d\d\d\d\d\d\d\d\d." logwget.txt | sed "s/^Location: //g" | sed "s/ \[following\]$//g" | sed "s/.* //g" | sort | uniq > logdone.txt** running:*** .../z8/text/3151ebd$ grep -o "/files/.................................?openDrive" logdone.txt | sed "s/?.*//g" | sed "s/.*\///g" | xargs -d "\n" sh -c 'for args do perl -p -i -e "s/$args\n//g" ./0/dirtodo.txt; done' _ # this command takes a while to finish*** .../z8/text/3151ebd$ cat /z8/text/3151ebd/0/dir1.txt | xargs -d "\n" sh -c 'for args do echo "https://clients6.google.com/drive/v2beta/files/${args}?openDrive=false&reason=1001&syncType=0&errorRecovery=false&fields=kind%2CmodifiedDate%2CmodifiedByMeDate%2ClastViewedByMeDate%2CfileSize%2Cowners(kind%2CpermissionId%2Cid)%2ClastModifyingUser(kind%2CpermissionId%2Cid)%2ChasThumbnail%2CthumbnailVersion%2Ctitle%2Cid%2CresourceKey%2Cshared%2CsharedWithMeDate%2CuserPermission(role)%2CexplicitlyTrashed%2CmimeType%2CquotaBytesUsed%2Ccopyable%2CfileExtension%2CsharingUser(kind%2CpermissionId%2Cid)%2Cspaces%2Cversion%2CteamDriveId%2ChasAugmentedPermissions%2CcreatedDate%2CtrashingUser(kind%2CpermissionId%2Cid)%2CtrashedDate%2Cparents(id)%2CshortcutDetails(targetId%2CtargetMimeType%2CtargetLookupStatus)%2Ccapabilities(canCopy%2CcanDownload%2CcanEdit%2CcanAddChildren%2CcanDelete%2CcanRemoveChildren%2CcanShare%2CcanTrash%2CcanRename%2CcanReadTeamDrive%2CcanMoveTeamDriveItem)%2Clabels(starred%2Ctrashed%2Crestricted%2Cviewed)&supportsTeamDrives=true&retryCount=0&key=$(cat ~/ytapikey4.txt)" >> /z8/text/3151ebd/start_urls_1700324807.txt; done' _** to run:*** ...grab-site...start_urls_1700324807.txt... # dirs
^Correction:* Partly done: metadata - dirs, per ID -> wbmImage from>https://web.archive.org/web/20231118012851/https://y.com.sb/watch?v=HokxLMmgsgk
>>40422488anypony have this song at 40:28? I would love to have it for my collectionhttps://youtu.be/V4CXXpz0MVY?si=olJRo6UrZ5kmAZtV&t=2428
>>40547361I don't know the title/singer. I do know that it is a parody of "American Pie" by Don McLean. Funny coincidence: a day or two ago I was randomly wondering if there was a PMV of "American Pie".
>>40529011Fuckin commie. https://chat-gpt.org/chat ran over Google reCaptcha's usage limit so now it uses Cloudflare's captcha/anti-bot-verification. (Recaptcha as of >>40529514; now=CF verification.)>>40547514I checked, as it is a popular song, makes sense that there is in fact PMVs of that.
2012 video not in TPA - "[PMV] American Pie (HD)":https://y.com.sb/watch?v=0ilcGf8sB_c>>40548155>>40529011>>40529514As if that IRL communist was someone who didn't commit acts of violence, terrorism, and murder.
>>40547318Computer crashed (grab probably incomplete). Will do things a bit differently this time, less likely to crash.>>40548180>>40528855That video is from a small MLP-focused channel, guess I will download that YouTube channel later. Cropped image: more of chatgpt (based on gpt 3.5) not thinking for itself, obviously.
>>40547361https://files.catbox.moe/g3ahk9.flac
>>40548905Thank you internet stranger, into the collection it goes
Tracking, NGU>>40464173>>40463992>>40464138>>40464160>1192 GB, MLP Leaks>~1000 GB, /mlp/ images>~584 GB, "various"> sum = ~2776 GBAs of 2023-10-25. Later:- ~193 GB, FIM S1-S9+Movie+Specials- 119 GB, /pag/ warc of previous threads- ~420 GB, 4K upscale of MLP [FIM presumably]- ~278 GB, post FIM S5 disc ISOs- ~90 GB, low estimate of various+warc+yt* sum = 1100 GB>>40547514>>40548988>singerIt's ML-generated.
>>40548905Linked from this threadhttps://desuarchive.org/mlp/thread/40456927/Holy hell, iPhones are garbage. I'm basically fine with Safari's 500 tab max limit. My problem is it sometimes replaces the url/webpage when a tab gets unloaded then I click on it and it loads as some other tab, so I end up losing the actual tab that was loaded with whatever URL. So, todo=warc of thread >>40456927 since I don't feel like saving whatever images I had opened in new tabs from that thread to wbm, Safari browser rekt those tabs, making it even harder. Seems the only way to prevent this problem is to have like 50 tabs max.
>>40548297>>40547318>Todo: get warc of dirs [metadata], per IDDone. It was about 100,000 URLs. Next todo: WARC of files metadata (per ID), which is about 800,000 URLs - API quota limit is hit somewhere around ~900,000.
>>39874871 >>39871936Would anyone happen to know where to find either of these files?
>>40549984I have those files. I also uploaded them to this one site with Filerun but CF messed up and verification failed.
Low relation - "Art of the Dress" song is heard in this popular 2018 Markiplier video - "Try Not To Laugh Challenge #17" (video not in TPA):https://www.youtube.com/watch?v=fhjl08mjenU
>>40550083Please, is there anywhere else you could upload it?
>>40463992Boom boom!https://gateway.pinata.cloud/ipfs/QmWRdfw7YxaXY38wnFNvYaR9J1oNtJEeo6jNzsn827mbX2/1598.%20Blumchen%20-%20Boomerang%20%28Langer%20Boooomerang%20Mix%29.mp3>>40550948Soon>$ id=" eeb916d1a8ad3f1cb7d8a2d0b91f "; utc; ~/Downloads/ia list $id 2>/dev/null || ~/Downloads/ia upload $id /z8/put/critter --metadata="title:WARC: critter.cloudns.nz and critter.duckdns.org" --metadata="mediatype:data" --metadata="collection:opensource_media" --metadata="subject:./Website archive/Fan-made/; website archive; fan-made; pony; My Little Pony; Friendship is Magic; requested; cartoon; snowpity; brony; bronies; MLP; FIM; ponies; mare; mares; critter.cloudns.nz; critter.duckdns.org; duckdns.org; cloudns.nz; fan fiction; fanfic; git; crittergit; stories; ferret's Stories; ferret; 2023-04-28; 2023-04-28 WARC; warc; 2023-04-29; 2023-04-29 warc; My Little Pony Friendship Is Magic" --metadata="description:From<br>https://critter.cloudns.nz/<br>https://critter.cloudns.nz/stories/html/<br>https://critter.cloudns.nz/blog<br>https://critter.duckdns.org/<br>https://critter.duckdns.org/stories/html/<br>https://critter.duckdns.org/blog<br>https://critter.duckdns.org/stories/html/contents.html" 2>&1 | grep -v "^/usr/lib/" | grep -v " warnings.warn(" | xxd -ps - | sed "s/e29688/23/g" | xxd -ps -r - | sed "s/\x20\x20/ /g" | xxd -ps - | sed "s/e29688/23/g" | xxd -ps -r -; utc>Sun, 19 Nov 2023 19:27:05 +0000>[in progress]
>>40551064Not allowed to upload multi-part ZIP files as-is to IA. Restricted on both of these scanners (upload methods):- Internet Archive HTML5 Uploader *- Internet Archive Python library *Error message - falsely perceives it to be an encrypted archive file:>eeb916d1a8ad3f1cb7d8a2d0b91f:>[...]> error uploading /z8/put/critter/critter.cloudns.nz.zip.001: Uploaded content is unacceptable. - Traceback (most recent call last):> File "/petabox/sw/ias3/deploy/check_file.py", line 123, in check_encrypted_archive>[...]>subprocess.CalledProcessError: Command '['7z', 'l', '-slt', '-p', '', '--', '/1/incoming/REMOTE_SUBMIT/s3-f4c256e8-6b0a-42fa-b656-b87db60adffe-eeb916d1a8ad3f1cb7d8a2d0b91f/__ia_spool/z8%2Fput%2Fcritter%2Fcritter.cloudns.nz.zip.001']' returned non-zero exit status 2.>[...]> File "/petabox/sw/ias3/deploy/check_file.py", line 125, in check_encrypted_archive> if 'Can not open encrypted archive' in e.output:>TypeError: a bytes-like object is required, not 'str'
>>40546214>NTFS partly corrupted/erroredTodo - fix these pins (partly/completely possible):>QmSe6gPzikEjC9Xev7dDfE3WLfCx41ygmV5HwaaxGRCWY4 [ = bafybeib7436inkcxxkfig54nmsqkrr3bzv2nq6wjx2rw6qnpjjwf3gjq6u ]> Error: pin: block was not found locally (offline): ipld: could not find QmPxxJcwQA4rQKAY1FPGpTc8CrooqgJWPg1vB911bCMravis: 4changif/202210/#partial>QmUaD2G9wvRS7S8w84FWuuZyDovenDyPBCxJ9CFcFHRcRa> Error: pin: block was not found locally (offline): ipld: could not find bafkreichfa3obtiyjun34ey6tjopvaeg2jaygomtt54q3sohctnmbndvumis: desu.1-29p1/1/#4chan_mlp>QmVfF4zAq5jMQT75cpao5ZM53LKhocM17N4QjP8PvAFQFY [ = bafybeidmyuota6hmlugc6vtqer5kwozn6kmhqmz6s4xiilewr7mu2jjam4 ]> Error: pin: block was not found locally (offline): ipld: could not find [ https://gateway.pinata.cloud/ipfs/QmdErNsyLYdQS8zifuEWX4PNA73yyub5Tu9T9ucNmfJLfH ]> Error: pin: block was not found locally (offline): ipld: could not find [ https://gateway.pinata.cloud/ipfs/QmXzGUAmmPoGxrbHqVUhKcziN8YKAQVcaEeTUw8NPKhzpQ ]is: poneb.in raw textsPonebin raw text is seeded by someone else and not just me (I didn't create that CID). QmXz...hzpQ:>Light creeps into the room and rests upon your eyes, letting you know it's time to get up.>Stand up and look back at the wavy blue maned mare sleeping with a smile on her face.>Lightly nudge her with a hand.>She turns over and looks up at you, her face scrunching up the freckles she has just above her nose.>"Good morning Anon...""Morning Milky.">She stretches out in the bed and then gets out of it.>She makes an annoyed face when her crotch tits slap against her legs as she slides off the bed.>Then she looks to you and giggles.>Both of you [...]>>40551488Gonna regret it, but I guess I'll just upload an extracted version of those multipart ZIP files.
>>40551064No bitrot since months ago>https://desuarchive.org/mlp/thread/40001862/#40022063Checked: 7/7 hashes on larger files (critter.cloudns.nz.zip.* and critter.duckdns.org.zip.*). Extracted 5637 files from those files: uploading.>>40551544>that greentextNext level horsefucking[...]>Squeeze her tits together and thrust even harder in between them.>When you do this, milk from them runs down and lubes up your dick.>She looks up at you.>"Anon... I'm ready to take it to the next level."[...]
>>40551658Might want to be careful with that image
I was somewhat randomly watching videos then I heard more about fricking lost media rapidshit blah blah blah. Didn't really wanted to think about that sad reality:>...UC2PbiTSO6XpyCMAsw67OLcQ/The_FORGOTTEN_My_Little_Pony_ARG_From_2011...-TobbyMLP-20221024-youtube-1920x1080-jN_3zTVVBtE.webm>https://www.youtube.com/watch?v=jN_3zTVVBtE>>40551962Why? I've seen lewder images posted here and nothing happened. Don't really remember which thread, but I think I was looking at a 2023 thread in desuarchive /mlp/ and someone posted a bat mare where you could clearly see her bare genitals. That post wasn't deleted. I guess jannies didn't notice.
>>40552061no I don't mean the lewd. it's that particular pony, although maybe it's fine in this context
To grab ( not listed/incomplete in https://fleek.cool/ipfs/bafkreic6ingxxyqelvin52ubb5cscbzhloez6chody2vbe5dtdkbvdzye4 )- nevobaster.art- [b] magicalponyreview.blogspot.com- [b] mlpraritydailies.blogspot.com- [b] mlpfactfile.blogspot.com- [small site] goldenoakslibrary.com / www.goldenoaklibrary.org- [large site] tabun.everypony.ru- [>>40444320 get JS linked] *.heartshine.gay- [site could soon change in a big way] lyrabooru.org- [crawl probably died=incomplete] radiobrony.ch>>40552061>lewdernoted https://desuarchive.org/mlp/thread/36457028/#36467090 and #36477923>didn't noticeIt was this image - https://twibooru.org/2409994 - posted in some thread. (Other image I saw when searching: https://twibooru.org/1548757 .) That upload links to a page in https://nevobaster.art/home.php / https://nevobaster.art/
>>40552253>no I don't mean the lewd.ok>it's that particular pony, although maybe it's fine in this contextI don't get it.>>40552294> [small site] goldenoakslibrary.com / www.goldenoaklibrary.orgWARC = done:https://w3s.link/ipfs/bafybeihb5bqijqnfkjx4zcpcjwerumzhadv2wphpjjxbmzqzssntp6c7ba/www.goldenoakslibrary.com/https://w3s.link/ipfs/bafybeicvux7n2vm4qyalzcmn6qbw6ksqz4zoucf6dvt26kfiur4u2ffyeu/www.goldenoaklibrary.org/
>>40552332Never mind. I shouldn’t have made a big deal out of it. Let’s just say that posting that pony usually results in deletion. Example: https://desuarchive.org/mlp/thread/35236811/#35240455 Carry on archiving
- mlpforum.umforum.net>>40552294Using an inferior computer to try to get the mediahash of a form of that bat pony image:> 1 md5 - broken https://web.archive.org/web/20231120083742/http://onlinemd5.com/ , works https://emn178.github.io/online-tools/md5_checksum.html> 2 hex->bin for d269804b6cda5026f70228daa9dbc14d - guess I could use some "run Python online" website> 3 bin->base64 - use the same thing as #2> 4 /->_ and +->- - easySteps 2&3: maybe use a "run bash/coreutils/Linux online" site.
- [b] watchmlpfim.blogspot.com>>40552932PHP:> < ? php echo base64_encode(pack("H*", md5(file_get_contents("/path/to/file.png")))); ? >Python:> . . .
>>40552955Ran>echo base64_encode(pack("H*", "d269804b6cda5026f70228daa9dbc14d"));In this crappy site - https://onlinephp.io/ - got nothing at>https://desuarchive.org/mlp/search/image/0mmAS2zaUCb3AijaqdvBTQMaybe better off searching by image dimensionsSome text from that blog:>Another character trait that Pinkie Pie has is her cartoonish behavior and deposition. Some old classic cartoons and their behaviors can also be seen in Pinkie Pie's actions like in the episode "Griffon the Brush Off", Pinkie's skips remind the viewers of Pepé Le Pew, while in the episode "Dragonshy", her costume resembles Daffy Duck's costume in the Looney Toons episode, Duck Amuck. Pinkie can also do incredible feats like make her eyes pop out and more like from classic cartoons. Her overall personality makes her the perfect pony as she represents the Element of Laughter.
In this Indian YouTube channel[1] a thumbnail for one of the uploads clearly shows Applejack's vagina.[2] Obviously that video is one of the most-viewed videos from that channel. I'm pretty sure I downloaded that channel in the past. More videos have been added since then, but I don't have a working updater, just a thing to save a whole channel once then not again. Actually, I think I could update my "ID list -> dl" one-liner to be similar to my "channel playlist all videos -> dl" one-liner and that would work. Could save more "crap" from that channel, but I think the folder for it is on a different HDD which is not attached.>>40551544>poneb.in raw texts [QmVf...FQFY]Fixed. Todo:>QmWRdfw7YxaXY38wnFNvYaR9J1oNtJEeo6jNzsn827mbX2.car> Error: import failed after block "QmYiPNvgZYSh3ZSxYAcrGrhMFX9gALgmUS1MpHCNdrwpYV": unexpected EOF>etc.>>40551658Got this archive.org error:> error uploading /critter.cloudns.nz/anonfiles/critter.cloudns.nz_stories.7z_extracted/stories/result/unfinished/chapter9.txt: Please reduce your request rate. - bucket_tasks_queued exceeds bucket_limit amountHow does one prevent this in the first place?>$ ia upload --help>[...]-R, --retries=<i> ; Number of times to retry request if S3 returns a 503 SlowDown error.>[...]-s, --sleep=<i> ; The amount of time to sleep between retries [default: 30].>>40552294>>40552332Updated list (blogspot.com is owned by Google):- mlpforum.umforum.net- nevobaster.art- [g] watchmlpfim.blogspot.com- [g] magicalponyreview.blogspot.com- [g] mlpraritydailies.blogspot.com- [g] mlpfactfile.blogspot.com- [large site] tabun.everypony.ru- [>>40444320 get JS linked] *.heartshine.gay- [site could soon change in a big way] lyrabooru.org- [crawl probably died=incomplete] radiobrony.chI have something of a plan to save Tabun, if/once I switch out this one HDD which is used for a certain purpose.> [1] https://web.archive.org/web/20231119162042/https://y.com.sb/channel/UCdJZ7XsDd-vldvHFpy2Y-NA?sort_by=popular> [2] https://web.archive.org/web/20231119162225/https://y.com.sb/watch?v=KP9XiWoMISk - title="Princess rainbowDash - Applejack - Princess Rarity - Princess twilightsparkle Song TilesHopEDMRush"
Should a separate thread be made for the imminent google drive deletion? I'm sure a lot of fans would want to make sure their pony stuff is saved.
>>40553291If there's one or more anons other than me who actually want to put in the work on it, then go for it. Maybe better that someone (not me) lead the effort. I could definitely help. If OP (of this hypothetical "Google Drive purge thread") or whoever are not willing to keep working on it, just post in /pag/. My thoughts/actions:* Did: got "./Pony/Website archive/" data (partial) + dirs per-ID metadata raws+warc and a small amount was auto-saved to wbm** "low risk", "API quota test run"* Todo: get "./Pony/Website archive/" files per-ID metadata warc** first try: computer crashed due to unrelated reasons. grab-site took a while to initialize about 800,000 URLs before actually fetching anything.* Todo: reconcile older threads on saving Google Drive like with the last purge or AT effort. Like someone posted multiple times here about a list, but didn't link it.* Todo: get links from all drive.google.com posted to /mlp/. I already saved those search results (basically). Just gotta automatically download the metadata as web archive files; in order to do this I hope to differentiate these links: to file, to folder, to dead, to access restricted.* Todo: somewhat automatically download the data from collected links. Some will be checked to see what they are as sometimes it is a link to a paid account with a folder with hundreds of gigabytes of files. Still, find a way to auto-download the data (I know how to auto-download the metadata). Could use rclone to automatically download it, but IIRC you sometimes have to do some manual actions even with rclone.* Todo: get links from other sources. I have CDXs of most MLP website warcs in one folder = >100GB of text files. Made easier from last time with Imgur. Maybe also get CDXs of my own grabs (is drive.google.com grab-site-ignored by default? I guess not).* Todo: figure out how to use resourceKeys to unlock whatever Google Drive folders/files that we or I can.* Todo: non-Drive Google things which might get deleted** Big topic, might include blogspot.com* I have ~terabytes of free space, especially if zpool z7 quits scaring me with "SUSPENDED". (z7 HDD: new+basically unused+passed smartctl test on the day of purchase from Best Buy.)* Uploads to IA: do after December 15, 2023 for metadata, do whenever for certain data
>>40553399>If OP (of this hypothetical "Google Drive purge thread") or whoever are not willing to keep working on it, just post in /pag/.I was asking because regardless of whether any work is done, I think it's important that everyone is aware so they can secure their own pony stuff. If it's kept to this thread, they may not remember and will have a nasty surprise next month.
>>previous postHere's the unedited image>>previous posthttps://web.archive.org/web/20231119162107/https://quetre.pussthecat.org/How-did-OpenAI-obtain-their-data-sets>Sixty percent of the weighted pre-training dataset for GPT-3 comes in from a filtered version of Common Crawl. Other sources are WebText2 representing 22% of the weighted total, Books1 representing 8%, Books2 representing 8%, and Wikipedia representing 3%.So I guess ChatGPT only used training data from those sources.>>40500324Should upload that to IA>>40496118>web.archive.org cannot save links containing "/ad/"Another fail:>https://realbooru.com//images/ad/53/ad53b438df6eb5cf6d67b78bdf564cc8.webm>>40553019- [g] g4mlp.blogspot.com>>40552980> 2818x2910 PNG 5.91 MB
>>40543949I think this was actually a problem.>>40553415Makes sense. And if not much work is done in that thread, someone(s) could at least keep it alive somehow.>>40553497Found it from thumbnail size - not labeled as deleted:>https://desuarchive.org/mlp/search/width/581/height/600/>>https://desuarchive.org/mlp/thread/40440452/#40447242>>40551488>>40553399Checked
>>40549984>>40550083>>40550948>>40551064>>40551488>>40551544>>40551658>>40553019It's all in here, raws+warcs - "WARC: critter.cloudns.nz and critter.duckdns.org":https://archive.org/download//eeb916d1a8ad3f1cb7d8a2d0b91f
>>40554386The index.html files - which contain the first chapter of each story in the html directory - are missing. Same for the sneakpeak directory.
>>40553399>reconcile older threads on saving Google Drive like with the last purge or AT effort. Like someone posted multiple times here about a list, but didn't link it.>figure out how to use resourceKeys to unlock whatever Google Drive folders/files that we or I can.This should be the thread: https://desuarchive.org/mlp/thread/37510688/This was a userscript for automatically adding resource keys to links: https://desuarchive.org/mlp/thread/37510688/#37528365
In desuarchive.org and similar websites, there isn't a "JS thing" where you click a post number and it shows up as a window thing without scrolling the page. This makes reading threads somewhat difficult, like you can end up continually jumping to some post which is a reply to everyone when you try to read replies. example - this thread: https://archive.4plebs.org/tv/thread/190007829/#190015264 . BTW, I saw that 4plebs deleted their internal /plebs/ board: some posts, maybe the majority, might be gone forever, but IDK.>>40554563But is that the case with the warcs? View it with ReplayWeb.Page or whatever software you use to view .warc.gz files. The wget (raws) copy wasn't made by me, and wget isn't that good.
>>40555132I could check the CDX files. Wpull log might show that some pages are duplicates.>https://archive.org/download/eeb916d1a8ad3f1cb7d8a2d0b91f/critter.cloudns.nz/anonfiles/critter.cloudns.nz_stories.7z_extracted/stories/html/scootasprite/c.f.>https://critter.cloudns.nz/stories/html/scootasprite/>https://critter.cloudns.nz/stories/html/scootasprite/contents.html>chapter 1 links to https://critter.cloudns.nz/stories/html/scootasprite/index.htmlImage from that site.
>>40554563>>40555132>>40555252Those index.html files are in the WARC. 39 lines of output from the following command, some shown:>$ curl -sL https://archive.org/download/eeb916d1a8ad3f1cb7d8a2d0b91f/critter.cloudns.nz/critter.cloudns.nz/z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c.cdx | grep "/html/" | grep "index.html">https://critter.cloudns.nz/stories/html/catch_fire/index.html 1682679391 - - XB7LP4B5XPSCEGQ35M7LBG7GUIPB7ROH 13675 120427443 z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c-00000.warc.gz <urn:uuid:8390dd66-5b64-4afe-b388-c48a8a0f233e>>https://critter.cloudns.nz/stories/html/rainbow_project/index.html 1682679392 - - RBQSOC7UDWJ3OOR47FVCSQR3E2KCGHZS 8454 120441719 z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c-00000.warc.gz <urn:uuid:0493e44e-d0ea-427d-8ba9-04f8cc64b6a4>>https://critter.cloudns.nz/stories/html/blank_flanks/index.html 1682679401 - - D553N6OVYODGVGSWREPQTZBDI2PVOEF5 4615 120458816 z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c-00000.warc.gz <urn:uuid:b07864d1-b231-4bd2-a69b-cae496c5dd7f>>https://critter.cloudns.nz/stories/html/guidance/index.html 1682679438 - - 6TF42I4ML4KKNGRDFFM3HPSEQ7XUOVBS 7163 120503071 z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c-00000.warc.gz <urn:uuid:6d4e72d4-aae2-4526-a759-86a757cfd489>>[...]>https://critter.cloudns.nz/stories/html/rare_mare/index.html 1682706709 - - FIWDUC24FRVRFFBOVLUIU2EVBBU6GN3M 19407 1777300201 z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c-00000.warc.gz <urn:uuid:dcafcfd6-9dc4-4271-a965-aac2f933c362>>https://critter.cloudns.nz/stories/html/scootasprite/index.html 1682706755 - - V2LPI4FNO7IQQP6OLD23PAV3FPSVYVH7 23133 1777399163 z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c-00000.warc.gz <urn:uuid:7e2bf88c-cac4-4171-b33f-4527d564c3b6>>https://critter.cloudns.nz/stories/html/oneshots/index.html 1682706864 - - VDYGHUCOVJXKLVNVWYVZVJXTOSI7XXVY 5807 1777826364 z1-data-19db0ac-in1.txt-2023-04-28-97a50f7c-00000.warc.gz <urn:uuid:7d036140-6ac7-43d7-8784-6853d9358587>>[...]pfp from>https://web.archive.org/web/20231121022322/https://y.com.sb/watch?v=AOHfbDnkPEI (npr, I agree with that comment and replies to it)
>>40551544>>40551658Refer to this to see which pastebin.com paste ID that corresponds to:ipfs://bafybeick4eeazuoxzheeizn3y23uibnzcjt33u7gzm7wxfszvhoyzyzpbm>>40554563>sneakpeak*sneakpeek>https://archive.org/download/eeb916d1a8ad3f1cb7d8a2d0b91f/critter.cloudns.nz/anonfiles/critter.cloudns.nz_stories.7z_extracted/stories/sneakpeek/I don't think sneakpeek/ has any index.html files. It's just like wip of the newest chapter.>https://web.archive.org/web/20231121014855/https://critter.cloudns.nz/stories/html/contents.html
>>40553019Doing:>.../z8/web/5d597da/watchmlpfim.blogspot.com$ utc; grab-site https://watchmlpfim.blogspot.com/ 1>1log1.txt 2>1log2.txt; utc>Tue, 21 Nov 2023 03:11:49 +0000>[in progress]>>40555391>https://gateway.ipfs.cybernode.ai/ipfs/bafybeick4eeazuoxzheeizn3y23uibnzcjt33u7gzm7wxfszvhoyzyzpbm?format=carIt's https://pastebin.com/8UKmAEtx>$ ipfs cat QmYT6unkszMqrYXJENPc7sAk6k5iDHMFzGKWiZViWyxB42 | grep hzpQ # QmYT...xB42 = HTML file>[...]?filename=8UKmAEtx[...]>$
>>40553399>Todo: get "./Pony/Website archive/" files per-ID metadata warc ... [first try=fail]Doing this again.>low riskSome Google Drive file IDs in there (>>40447939) are now HTTP 404, such as these two:>1ToS7HpYEMnIxqRKsiZBUMgrB6GKV9aIn>15wPN1TNOCtoWo0zDwjQmJJobAwaniSYX>>40555475>watchmlpfim.blogspot.comDone as of>Tue, 21 Nov 2023 03:30:00 +0000magicalponyreview.blogspot.com = also done:>$ utc; grab-site https://magicalponyreview.blogspot.com/ 1>1log1.txt 2>1log2.txt; utc>Tue, 21 Nov 2023 03:40:31 +0000>Tue, 21 Nov 2023 03:48:35 +0000>$Image from>https://web.archive.org/web/20231119074414/https://vid.puffyan.us/playlist?list=PLNchicDc6xvYqD-GHuuFpgObCxUJ_wb77captcha: H4YW00
>>40538343I memorized how to set a partition in that ISO file to be a loopback device then mount it as a read-write partition (permanent changes to the ISO from writes). Unfortunately, after minutes or hours of IO operations it would always crash this one computer (multiple attempts with /mnt/loop/->). Will try something different.>>40553415If that thread does get made, link it here.>>40555132There>https://web.archive.org/web/20210514111923/https://archive.4plebs.org/plebs/Gone>https://web.archive.org/web/20210812015805/https://archive.4plebs.org/plebs//plebs/ images are still alive, for now.
Thank you for all your work, anons. Our lives would be worse without archives.
>>40555883>Some Google Drive file IDsBefore creating the google drive thread, could you summarise what has been done so far? I didn't know so many IDs have been scraped.
>>40556690>Before creating the google drive thread, could you summarise what has been done so far?I did that here: >>40553399 . I also did a small manual copy of some Google Drive posts to old /mlp/, but that effort doesn't really count.>I didn't know so many IDs have been scraped.I have done like 1/8 of the metadata of the IDs in the following .txt.gz file + I have some of the data + I think someone else has all of the data. I also claim the rest of it (7/8):>currently online: ipfs://QmWzFeb4Qn4Kx83Z8bxtniYv4jKv9RbUjUoTtqxoLAd2eV>( https://web.archive.org/web/20231020153021/https://gateway.ipfs.cybernode.ai/ipfs/QmWzFeb4Qn4Kx83Z8bxtniYv4jKv9RbUjUoTtqxoLAd2eV )Speaking of that, >>40555883>Some Google Drive file IDs in there (>>40447939) are now HTTP 404, such as these two:>- 1ToS7HpYEMnIxqRKsiZBUMgrB6GKV9aIn>- 15wPN1TNOCtoWo0zDwjQmJJobAwaniSYXThose are these:>$ ipfs cat QmWzFeb4Qn4Kx83Z8bxtniYv4jKv9RbUjUoTtqxoLAd2eV | zcat | grep 1ToS7HpYEMnIxqRKsiZBUMgrB6GKV9aIn>[...]{"Path":"Media/en.wikipedia.org-wiki-Equestria/How to open warc files.html","Name":"How to open warc files.html","Size":148,"MimeType":"text/html","ModTime":"2021-05-27T19:03:25.024Z","IsDir":false,"ID":"1ToS7HpYEMnIxqRKsiZBUMgrB6GKV9aIn"},>[...]{"Path":"Media/15.ai/warc/15.ai-2020-11-16-79c9522f-00000.warc.gz","Name":"15.ai-2020-11-16-79c9522f-00000.warc.gz","Size":2471962,"MimeType":"application/gzip","ModTime":"2020-11-16T00:04:08.051Z","IsDir":false,"ID":"15wPN1TNOCtoWo0zDwjQmJJobAwaniSYX"},>[...]$Hoping those files were just moved around and not anything worse.>>40555883>first try=failCrashed again. Seems more likely that grab-site fails with 811,307 lines in "input_file". 120.650 lines in input_file = basically worked. I could cut "start_urls_files_1700372714.txt" in half so I have two files with like 400,000 lines of URLs each, maybe that will work. BTW, if I was using wget, it would try to load the entire ~800MB input file into RAM, gross; from what I've read, grab-site doesn't do that with that file and memory.
BOORU SOON GOING TO SHUTDOWNhttps://furry.booru.org/There was definitely some MLP content there. If it is overly Cloudflare-walled I may not be able to get any WARCs from various access methods.
>>40556902Had more than 3 million posts.https://web.archive.org/web/20230716154231/https://furry.booru.org/Booru.org admin is a FAGGOT, so I suspect I cannot download much. pbooru.com (was owned by booru.org) warc was like 1TB from ~300,000 posts. If this emergency grab works, settings: no offsite links, ignores on certain URL patterns, might need help from other users to get it, might talk to others that might be interested. Also consider: storage limitations.
>>40556902>>40556917Dead and gonehttps://booru.org/furry/https://booru.org/furry/index.php?page=post&s=listhttps://booru.org/furry/index.php?page=post&s=view&id=123000https://furry.booru.org/index.php?page=post&s=view&id=123456https://furry.booru.org/index.php?suckmy=cockhttps://furry.booru.org//images/956/7a4ff6440d77053b9b387163c02ba707428ac45c.gif?980663->https://w3s.link/ipfs/bafybeifjrwlk55bi2anjcsqyirxoxljaju4uwnyzhpbrveh7lplyqoftgi
>>40535081Or this, imported from pipe:>$ curl -sL https://w3s.link/ipfs/bafybeifjrwlk55bi2anjcsqyirxoxljaju4uwnyzhpbrveh7lplyqoftgi?format=car | ipfs dag import ->>40556962Thumbnails and samples gone (HTTP 404)>https://furry.booru.org/thumbnails/3179/thumbnail_8e1151f38de5b4a2d1414d1ca6e760c781753835.jpg?3226333>https://furry.booru.org//samples/3356/sample_d73de8d45c997719f407d0184366bdc22204453f.jpg?3405327Some thumbnails saved:https://web.archive.org/web/20220523045939/https://furry.booru.org/index.php?page=post&s=list&tags=my_little_pony
>>40556962>furry.booru.orgNot listed in here:https://bafkreic6ingxxyqelvin52ubb5cscbzhloez6chody2vbe5dtdkbvdzye4.ipfs.fleek.cool/Loses:- [!] bot / automatic mirror uploads where the source was deleted, not copied elsewhere- [!] non-bot additions, like forum posts, image uploads, comments- everything elseNo recent mention:https://desuarchive.org/mlp/search/text/%22furry.booru.org%22^There was some consideration to grab that entire booru or part of it in the past, but never happened.
>furry.booru.orgStarted in around 2011. It is more than a decade old.https://web.archive.org/web/20110305192702/http://furry.booru.org/Image = screenshot ofhttps://desuarchive.org/mlp/thread/23771920/>Yiff in hell, furfags
*It was more than a decade old.It ran the proprietary closed-source software Gelbooru 0.2 for the entire time. Along with pbooru.com, furry.booru.org likely supported no-derive images.
I'll always be a bit disappointed that pbooru.com is gone (not dead though, static, P2P, ~900GB). Similar website furry.booru.org (~same version of Gelbooru) is now dead and gone. More likely that raws were copied out of FurryBooru to some degree, less likely that anyone got warcs. I can try to think of this in a positive way: now that both of those sites are gone, there is fewer websites/boorus running proprietary software. However, the open source booru software is mostly missing nice and important feature(s) that some or all versions of Gelbooru has.
>>40457499As a summary, data not shared yet:- ipfs refs index before deleting stuff off of server(s)- derpibooru images via 1.00 TB torrents (preferred size by me)>>40556761second try=fail. Might have crashed due to unrelated reasons.
2022 video not in TPA - "Noise storm - Crab Rave (Pony version)" ("silly"):https://y.com.sb/watch?v=3aPDA_2nOocI thought this was funny, video is in TPA - "[A7] Horse Rave":https://www.youtube.com/watch?v=KKDStRx6Ig0>>40555132>>40555355>>40494005>>40494328>>40494209>>40485761>>40556761Chad grab-site vs. virgin wget
>>40475049>>40475621Reason to trust it: works in 32-bit and 64-bit computers. I installed kubo IPFS on a 32-bit Linux computer. Immediately after repo initialization I deleted and symlinked "empty" folders $IPFS_PATH/.ipfs/blocks/ and $IPFS_PATH/.ipfs/datastore/ to the corresponding larger folders in a repo in a different storage device and then I had all of those pins and whatever available. Done for various reasons, one of them: to test it.Reason to not trust it: IPFS might not be operable as a read-only filesystem. In my experience it didn't work. Possible workaround: set the read-write parts to operate on some read-write device, like an HDD or RAM disk. Then it might work as a partly read-only FS.>>40545407>https://w3s.link/ipfs/bafybeiaclozjpgzy5dujt4tomnoezqe2fvwhnkqeohrp2j6ma75b7uvoze/Revenge_Minecraft_Creeper_Song_feat._CaptainSparklez_PMV-Emma_Schmudlach-20140619-youtube-640x360-7ZFKRX7sQQY.webmMissed opportunities: better clips. Examples - could have had clips of Rarity looking for gems, in caves, with a large illusory diamond, finding gems in a rock and getting her cutie mark.>>40557173>"silly"Might also be described as "crap"pfp from>https://web.archive.org/web/20231121212527/https://y.com.sb/watch?v=LDU_Txk06tM (npr, "I am absolutley terrified of crabs. But i cant stop watching this")
next>>40557552
