also i hope the curl joke is correct i don’t use it that much

also i hope there are itysl fans here

      • krashmo@lemmy.world
        9·
        8 months ago

        I really like that the link at the bottom of the page says “check out more stuff you should be using” but that URL takes you to a page where the curl article is the only link.

        “more coming soon. Or not. I don’t owe you shit”

        A majestic site indeed. Bravo sir.

    • azimir@lemmy.ml
      1·
      8 months ago

      I feel bad that I read that page in Chrome. I’m a failure of a techie.

      Tomorrow I must atone by teaching more students terminal commands. Maybe using web API calls with cURL. Or get and some eviloverlord.com quotes?

  • synae[he/him]@lemmy.dbzer0.comEnglish
    5·
    8 months ago

    whenever someone at work says they have trouble with a web service or api I’m like “Idk I can curl it just fine, what’s your request look like” and you would not believe how many developers get confused by this question. It’s so goddamn frustrating

  • pelya@lemmy.world
    5·
    8 months ago

    Recursively dumping all data from the server was always a wget thing, it will create a nice directory structure for you and will also convert links in webpages to point to your local file system.

  • MonkderVierte@lemmy.zip
    0·
    8 months ago

    aria2c -c -x 10 -k 5M rocks. Faster and more persistent than Firefox’ built-in downloader, while still working on most servers.

      • luciferofastora@feddit.org
        2·
        8 months ago

        Excerpted from the manual linked by the other response by @funkless_eck@sh.itjust.works for those who don’t want to dig through it:

        aria2 is a utility for downloading files. The supported protocols are HTTP(S), FTP, BitTorrent, and Metalink. aria2 can download a file from multiple sources/protocols and tries to utilize your maximum download bandwidth.

        Basically, a powerful and versatile file downloader. It includes options to distribute downloads across multiple connections, download a bunch of files at once, automatically retry failed downloads, authorization, cookies and a lot of fancy options.

        @MonkderVierte@lemmy.zip has already explained what the specific flags in this case do:

        I think (a while ago)

        • -c is with a temp file to pick up again on failure
        • -x 10: # of connections
        • -k 5M: block size or something

        Specifically -x is the maximum number of connections per server, relevant mostly if multiple downloads are queried at once. -k defines the minimum size per block downloaded. In this case, if the file is smaller than 10MiB, it won’t be split because that would make the parts smaller than 5MiB. If it is larger, aria2c will split it into multiple connections, up to a default of 5 (unless a differenr value is specified by -s).