Download limited number of Puzzles

Hello there!

I would like to download a limited number of puzzles from Lichess without having to download all 4,211,138 from the database. But I don't know how and if this is possible.
Does anyone know more?

Thank you!

Hi, sure!

Looking at the "Standard Chess" tab, there's a section about decompressing .zst format,
https://database.adjva4.dpdns.org/#zst

"ZStandard archives are partially decompressable, so you can start downloading and then cancel at any point. You will be able to decompress the partial download if you only want a smaller set of game data."

Since the puzzles are also in zst format, the same information can be applied to them,
https://database.adjva4.dpdns.org/#puzzles

There's also some dataset collections available at Hugging Face, https://huggingface.co/Lichess

Looking at the puzzles dataset,
https://huggingface.co/datasets/Lichess/chess-puzzles
, there's a an API button which shows a couple of ways to process the data.

One given example to download some of the puzzles is given with:

curl -X GET "https://datasets-server.huggingface.co/rows?dataset=Lichess%2Fchess-puzzles&config=default&split=train&offset=0&length=100"

(The dataset is however not formatted in the CSV format described on the Lichess site, but in some json format...)

Chess on!

Depending on what you want to achieve here, it might or might not be useful to you to know that the Lichess app seems to preload 50 puzzles that you can then solve even without an internet connection.

Iff you're looking to do puzzles off-line, I use Off-line Puzzles. It's free. I also used fileStar to extract the puzzles. This will

@tors42 said in #2:

Looking at the "Standard Chess" tab, there's a section about decompressing .zst format,
database.adjva4.dpdns.org/#zst

"ZStandard archives are partially decompressable, so you can start downloading and then cancel at any point. You will be able to decompress the partial download if you only want a smaller set of game data."

Since the puzzles are also in zst format, the same information can be applied to them,
database.adjva4.dpdns.org/#puzzles

Thank you very much for your answer. I tried to partially download the file with the puzzles (the one on the Lichess database) and then stop it. But I got a “CRDOWNLOAD” file that I can't open and when I stop the download, the file disappears.
Do you know how I can get the file data?

Do you know how I can get the file data?

No. Sounds like you were close though!
Maybe you can copy the file to a backup file, before you cancel the download?
Or maybe you can exit the application you are using, instead of cancelling the download?
Try to outsmart that Technology! :)

Or maybe it is possible to search for other applications, than the one you are using, which can download files partially.

@tommy_plays said in #1:

Hello there!

I would like to download a limited number of puzzles from Lichess without having to download all 4,211,138 from the database. But I don't know how and if this is possible.
Does anyone know more?

Thank you!

Are you trying to avoid having to deal with a 700+ MB csv file, or do you just want to limit the number of games to a small number for simplicity? If the file size isn't important, you can download and install the "offline-chess-puzzles" program. With that program, you can filter the number of games that you see to any number that you want. (That is, the first x number of games.) Also, you can filter the games by a range of minimum and maximum ratings.

@tors42 said in #6:

Thank you it worked!!

@NeuralGnat said in #7:

, or do you just want to limit the number of games to a small number for simplicity?

Yes, I do not want to download all 4 000 000 puzzles.